AI enabled RPA using ChatGPT and computer vision

Founding Applied AI Engineer

$165K - $185K / 0.50% - 1.50%
San Francisco, CA, US
Job Type
6+ years
Connect directly with founders of the best YC-fundedstartups.
Apply to role
Lucas Ochoa
Lucas Ochoa

About the role

San Francisco, California

Company Overview: At Automat, we're at the forefront of integrating cutting-edge research into user-centric products. Our philosophy, "Get the toys to the kids," drives our commitment to transforming knowledge work through Large Language Models (LLMs). We envision a future where intelligent agents streamline business operations and even one day could run their own enterprises. Our focus lies in developing the necessary tooling and infrastructure to incorporate the advancements of transformer models into practical, real-world applications.

Role Description:

As an Applied AI Engineer, you will play a pivotal role in developing Automat's Automation AutomatorTM, a platform that epitomizes our commitment to innovation and practical application of AI technology. You will collaborate closely with our forward-deploy engineers, understanding their requirements, and crafting tailored solutions. Your role is critical in shaping both our strategic product direction and company ethos.


  • Develop and enhance the Automat Sandbox, a standalone automation builder.
  • Work on vision models for UI decision-making and detection, similar to OpenAI's CLIP.
  • Create and refine code-generation tooling.
  • Engage in collaborative problem-solving with the engineering team, contributing to product strategy and execution.


  • Strong background in Computer Vision, Deep Learning, Machine Learning, and NLP.
  • Proficiency in Python and JavaScript.
  • Experience with frontend frameworks like React and REST APIs.
  • Expertise in building applications leveraging LLMs, with an understanding of performance, latency, and deployment considerations.
  • Familiarity with LLM-enabled software tooling, including frameworks (LangChain, LlamaIndex), vector databases, caching solutions (Redis), and monitoring tools.
  • Knowledge of secure deployment practices and robustness against prompt injection.


Minimum 6 years of experience as a software engineer, with a focus on app and interface development.

  • Familiarity with AI frameworks such as PyTorch.
  • Excellent communication and teamwork skills.
  • Bonus: Experience in building LLM-powered agents capable of API interactions.

What You Will Define:

  • Engineering standards and best practices.
  • Company culture and values.
  • Strategic product decisions and company direction.

About the interview

The interview process is a deeper dive into technical abilities, product thinking and overall fit. For the fit portion, we are again looking for ownership and autonomy, but we also dig deeper into communication. This is evaluated throughout the process -- in how you communicate your approach, solutions and overall thinking.

  1. Initial meeting - Get to know Lucas. Chat about Automat & any relevant experience you might have.

  2. Talk Tech with Gautam - Chat about some of your previous work, experiences, and skill with Gautam

  3. Lucas closing interview. We'll be able to make a decision fairly quickly. If you're open to the idea we'd also consider doing a 1-2 week paid work trial to see if it's a good fit.

About Automat

Automat is the fastest and most affordable way to create automations. We're enabling Robotic Process Automation for Chrome using ChatGPT and Computer Vision

Team Size:
Location:San Francisco
Gautam Bose
Gautam Bose
Lucas Ochoa
Lucas Ochoa