{"id":65540,"title":"Dev Tools AI 🤖 CoPilot for UI Testing","tagline":"We make writing UI automation tests as easy so you can solve bigger problems","body":"# **TL;DR**\n\n[Dev Tools](https://www.dev-tools.ai/) is a library that makes it easy to write web tests in your existing framework by drawing a box over a screenshot instead of building a locator.\n\n![uploaded image](/media/?type=post\u0026id=65540\u0026key=user_uploads/1076464/6cf84e73-20ac-4ca5-994d-329f77e7b325)\n\n\n# **🤕Problem**\n\nWriting end to end tests is difficult and time consuming. It takes forever to dig into the page code to build the right XPath or locator. And even when these are found, they are likely to change over time as the product continues development.\n\n# **⚡️Our solution**\n\nWe use computer vision to look at the screen, like an end user, and find the element you want to interact with. Then, in real-time, we find the element and return it so all your existing automation can keep working with it. We make this easy to use by extending Selenium with a `findByAI()` method where you just put a human readable name and let the AI do the hard work.\n\nWe even let you see the elements from within your IDE!\n\n![uploaded image](/media/?type=post\u0026id=65540\u0026key=user_uploads/1076464/bb8100b8-b570-4aeb-8bae-fd49cd8d470d)\n\n# **🎉 Bonus Features**\n\n### Work on Games\n\nTraditional automation has trouble working with games as most games render within a canvas element. Because we only use the screenshot, and not page source, we can play games like LooneyToons!\n\n![uploaded image](/media/?type=post\u0026id=65540\u0026key=user_uploads/1076464/3feb64e1-36cd-47c0-93f5-a8c3e98d10d1)\n\n### Crawl for Errors\n\nMonkey Testing for errors comes standard with Android, but there isn’t a default one for Web. We added that functionality to our SDK so that you simply call `scan_domain()` and it will crawl your page and look for errors like broken links, 404s, console errors, etc. Learn more in our [blog](https://www.dev-tools.ai/blog/site-sacnner) about the feature.\n\n# **Our Ask - Try it out and give us feedback**\n\nIf you write or have written Selenium or UI tests, we would love your feedback on the tool.\n\nJoin us on [Discord](https://discord.gg/2J9WEYdq5C), or follow us on [Linkedin](https://www.linkedin.com/company/dev-tools-ai)!\n\nIf you have any questions or automation challenges, reach out to us anytime! [chris@dev-tools.ai](mailto:chris@dev-tools.ai) \u0026 [etienne@dev-tools.ai](mailto:etienne@dev-tools.ai)","slug":"H36-dev-tools-ai-copilot-for-ui-testing","created_at":"2022-08-22T17:01:29.766Z","updated_at":"2026-04-29T17:40:54.164Z","total_vote_count":53,"url":"https://www.ycombinator.com/launches/H36-dev-tools-ai-copilot-for-ui-testing","share_image_url":"//bookface-static.ycombinator.com/assets/ycdc/yc-og-image-c440a0ad1dacfb86eeeb343717479cc54d256614449b4ef719977a0a451f8bc8.png","company":{"id":27264,"name":"Dev Tools AI","slug":"dev-tools-ai","url":"https://dev-tools.ai","logo":"https://bookface-images.s3.amazonaws.com/small_logos/52816343555456026d1de1250894ad8361d57799.png","batch":"Summer 2022","industry":"B2B","tags":["Artificial Intelligence","B2B","Productivity","Enterprise"],"search_path":"https://bookface.ycombinator.com/company/27264"}}