About Impact Analytics
Impact Analytics is an agentic-first AI software company transforming retail merchandising through cutting-edge AI, LLMs, and Generative AI technologies. As a fast-growing Series D company with deployments across five continents, it is building both industry-leading merchandising solutions and foundational AI agents that are redefining how retail decisions are made.
What makes Impact Analytics unique is its combination of deep retail domain expertise, strong innovation culture, and global presence. It is one of the few India-born AI companies recognized globally by organizations like Fortune, Gartner, and the Inc. 5000.
For candidates looking to work on next-generation AI products with global scale and real-world impact, Impact Analytics is an exciting place to build your career. Here’s a link to our website: www.impactanalytics.co.
The impact that you will be making
We are looking for a highly motivated QA Intern to join the team building our Agent Studio. This role offers hands-on experience in the challenging, non-deterministic world of Generative AI, focusing on quality assurance for autonomous agents and complex multi-step workflows. You will play a crucial role in validating agent behaviour, reasoning, tool-use, and safety.
What lands you in this role
Required Skills & Qualifications
- Currently pursuing or recently completed a degree in Computer Science, Information Technology, or a related technical field.
- Basic understanding of Generative AI/LLMs and their non-deterministic nature.
- Foundational knowledge of Software Quality Assurance (QA) principles and the Software Development Lifecycle (SDLC).
- Strong analytical and critical thinking skills with exceptional attention to detail.
- Familiarity with at least one bug-tracking tool (e.g., Jira, Asana) and writing clear defect reports
- Basic scripting skills (Python is a plus) for simple data analysis or test execution.
- Excellent communication and collaboration skills to work with engineers and researchers.
Key Responsibilities
- Agent Validation: Execute and document test plans specifically designed to validate the reasoning, planning, and decision-making capabilities of autonomous AI agents.
- Workflow Testing: Manually and semi-automatically test end-to-end multi-step workflows orchestrated by GenAI agents across enterprise tasks.
- Defect Analysis: Identify, meticulously document, and track complex defects, especially those related to agent hallucination, poor tool selection, or memory failure.
- Test Case Development: Assist in writing and refining test scenarios, focusing on edge cases, long-running tasks, and multi-agent collaboration failure points.
- Documentation & Reporting: Maintain clear test results, contribute to quality metrics, and provide timely feedback to engineering and product teams.
Preferred Skills:
- Experience with testing APIs (e.g., using Postman) and Load testing
- Interest in exploring and setting up basic automated QA for LLM responses.
What we offer
- An opportunity to work with the best companies globally.
- Opportunities to quench your thirst for problem-solving, experimenting, learning, and
- implementing innovative solutions
- A flat, collegial work environment, with a work hard, play hard attitude
- A platform for rapid growth if you are willing to try new things without fear of failure.
- Remuneration with best in class industry standards with generous health insurance cover
Our accolades include:
- Ranked #72 in America’s Most innovative Companies list in 2023 alongside companies like Microsoft, Tesla, Apple, IBM, etc.
- Ranked as one of America' s fastest growing companies by Financial Times for four consecutive years: 2020-2023.
- Ranked as one of America' s fastest-growing private companies by Inc 5000 for Six consecutive years: 2018-2023.
- Recognized in multiple Gartner reports, including Market Guides and Hype Cycle, spanning assortment, merchandising, forecasting, algorithmic retailing, and Unified Price, Promotion, and Markdown Optimization Applications.
- Featured as one of top 25 ML startups to watch by Forbes in 2019.
- Ranked as one of North Americas' fastest-growing technology companies by Deloitte for two consecutive years 2019 & 2020