AI Quality Assurance Analyst (Hybrid)

Title: Quality Assurance Analyst – AI Software Development Engineer in Test

Location: Charlotte, NC (Hybrid)

Note: This is a W2 contract role – C2C and 3 rd party candidates will NOT be considered

The AI Software Development Engineer in Test will be responsible for:

· Helping create a culture that motivates teams to ensure zero defects leak into production

· Working across teams to understand enterprise quality requirements and ensure adoption of core processes and standards

· Implementing the shift-left test strategy for each line of business

· Leveraging open-source automation frameworks and tools across all levels of testing that integrate in the automated CI/CD pipeline

· Participating in Agile (Scrum) team processes, performing required standard testing activities, and keeping the customer experience top of mind during the testing process

· Working with internal teams to document test environment, test data management container strategies, and provisioning for different types of testing activities

· Comprehending and decomposing user stories/requirements to identify what tests need to be created and automated across all levels of testing

Position Qualifications:

· 5+ years of experience in test automation engineering

· Proficiency writing code in Python, preferably within the context of integration testing

· Strong functional & API based testing experience, including a strong understanding of how APIs function

· Experience with up-to-date AI paradigms, including Large Language Models, classification models, MCP for agentic workflows, RAG, & dynamic prompting for LLMs

· Experience writing end to end test scripts utilizing multiple services and reporting results

· Experience using SQL to join and query data across multiple tables and schemas

· Experience with AWS services, including S3, Lambda, Dynamo DB, Cloudwatch, etc.

· Experience with CI/CD supporting technologies, including GIT, GitLab, Docker, etc.

· Experience with up-to-date AI paradigms, including Large Language Models, classification models, MCP for agentic workflows, & dynamic prompting for LLMs

· Extensive knowledge of White Box Testing practices

· Strong understanding of software engineering best practices for the full software development lifecycle, including coding standards, code reviews, source control, build and release processes, continuous integration and continuous deployment concepts (CI & CD), and test suite development and maintenance

· Working knowledge of commonly used ML/AI Python libraries/packages

· Experience with Spacy, nltk, etc.

· Experience troubleshooting issues and performing root cause analysis

· A deep understanding of shift-left test practices / techniques, along with the frameworks / tools that support it

· Strong written and verbal communication skills

· An enthusiastic and inherent curiosity to break code

· Experience automating API tests, including extensive knowledge in creating and leveraging mocks, stubs, and virtual services to fulfill test automation requirements preferred

· Experience automating tests for the full solution stack (unit, business logic, contract, usability, functional, performance) preferred

· Experience testing AI implementations, including an understanding of the risks models pose to systems and the business at large preferred

· Experience leaving feedback on Merge/Pull Requests to ensure teams follow best practices highly preferred

· Financial services technology / consumer banking testing experience highly preferred

· Experience with Genesys IVR or Salesforce platform highly preferred

· A minimum of a BS/MS in Computer Science, Engineering, or other related field

Note: This is a W2 contract role – C2C and 3 rd party candidates will NOT be considered

.

Apply Job!

Apply to this Job