Principal Data & ML Ops Architect (Remote, Continental United States)
ICA.ai Open · verified Oct 22, 2026 At a glance
Senior ML Platform & Ops role at ICA.ai. Remote, United States · full-time · no salary stated · we estimate $180,000–$245,000 across the United States.
ICA.ai has not published a salary for this role. The figure below is our estimate, not theirs.
aimlroles summary, based on the employer's posting.
What you'll do
- Shape data and document platforms from initial intake through the systems that use their outputs
- Set reusable approaches for parsing, extracting, checking, storing, searching, reviewing and reprocessing documents
- Define how schemas, metadata, lineage, quality and audit records are managed across data systems
- Build ingestion and transformation flows for APIs, files, batch jobs and streaming when needed
- Review designs, troubleshoot live failures and mentor engineers while staying hands-on with Python, SQL and pipelines
What you bring
- You have owned production data platforms or distributed systems, with strong Python, SQL, data modeling and ETL/ELT skills
- You have substantial experience operating large-scale systems for unstructured data or document processing
- You understand data governance, lineage, quality, observability, recovery and controls for sensitive information
- You can connect production data architecture to AI/ML and retrieval systems, and make clear technical decisions
- You are authorized to work in the United States, have lived there for at least three consecutive years and can obtain Public Trust clearance
Who this fits
This is a hands-on principal-level architecture role that includes technical reviews, incident investigation and mentoring. You can work remotely from the continental United States, with Eastern Standard Time hours; candidates in the DMV area are preferred.
From the employer
About ICA, Inc.
ICA, Inc. is a rapidly growing company, located in the D.C./Metro area. We were founded in 2009 to assist government clients with evaluating and achieving their objectives. We have become a trusted advisor helping our clients by offering cutting-edge innovation and solutions to complex projects. Our small company has grown significantly, and we're overjoyed at the opportunity to expand yet again!
We are results-focused and have a proven track record supporting federal agencies and large government services primes in three main areas: Research and Data Analysis, Advanced-Data Science, and Strategic Services. We currently support multiple analytics and research programs across HHS.
At ICA, we believe our success starts with our people. We foster a collaborative "one team" environment where work-life balance isn't just talked about – it's prioritized. We're building dynamic, highly skilled teams in a welcoming and supportive atmosphere. If you're passionate about using your technical expertise to make a difference, we want to talk to you.
ABOUT THE ROLE:
We are seeking a hands-on Principal Data & ML Ops Architect to lead the architecture of our data and document-intelligence platforms. ICA works across healthcare, federal health, regulatory and life-sciences environments, building systems that turn complex structured and unstructured data into reliable, actionable intelligence.
This role is responsible for designing scalable platforms that ingest, process, govern, and serve large volumes of data and documents for analytics, AI/ML, RAG, search, and operational applications. You will help modernize and unify existing platforms while establishing reusable architectural patterns for new solutions.
KEY RESPONSIBILITIES:
- Architect large-scale data and document-processing platforms, from ingestion through downstream consumption.
- Design robust patterns for document parsing, extraction, normalization, validation, storage, search, human review, and reprocessing.
- Establish standards for schemas, metadata, lineage, provenance, data quality, reproducibility, and auditability.
- Design reliable ingestion and transformation pipelines using APIs, files, batch processing, and streaming where appropriate.
- Create platform patterns that enable Data Science and AI prototypes to become secure, maintainable production solutions.
- Architect data and retrieval foundations supporting RAG, analytics, AI workflows, evaluation, and feedback loops.
- Make architecture decisions involving scalability, reliability, security, privacy, cost, and operational complexity.
- Lead technical design reviews, investigate production failures, mentor engineers, and work across Data Engineering, Data Science, DevOps/MLOps, Product, Security, and client teams.
- Remain technically hands-on enough to review and develop Python, SQL, schemas, APIs, and production data pipelines.
REQUIRED QUALIFICATIONS:
- Deep experience architecting and owning production data platforms or distributed data systems.
- Strong Python, SQL, data modeling, ETL/ELT, workflow orchestration, and cloud-data-platform experience.
- Significant experience with unstructured data or document-processing systems at scale.
- Strong understanding of metadata, schema evolution, lineage, provenance, data quality, observability, retries, replay, backfills, and recovery.
- Experience designing systems with sensitive-data controls, governance, access management, and audit requirements.
- Strong understanding of how modern AI/ML and retrieval systems depend on production data architecture.
- Demonstrated technical judgment, ownership, problem solving, and ability to challenge fragile or overly complex designs.
- Strong technical communication and decision-making skills.
- Must be authorized to work in the United States and have lived in the US for 3 or more consecutive years.
- Must be able and willing to obtain a Public Trust Clearance
PREFERRED QUALIFICATIONS:
- Experience in healthcare, life sciences, government, regulated industries, PHI/PII, or GDPR environments is valuable, but not required.
UNAUTHORIZED USE OF AI ASSISTIVE TECHNOLOGY: All application materials must be your own original work, and interviews must be completed independently. The use of AI-generated content or AI-assisted technologies during the application or interview process is prohibited unless interviewers provide explicit permission for specific activities during a live technical assessment. Any unauthorized use of AI will result in disqualification from the hiring process.
BENEFITS:
We invest in our team members so you can live your best life professionally and personally, offering a competitive salary and benefits.
- Health Insurance -100% employer-paid premiums – ICA covers the full cost of one of three offered medical plans
- Dental Insurance
- Vision insurance
- Health Spending Account
- Flexible Spending Account
- Life and Disability insurance
- 401(k) plan with company match
- Paid Time Off (Vacation, Sick Leave and Holidays)
- Education and Professional Development Assistance
- Remote work from anywhere within the continental United States
LOCATION & TELEWORK
This is a remote position following Eastern Standard Time (EST). Candidates residing in the DMV area preferred.
ADDITIONAL INFORMATION:
ICA is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender, gender identity or expression, national origin, genetics, disability status, protected veteran status, age, or any other characteristic protected by state, federal or local laws.
This policy applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.