AI Software Engineer
At a glance
Mid-level AI Engineering role at webAI. Austin · full-time · no salary stated · we estimate $118,350–$140,400.
webAI has not published a salary for this role. The figure below is our estimate, not theirs.
aimlroles summary, based on the employer's posting.
What you'll do
- Use pruning, quantization and distillation to reduce model demands on edge hardware and high-volume cloud systems
- Package models as fast APIs, then connect those interfaces to the surrounding software
- Develop and support ML frameworks that scale experiments for AI scientists
- Refactor research code alongside an AI Scientist into dependable, maintainable production software
What you bring
- At least five years in software engineering or equivalent university study, with strong ML systems and distributed computing experience
- A bachelor's or master's in computer science or software engineering
- Proficiency with C++ or Python, Docker or Kubernetes, vector databases, and ML CI/CD
Who this fits
This role suits an engineer focused on inference performance, low-level software and hardware-aware optimization. It is based in Austin, United States.
From the employer
About Us:
webAI is pioneering the future of artificial intelligence by establishing the first distributed AI infrastructure dedicated to personalized AI. We recognize the evolving demands of a data driven society for scalability and flexibility, and we firmly believe that the future of AI lies in distributed processing at the edge, bringing computation closer to the source of data generation.
Our mission is to build a future where a company's valuable data and intellectual property remain entirely private, enabling the deployment of large-scale AI models directly on standard consumer hardware without compromising the information embedded within those models. We are developing an end-to-end platform that is secure, scalable, and fully under the control of our users, empowering enterprises with AI that understands their unique business. We are a team driven by truth, ownership, tenacity, and humility, and we seek individuals who resonate with these core values and are passionate about shaping the next generation of AI.
About the Role:
The webAI Intelligence Lab (WIL) is looking for an AI Software Engineer with deep expertise in high-performance computing and machine learning inference. The AI Engineer is the "builder" who makes the science real. They take raw models and turn them into scalable, efficient, and reliable software. They are the masters of the production environment focusing on latency, reliability, and data integrity.
This is an ideal opportunity for someone who thrives at the intersection of low-level systems programming, applied machine learning, and hardware-aware optimization.
Key Responsibilities
Optimization: Implement techniques like pruning, quantization, and distillation to ensure models run efficiently on edge devices or in high-traffic cloud environments.
Model Deployment: Wrap models in high-performance APIs and integrate them into the broader software ecosystem.
Inference Engines: Build and maintain ML frameworks that enable the AI Scientist’s experiments at scale.
Collaboration: Work closely with the AI Scientist to refactor "research code" into production-grade, maintainable code.
Requirements & Skills
Experience: 5+ years in Software Engineering or equivalent university time with a deep experience that matches WIL objectives to include with a focus on ML-specific systems and distributed computing.
Technical Depth: Proficiency in C++/Python, Docker/Kubernetes, Vector Databases (Pinecone, Weaviate), and CI/CD for ML.
Education: Bachelor’s or Master’s in Computer Science or Software Engineering.
We at webAI are committed to living out the core values we have put in place as the foundation on which we operate as a team. We seek individuals who exemplify the following:
Truth - Emphasizing transparency and honesty in every interaction and decision.
Ownership - Taking full responsibility for one’s actions and decisions, demonstrating commitment to the success of our clients.
Tenacity - Persisting in the face of challenges and setbacks, continually striving for excellence and improvement.
Humility - Maintaining a respectful and learning-oriented mindset, acknowledging the strengths and contributions of others.
Benefits:
We strive to provide competitive benefits to all employees. The benefits listed in this posting generally apply to U.S.-based employees. For employees hired outside the United States, benefits may vary based on local law, country-specific requirements, and the employment platform or entity through which the employee is hired.
Competitive salary and performance-based incentives
Comprehensive health, dental, and vision benefits package
Including a high-deductible HSA option with company contribution
401k match (US-based only)
Flexible PTO Policy
Parental leave for eligible employees
Continuing education support
Basic, company-paid life insurance
Supplemental life insurance
Company-paid short and long term disability
Free parking for in-office employees
webAI is an Equal Opportunity Employer and does not discriminate against any employee or applicant on the basis of age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We adhere to these principles in all aspects of employment, including recruitment, hiring, training, compensation, promotion, benefits, social and recreational programs, and discipline. In addition, it is the policy of webAI to provide reasonable accommodation to qualified employees who have protected disabilities to the extent required by applicable laws, regulations and ordinances where a particular employee works.