Senior AI Software Engineer
Company: webAI
Location: Austin
Posted on: April 2, 2026
|
|
|
Job Description:
About Us: webAI is pioneering the future of artificial
intelligence by establishing the first distributed AI
infrastructure dedicated to personalized AI. We recognize the
evolving demands of a data-driven society for scalability and
flexibility, and we firmly believe that the future of AI lies in
distributed processing at the edge, bringing computation closer to
the source of data generation. Our mission is to build a future
where a company's valuable data and intellectual property remain
entirely private, enabling the deployment of large-scale AI models
directly on standard consumer hardware without compromising the
information embedded within those models. We are developing an
end-to-end platform that is secure, scalable, and fully under the
control of our users, empowering enterprises with AI that
understands their unique business. We are a team driven by truth,
ownership, tenacity, and humility , and we seek individuals who
resonate with these core values and are passionate about shaping
the next generation of AI. About the Role: We are looking for a
Senior AI Software Engineer with deep expertise in high-performance
computing and machine learning inference. In this role, you’ll
design and optimize inference engines for on-device applications on
Apple platforms (macOS & iOS), leveraging Metal and MLX to push
performance to its limits. This is an ideal opportunity for someone
who thrives at the intersection of low-level systems programming,
applied machine learning, and hardware-aware optimization. Key
Responsibilities Implement and optimize advanced ML architectures
(Transformers, Mixture of Experts, Diffusion models) in C++, with a
focus on performance and memory efficiency. Develop and fine-tune
custom Metal kernels for performance-critical inference operations.
Apply advanced model quantization techniques (low-bit,
mixed-precision) to accelerate performance while minimizing
footprint. Profile, benchmark, and tune inference on Apple Silicon
(M-series, A-series), identifying and eliminating bottlenecks.
Collaborate on API design and build Python bindings for C++
libraries. Contribute to robust testing frameworks to ensure
reliability and performance. Requirements & Skills Bachelor’s
degree in CS, EE, or a related field, or equivalent experience. 4
years of professional experience in C++ systems programming. Strong
understanding of computer architecture, data structures, and
algorithms. Demonstrated experience with performance profiling and
low-level optimization. Familiarity with deep learning concepts and
architectures (Transformers, Diffusion models, Mixture of Experts).
Preferred (but not required) Deep expertise with Apple’s MLX
framework. Demonstrable experience writing and optimizing custom
Metal kernels. Experience with model quantization techniques and
their performance implications. Familiarity with the iOS/macOS
development ecosystem and build systems ( CMake ). Experience
creating Python bindings for C++ libraries. We at webAI are
committed to living out the core values we have put in place as the
foundation on which we operate as a team. We seek individuals who
exemplify the following: Truth - Emphasizing transparency and
honesty in every interaction and decision. Ownership - Taking full
responsibility for one’s actions and decisions, demonstrating
commitment to the success of our clients. Tenacity - Persisting in
the face of challenges and setbacks, continually striving for
excellence and improvement. Humility - Maintaining a respectful and
learning-oriented mindset, acknowledging the strengths and
contributions of others. Benefits: Competitive salary and
performance-based incentives. Comprehensive health, dental, and
vision benefits package. 401k Match (US-based only) $200/mos Health
and Wellness Stipend $400/year Continuing Education Credit
$500/year Function Health subscription (US-based only) Free
parking, for in-office employees Unlimited Approved PTO Parental
Leave for Eligible Employees Supplemental Life Insurance webAI is
an Equal Opportunity Employer and does not discriminate against any
employee or applicant on the basis of age, ancestry, color, family
or medical care leave, gender identity or expression, genetic
information, marital status, medical condition, national origin,
physical or mental disability, protected veteran status, race,
religion, sex (including pregnancy), sexual orientation, or any
other characteristic protected by applicable laws, regulations and
ordinances. We adhere to these principles in all aspects of
employment, including recruitment, hiring, training, compensation,
promotion, benefits, social and recreational programs, and
discipline. In addition, it is the policy of webAI to provide
reasonable accommodation to qualified employees who have protected
disabilities to the extent required by applicable laws, regulations
and ordinances where a particular employee works.
Keywords: webAI, College Station , Senior AI Software Engineer, IT / Software / Systems , Austin, Texas