Biography
Alay Shah is a ML Software Engineer at FEDML, currently leading the development of AI / ML platform that facilitates distributed execution and deployment for GenAI tasks. Anything that falls at the intersection of Machine Learning and Distributed Systems excites him the most!
Interests
- Large Language Models
- Distributed Systems
- Deep Learning
- Computer Vision
- Machine Learning
Education
Master’s in Computer Science, 2021
University of Southern California
Post Graduate Diploma in Data Science, 2018
International Institute of Information Technology
Bachelor’s in Mechanical Engineering, 2017
Gujarat Technological University
Experience
ML Software Engineer
- Building AI/ML platform that facilitates distributed execution and deployment for GenAI tasks.
- Tech lead of orchestration and scheduling layer that enables spot jobs and model deployments on a decentralized compute plane.
- Projects where I’ve played a significant role: Launch, Deploy, Compute, Storage
- Technologies: Python, Java, SQL, Git, Docker, Kubernetes, Pytorch, MQTT, Redis, Bash, Jenkins, Jira
Backend Software Engineer
- Implemented monitoring and alerting systems for databases, resulting in a 75% reduction in downtime and a 50% increase in response time.
- Developed Python automation scripts to transition assets to a multi-tenant environment, reducing human effort by 90%.
- Contributed to improving authorization frameworks for data protection in multi-tenant setups.
- Technologies: Java, Python, Golang, Bash, SQL, Git, Docker, Kubernetes, AWS, Observability
Research Assistant
- Advised by Professor Salman Avestimehr
- Research Areas: Distributed Systems, Deep Learning, Computer Vision, Federated Learning, Machine Learning
- Projects: FedCV, FedSegment
- Technologies: Python, Pytorch, Communication Protocols
Software Engineer Intern
- Developed visualization dashboard for forecast reports, aiding evaluation and improvement of ML model forecasts via user-friendly scenario-driven charts with customizable options.
- Technologies: Vue, Javascript, Java
Skills
Programming Languages
Python, Java, Golang, C/C++, Bash, SQL
Tools & Technologies
Docker, Kubernetes, AWS, Git, Redis, MQTT, Observability
Machine Learning
Pytorch, Tensorflow, Keras
Featured Publications
Projects
*
Implemented a computational offloading distributed system based on client-server architecture using UDP and TCP sockets.