Chip Huyen

The more I work with machine learning in production, the more I realize how important probability & statistics is and how hard it is to do it right.

It's easy to split data. It's hard to sample data.

It's easy to write metrics. It's hard to understand what metrics measure.

It's easy to look at dashboards. It's much, much harder to interpret numbers and know what to do about them.

#machinelearning #mlops #statistics

Guys, hear me out. What if instead of showing students that same convnet picture in 10 different classes, some classes teach ML students engineering principles? Idk, something like unit test, CI/CD, performance profiling, typing, encoding, databases, etc.?

#mlops #machinelearning #engineering #datascience

It’s been so inspiring to hear about the amazing things people are working on in the AI & compute space at #GTC2024!

- Christian Szegegy: who’s currently working on reasoning for xAI’s Grok. He believes that solving math is the best path towards intelligence. Math is more than just computing numbers. Math is essential for many tasks: logic, coding, science discovery… His team is working on making Grok the superhuman mathematician. Fun fact: at xAI, they don’t have data annotators but they have AI tutors.

- Clément Farabet: VP of Research at DeepMind who’s leading the development of Gemma. He got me access to Gemini 1.5 Pro, a small mixture-of-expert model that can process 1 million token context length. Let me know what tasks you’d like me to experiment with!

- Sameer Raheja: senior director of engineering at NVIDIA. His team, RAPIDS AI, works on this challenging problem of making data processing cheaper and faster on GPUs. Companies like Paypal already saw up to 70% cost savings by moving data processing from CPUs to GPUs — check out Ilay Chen’s talk on it today!

- Kyle Kranen: engineering manager at NVIDIA who works on optimization for NIM, NVIDIA’s Inference Microservices. NIM is a suite of pre-built, optimized containers for AI models that allow users to deploy AI models anywhere.

- Adel El Hallak: senior director of product at NVIDIA who leads the development of NVIDIA’s API catalog that allows users to quickly try out open source and close source models, before deploying them with NIM.

If you want to learn more about data processing on GPUs, our team at Voltron Data will be presenting at Lambda Labs booth today (Wed) at 2pm and tomorrow (Thu) at 11am!

#gpu #aiengineering #llmops

As an engineer who've learned so much from writing, I love meeting other engineers who write. It's great seeing Joe Reis 🤓 (Fundamentals of Data Engineering), Matt Topol (In-memory Analytics with Apache Arrow), Alex Merced (Apache Iceberg: A Definite Guide), and so many other great folks in town for #SnowflakeSummit!

Matt and I will be at Snowflake Dev Day the whole day and we'll have a few copies of our books to give away. Come say hi!!

#dataengineering