Shivani Modi

Founding Engineer at Konko AI

Shivani Modi is a distinguished leader in the field of artificial intelligence, specializing in machine learning and large language models (LLMs). As the Head of AI and Machine Learning at Konko AI, Shivani has been pivotal in pioneering multi-agent frameworks that enhance the capabilities of LLMs, driving innovation and efficiency in AI applications.

With a robust background that includes roles at IBM, SAP, Amazon, and C3 AI, Shivani has spearheaded innovations that delivered enterprise solutions with multimillion-dollar impacts. Her expertise spans across deep learning, natural language processing, and the scalable optimization of AI models. Shivani holds a Master’s degree from Columbia University, where she focused on machine learning, further solidifying her technical foundation.

Shivani is renowned not only for her technical prowess but also for her leadership in the AI community. She has been instrumental in organizing hackathons, mentoring up-and-coming talents, and delivering impactful keynotes that bridge the gap between AI theory and its practical applications. Her commitment extends to ethical AI use, advising on AI integration for public services in Santa Clara County.

At Konko AI, Shivani leads initiatives to empower developers and product teams with tools to select and scale LLMs effectively, focusing on security, reliability, and cost-efficiency. She is also involved in building a multi-agent framework for AI agents powered by Generative AI.

Shivani’s technical skills are extensive, including proficiency in Python, R, and SQL, and expertise in frameworks like TensorFlow, PyTorch, and Keras. She is skilled in MLOps tools such as AirFlow and KubeFlow, and familiar with LLM tools and frameworks like LangChain and LlamaIndex

Links

Previous companies

Amazon logo
IBM logo
SAP logo

Peers

View in org chart

Timeline

  • Founding Engineer

    June, 2023 - present