Women Leaders Advocate: Generative AI Requires Human Oversight for Success

Building tools with generative AI is more accessible than ever, yet developers must prioritize experimentation and a focus on human end-users, as emphasized by speakers at the sixth annual Women in AI Breakfast during VB Transform.

The sold-out event, sponsored by Capital One, showcased the critical need for diverse perspectives in the rapidly evolving field of generative AI.

Jessica Gilmartin, Chief Revenue Officer at Calendly, highlighted the importance of keeping human needs at the forefront of AI development. "AI is impressive, but our goal should not be the technology itself. Instead, we must build for people and collaborate with them. Technology facilitates change; it should not be the final objective," Gilmartin stated.

By prioritizing a human-first approach, Gilmartin noted that incorporating varied backgrounds into the development process not only enhances usability but also sparks innovative ideas for AI projects. At Calendly, the company encourages cross-disciplinary collaboration among teams.

Other speakers echoed the sentiment that AI requires human involvement, especially for products intended for user interaction. Failing to include diverse perspectives during development can hinder the creation of trustworthy and user-friendly products. Moderator Noelle Russell, founder and chief AI officer of the AI Leadership Institute, shared an example involving Amazon’s Alexa. Early on, the development team primarily included men, leading Alexa to better recognize male voices. Consequently, research has shown that women often have to raise their voices for Alexa to understand them.

Yet, encouraging broader participation in generative AI can be a challenge. Many women and individuals without formal machine learning experience feel hesitant due to time constraints and self-doubt regarding their tech knowledge.

"Many people lack a generative AI background because it's a new field. However, if you come from education, English, or legal backgrounds, you can contribute to AI development—just experiment with the technology," said Aparna Sinha, Head of AI Product at Capital One.

Acknowledging the rapid evolution of AI, LinkedIn's Head of Data and AI, Ya Xu, stated, "Now is the perfect time to dive into AI, as there are numerous tools, podcasts, and resources available to help you get started." Kari Briski, Vice President of AI Models, Software, and Services at Nvidia, emphasized the importance of dedicating time to learn and experiment with AI tools.

Speakers agreed that fostering comfort with AI technology and encouraging participation from diverse backgrounds will lead to improved AI applications and systems.