Gen AI: The Identity Fraudster's Friend and Foe

Presented by AU10TIX

Generative AI can compose a sonnet in seconds, but it also facilitates billions in identity fraud, severely damaging the reputations of individuals, organizations, and governments. According to AU10TIX’s Q2 2023 Global Identity Fraud Report, organized ID fraud in the U.S. has increased by 44% compared to previous quarters.

The data in AU10TIX’s report stems from its AI-driven fraud detection solutions, particularly the Serial Fraud Monitor. This tool has recorded a rise in professional organized attacks and various attack modes globally, with a notable focus on vulnerable sectors like crypto trading and payments. This surge directly correlates with our increasingly digital world, making trust harder to establish between financial services, consumers, and the technology ensuring secure interactions—an issue exacerbated by generative AI.

“Large language models and generative AI empower professional fraudsters to convincingly mimic valid identities, complicating the differentiation between forgeries and genuine identities,” states Dan Yerushalmi, CEO of AU10TIX.

“Fraudsters are not just opening a few accounts; they conduct extensive swarm attacks that can last weeks or months, inflicting widespread damage,” adds Ofer Friedman, Chief Business Development Officer at AU10TIX. “Organizations are facing heavier repercussions, often feeling overwhelmed.”

Consumers demand heightened security and control, increasingly prioritizing safety over convenience. Organizations that fail to meet these security expectations risk losing customer trust.

The Impact of Generative AI on Fraud

“Generative AI equips fraudsters with vast amounts of data and allows them to infinitely adapt their methods,” explains Yerushalmi. “It's accessible and cost-effective, attracting new players who can leverage these cyberattack tools for significant impact.”

Generative AI is influencing fraud through several mechanisms. Deepfakes can create realistic images, voice recordings, and videos to execute advanced social engineering and phishing schemes. Fraudsters utilize deepfakes to establish fake accounts, bypass identity verification, or outsmart biometric systems through presentation and injection attacks.

Moreover, generative AI allows fraudsters to fabricate entire identities. “Fraudsters are adopting AI technology faster than other sectors,” remarks Friedman. “This technology shifts the dynamic of fraud detection. Previously, identifying manipulation signs was key, but now detecting completely fabricated identities becomes critical.”

Synthetic IDs—combinations of stolen Social Security numbers, names, addresses, and fabricated information—can pass verification checks. These evolved digital personas mimic legitimate human behavior, complicating detection and paving the way for coordinated fraud schemes like credit fraud, account takeovers, and money laundering.

Combatting Fraud with AI Tools

So, how do organizations combat nearly undetectable fraud? Friedman suggests enhancing existing security with generative AI detection capabilities. “To counteract these threats, implementing multilayer detection strategies is essential, assessing fraud and its perpetrators from multiple perspectives.”

AI deepfake detection employs algorithms to identify manipulated content, evaluating factors such as facial transformations and lighting inconsistencies. Integrating biometric markers—like facial landmarks and voice patterns—adds further scrutiny.

Organizations should deploy automated AI and machine learning identity verification systems while adding a robust layer to detect sophisticated coordinated attacks at the network traffic level. An advanced neural network can analyze subtle fraud patterns in real-time, enabling proactive intervention. AU10TIX’s Serial Fraud Monitor aggregates anonymized data from various large-scale institutions, facilitating the identification of sophisticated fraud patterns.

Yerushalmi emphasizes that, while generative AI enhances both fraud capabilities and detection, traditional algorithms shouldn't be overlooked. “A balanced approach that combines machine learning, AI, and foundational techniques is vital for optimal results.”

Optimized fraud prevention is imperative; customers increasingly value security but demand a seamless user experience. “Users abandon businesses unhappy with the process, choosing alternatives readily available,” warns Yerushalmi. “They quickly lose patience, so integrating protective technologies into authentication must enhance protection without sacrificing user experience.”

Maintaining Customer Trust

Protecting customers from fraud is an organization’s legal and ethical obligation—key to business survival. This responsibility involves shielding clients from financial loss and fostering trust and loyalty. Combating sophisticated fraud globally relies on collaborative efforts among organizations.

“Organizations must unite to combat fraud on a global scale, and AU10TIX is committed to fostering trust in this endeavor,” Yerushalmi asserts. “As new technologies and generative AI evolve, we remain dedicated to being a reliable partner in the digital landscape.”

AU10TIX’s Serial Fraud Monitor is an industry-leading solution, offering real-time protection against sophisticated organized ID fraud. Learn more and schedule a demo here.

Most people like

Find AI tools in YBX