Fortune | FORTUNE 23小时前
Why Booz Allen’s CTO used generative AI to make a deepfake video of himself
index_new5.html
../../../zaker_core/zaker_tpl_static/wap/tpl_guoji1.html

 

为了应对日益严峻的深度伪造(deepfake)技术带来的潜在金融欺诈风险,Booz Allen Hamilton公司采取了一种非传统方法。公司首席技术官Bill Vass亲自制作了一段包含“自己”的30秒深度伪造视频,旨在向公司内部员工以及其他行业人士展示生成式AI技术在制造虚假音视频内容方面的便捷性。Vass强调,当前的AI技术已发展到让人难以辨别视频和音频的真实性,传统的“眼见为实”已不再可靠。通过在公司内部推广这段视频,Booz Allen Hamilton希望员工能切身理解深度伪造技术的强大能力,从而提升防范意识。此前,公司曾通过展示名人视频来训练员工识别深度伪造,但由于名人资料公开广泛,而Vass作为公司高管,其大量视频和音频资料的存在,使得不法分子更容易利用少量内容制作出足以欺骗员工的深度伪造内容。此次合作公司还与深度伪造检测公司Reality Defender联手,后者开发的工具能在几秒钟内识别AI生成内容,并已获得包括IBM、Visa等大客户的支持。

💡 **企业内部推广深度伪造内容以提高员工警惕性**:Booz Allen Hamilton公司首席技术官Bill Vass亲自制作了包含“自己”的深度伪造视频,在公司内部推广,旨在让员工直观了解生成式AI技术制造虚假音视频的便捷性,从而提高员工对深度伪造的警惕和防范意识。这种“以毒攻毒”的方式,让员工亲身体验技术的“威力”,以达到更好的教育效果。

🛡️ **深度伪造技术的安全挑战与应对策略**:文章指出,随着生成式AI技术的飞速发展,深度伪造已达到令人难以辨别真伪的程度,传统的“眼见为实”观念已不再适用。不法分子可以利用少量公开的音视频资料,结合现成的软件和基础技术知识,制作出足以欺骗他人的深度伪造内容。这给企业带来了新的安全挑战,如金融欺诈、品牌声誉损害等,迫使企业需要投资防御系统和加强员工培训。

🤝 **与专业公司合作,利用技术手段防御深度伪造**:Booz Allen Hamilton与深度伪造检测公司Reality Defender合作,共同推广这段深度伪造视频。Reality Defender专注于开发识别AI生成内容的工具,并在业界获得了包括IBM、Visa等知名企业的支持。这表明,企业正积极寻求外部专业技术支持,以应对日益复杂的网络安全威胁,并认为音频和视频交互的认证过程将如同多因素认证一样,成为必需的网络安全措施。

📈 **深度伪造的经济影响与行业趋势**:文章引用德勤的估计,到2027年,生成式AI驱动的欺诈损失可能高达400亿美元,年复合增长率为32%。同时,文章提到金融行业是深度伪造攻击的重点目标,半数美国和英国的金融专业人士曾遭遇过深度伪造扫描攻击。这些数据和案例(如香港的案例)都凸显了深度伪造技术带来的巨大经济风险,以及行业内对加强防范的紧迫性。

🧠 **改变员工心态,提升安全意识是关键**:Vass强调,面对日益普遍的深度伪造攻击,人们需要改变心态,变得更加怀疑和审慎。即使是在安全级别极高的部门,过去的经验也表明,社会工程学攻击依然能够得逞。因此,除了技术手段,提升员工的“心理防御”能力,使其在面对可疑信息时保持警惕,是应对此类威胁的重要组成部分。

To ensure Booz Allen Hamilton’s global workforce of more than 35,000 can guard against deepfakes and avoid potential financial fraud, the consulting firm’s chief technology officer, Bill Vass, embraced an unconventional approach.

He created a deepfake video of himself.

This week, Vass will promote a 30-second deepfake video where “he” briefly speaks to the camera to show Booz Allen employees and other workers how easy it is to create fake audio and video content. Vass contends that generative AI technology has gotten so advanced that a popular refrain, “believe none of what you hear and half of what you see,” isn’t cynical enough.

“You’re at a point with AI and these deepfakes where you are not going to be able to believe any video you see or audio you hear,” Vass says. The deepfake video of Vass will be promoted internally at Booz Allen so that employees “better understand the capabilities and how strong a deepfake can be,” he adds.

Booz Allen has previously trained workers to spot deepfakes by showing videos of celebrities, who tend to be easy targets given the vast prominence of their likeness in the public domain. But there are also hours upon hours of video and audio of Vass uploaded to YouTube, and it only takes a couple of minutes of content for criminals to make a deepfake that can trick workers.

The stunt deepfake video of Vass was created by Booz Allen in partnership with Reality Defender, a deepfake detection company that sells tools to identify AI-generated content within seconds to clients including IBM, Visa, and Comcast. Last year, Reality Defender expanded its Series A funding round, raising $33 million in total capital (from investors including Booz Allen’s venture capital arm) to further develop the startup’s technologies.

Vendors like Reality Defender are betting that processes for authenticating audio and video interactions will become as essential as other cybersecurity tactics like multi-factor authentication, a two-step verification process, and zero-trust authentication, which requires continuous verification of identity.

Alex Lisle, who became CTO at Reality Defender last week, says there is a growing list of risks CEOs and other C-suite executives must confront when it comes to deepfakes. While much of the attention is on social engineering cyberattacks that prey on workers, cybercriminals can also use AI to craft audio files where a CFO “announces” manipulated earnings results, which could move the stock. AI videos can be generated that depict a CEO issuing a fake public statement that could hurt a brand’s reputation.

“Unlike other emerging cybercriminal threats, which require an incredible amount of technical knowledge and foresight, this doesn’t,” Lisle says. Deepfakes, he adds, can be done with “off-the-shelf software and a basic knowledge of technology.”

Top executives at WPP, Accenture, and Ferrari have been targeted by deepfakes, though in the corporate world, the banking sector is a favored target. Half of finance professionals in the U.S. and U.K. have reported that they’ve experienced an attempted deepfake scanning attack. Accounting giant Deloitte has estimated that generative AI-enabled fraud losses could reach $40 billion by 2027, a compound annual growth rate of 32% from 2023’s level.

The cautionary tale that security executives frequently cite is a Hong Kong incident where a financial worker was fooled into paying $25 million to fraudsters that used a deepfake video call to impersonate the company’s chief financial officer. To avoid these types of scams, chief information security officers and other technologists have been investing in defensive systems and better employee training to detect attacks.

Vass, who joined Booz Allen in 2024 after previously serving as VP of engineering at Amazon Web Services, says social engineering attacks would even trip up employees at the Pentagon, where he worked as a senior executive in the office of the CIO in the late 1990s. The Department of Defense would hire external parties to attempt attacks, and Vass says it always amazed him how many times those teams would succeed, even after all of the training.

He recalls another incident at a startup he led, where a former employee sent a deepfake email that was purportedly sent from Vass, while also pretending to loop in the CFO. The note was sent to the procurement office, and a worker ended up processing a fake $25,000 invoice payment.

Generative AI, Vass adds, will only make cases like these all that more common. “People are going to have to learn to change their psyche to be more skeptical.”

John Kell

Send thoughts or suggestions to CIO Intelligence here.

NEWS PACKETS

Samsung, Tesla ink $16.5 billion AI chips deal. Samsung has agreed to make AI chips for electric vehicle manufacturer Tesla under a multiyear deal that is billed as a major win for the South Korean electronics giant’s U.S. foundry business. Tesla CEO Elon Musk confirmed on his social media platform X that Samsung’s new Texas semiconductor plant would be dedicated to making the auto company’s next-generation AI6 chip, which is expected to be used in humanoid robots, self-driving cars, and AI data centers, reports WSJ. The win is huge for Samsung, which has lost ground in chip manufacturing, most notably to Taiwan Semiconductor Manufacturing Co., which holds roughly two-thirds of the global foundry market and reportedly still can’t meet all demand. Samsung’s investors cheered the news, adding billions to the company’s market value.

Anthropic in talks to more than double valuation to over $170 billion. Anthropic is in talks with numerous investors about raising as much as $5 billion in a funding round that would value the four-year-old AI developer at $170 billion, according to the Financial Times. Fortune, meanwhile, separately reports this week on a class-action lawsuit against Anthropic that could expose the AI company to billions in copyright damages for allegedly using pirated books to train its models. Anthropic didn’t immediately respond to Fortune’s request for comment.

Walmart is “all in” on AI agents. Retail behemoth Walmart last week rolled out the company’s vision for how AI agents will overhaul the way customers shop, the ways that corporate and store employees work, and how vendors sell and track their merchandise performance within the Walmart ecosystem. This range of four AI agents, displayed at a media event attended by Fortune, included a generative AI digital assistant named Sparky that can answer product questions for customers. There were also some internal agentic use cases that can accomplish mundane and repetitive tasks, which is where much of the focus on AI agents has been since companies started to embrace the technology in earnest earlier this year. In yet another sign of Walmart’s seriousness when it comes to AI, the Wall Street Journal reports of key hires, including Daniel Danker, an executive at Instacart, who will steer global AI acceleration, product, and design.

Microsoft-OpenAI contract talks advance. Bloomberg reports this week that Microsoft is in “advanced talks” to secure an agreement that would give the tech giant ongoing access to OpenAI’s technology. The new terms, people familiar with the matter say, would give Microsoft use of OpenAI’s latest models, including if the startup achieves its goal of building a more powerful artificial general intelligence (AGI), a theoretical concept in which an AI system would have capabilities that rival those of a human. The news outlet reports that the pair have been meeting regularly and that a deal could come together within a matter of weeks. Microsoft has already invested $13.75 billion into OpenAI, and these negotiations would also avoid losing access to the latter company’s technology before the end of the current deal terms, which is set to expire in 2030.

ADOPTION CURVE

Majority of business leaders believe agentic AI can manage entire business divisions. EY’s latest U.S. AI Pulse survey, released this week, found that 73% of the 500 U.S.-based decision-makers say they believe agentic AI, which can act autonomously and perform complex tasks with little-to-no human supervision, will “manage entire business units.” But the business community is still quite a bit away from making that level of automation a reality. The consulting firm also reports that 34% of senior leaders say their companies have already started to implement agentic AI technology, though it is only fully implemented at 14% of those organizations.

Dan Diasio, EY’s global consulting AI leader, tells Fortune that the firm’s clients are quite bullish on agentic AI’s potential, but that most still keep a human in the loop to monitor tasks. “The parts of transforming and changing the way the business operates around the technology—creating new jobs, creating new controls that can ensure the technology works responsibly—are still lagging the implementation,” Diasio says.

A big hurdle to overcome remains human change management. Sixty-four percent of senior leaders agreed that the fear of replacement, as opposed to augmentation with agentic AI, will stifle adoption. Yet only 24% said that employee resistance is one of the biggest barriers, as cybersecurity and data privacy concerns each ranked higher, at 35% and 30%, respectively.

Courtesy of EY

JOBS RADAR

Hiring:

- Northwestern Mutual is seeking a VP, chief information security officer, based in Milwaukee. Posted salary range: $308K-$572K/year.

- The Minneapolis Star Tribune is seeking a chief product and technology officer, based in Minneapolis. Posted salary: $300K/year.

- Northeast Arc is seeking a chief information and technology officer, based in Danvers, Mass. Posted salary range: $155K-$175K/year.

- Nebraska Department of Health and Human Services is seeking a CIO, based in Lincoln, Neb. Posted salary range: $150K-$200K/year.

Hired:

- Norwegian Cruise Line appointed Daniel Henry to serve as EVP and chief digital and technology officer, where he will navigate the integration of the travel company’s IT and digital experience teams. Previously, he served as EVP and global CIO for fast-food giant McDonald’s and spent 17 years in various technology leadership roles at American Airlines, including as a VP of customer technology.

- Fulton Bank named Kevin Gremer as chief operations and technology officer, joining the Mid-Atlantic regional bank to oversee the IT and operations teams. Since 2022, he has served as SVP and head of operations of banking and investment services at City National Bank, a subsidiary of Canadian bank RBC. He also has more than 20 years of management experience at Capital One.

- CIQ announced the appointment of Peter Nelson as CTO, joining the software infrastructure firm after most recently serving as VP of engineering at Apple's Claris software development subsidiary. Before that, he served as the chief product officer at headphones and speakers manufacturer Bowers & Wilkins.

- Everon appointed Ibrahim Kassem as CTO, where he will oversee the development of the company’s commercial security, fire, and sprinkler safety systems. Previously, Kassem served as CIO at security company Stealth Monitoring, as SVP of IT at home and business security systems provider ADT, and as VP of IT at Protection 1 Security Solutions, which merged with ADT in 2016.

- Candescent named Satheesh Ravala as CTO, joining the digital banking services provider after most recently serving as CTO at corporate-governance software company Diligent. He previously held senior leadership roles at financial services company Intercontinental Exchange (ICE) Mortgage Technology and mortgage software provider Ellie Mae.

- Arch Insurance promoted David Maher to the role of CIO, effective immediately. In this role, Maher will lead the delivery of the global insurance company’s IT strategy and infrastructure. He joined Arch in 2024 as international head of delivery. Previously, he served as a head of engineering at Lloyds Banking Group and also held technology leadership roles at banking giants including Bank of America and Merrill Lynch.

- InspereX appointed Ira Lehrman as CTO, where he will spearhead the financial technology company’s product roadmap. Lehrman joins InspereX from digital capital marketplace Clear Bid Global Markets, where he served as CTO. Previously, he held senior positions at fintech company Broadridge, investment manager Nuveen, and Merrill Lynch.

Fish AI Reader

Fish AI Reader

AI辅助创作,多种专业模板,深度分析,高质量内容生成。从观点提取到深度思考,FishAI为您提供全方位的创作支持。新版本引入自定义参数,让您的创作更加个性化和精准。

FishAI

FishAI

鱼阅,AI 时代的下一个智能信息助手,助你摆脱信息焦虑

联系邮箱 441953276@qq.com

相关标签

深度伪造 生成式AI 网络安全 企业培训 金融欺诈
相关文章