Cisco study shows DeepSeek is very susceptible to attacks — here's why

(Image credit: Getty Images/Qi Yang)

Last week, DeepSeek quickly became the most popular app on the Apple App Store. The free, open-source model quickly gained popularity for its advanced capabilities and free access. However, significant concerns are being raised about its security and potential vulnerabilities.

A recent report by Cisco revealed alarming findings that indicate DeepSeek is severely flawed in terms of security. The R1 model exhibited a 100% attack success rate, failing to block harmful prompts. DeepSeek is highly susceptible to algorithmic jailbreaking, where users manipulate the AI to perform unintended or malicious tasks. While other top AI models are not entirely safe, they have guardrails for some measure of resistance to harmful inputs.

In addition to its security vulnerabilities, DeepSeek has faced issues related to data privacy. A critical database leak exposed over one million records, including system logs, user prompts, and API tokens. This exposure raises concerns about the potential misuse of sensitive information and highlights the need for robust data protection measures in AI platforms.

The combination of security flaws and data privacy issues has attracted international attention. Due to potential security and ethical concerns, the U.S. Navy has banned the use of DeepSeek on government-issued devices. Similarly, Italy banned the app, citing fears of data privacy concerns.

These actions underscore the growing apprehension regarding using AI technologies developed in jurisdictions with differing data privacy standards.

The open-source paradox

The open-source nature of DeepSeek's models offers significant appeal. Companies can access, modify, and integrate the technology into their existing systems without licensing fees, fostering innovation and customization. This approach aligns with the growing trend in the tech industry toward open-source solutions, enabling rapid development and adaptation. Just last week, ElevenLabs made it possible to chat with DeepSeek, improving upon the chatbot.

DeepSeek's AI models are notably cost-effective, with the DeepSeek-R1 model developed at a fraction of the cost of its competitors. This efficiency allows companies to integrate advanced AI capabilities without the substantial financial investment typically required for proprietary models. The performance of DeepSeek-R1 is comparable to leading models, excelling in tasks such as mathematics, coding, and natural language reasoning.

Companies such as Perplexity AI and Grok offer users a selection of proprietary and third-party AI models to address their queries. The latest addition to this lineup is DeepSeek R1. This integration allows users to access DeepSeek's capabilities directly through the U.S. platforms while ensuring their data stays safe. Grok does not store user data. Perplexity users can rest assured that all user data, including prompts and responses, is stored within U.S. data centers, ensuring compliance with local data privacy standards.

Implications for users and the AI industry

This democratization of AI could lead to increased innovation, as more companies and developers can contribute to and benefit from advanced AI capabilities. The open-source model also encourages collaboration and knowledge sharing, which can accelerate the development of AI applications across various industries.

The fast adoption of DeepSeek's open-source AI models is driven by the desire for cost-effective, high-performance solutions that offer strategic advantages in a competitive and evolving market. The open-source nature of DeepSeek's technology, combined with its impressive performance and cost efficiency, presents a compelling case for its integration into existing AI infrastructures. However, these cost-effective strategies may have weakened the safety mechanisms of the models.

The lack of safety in models like DeepSeek R1 makes them susceptible to algorithmic jailbreaking and potential misuse. As organizations consider integrating such technologies, balancing the benefits with a thorough assessment of security risks is imperative to ensure responsible and safe deployment.

While DeepSeek's innovative approach to AI has garnered attention, the recent findings highlight significant security and privacy concerns. As AI continues to evolve rapidly, developers and users alike must prioritize safety and data protection to fully realize this transformative technology's benefits.