Search This Blog
Powered by Blogger.

Blog Archive

Labels

About Me

Load More
Trendy Right Now

Popular Posts

Showing posts with label AI Misuse. Show all posts
Technology
AI Misuse AI-generated road scam ChatGPT fraud contractor fake road AI Technology

Contractor Uses AI to Fake Road Work, Sparks Outrage and Demands for Stricter Regulation

 

In  a time when tools like ChatGPT are transforming education, content creation, and research, an Indian contractor has reportedly exploited artificial intelligence for a far less noble purpose—fabricating roadwork completion using AI-generated images.

A video that recently went viral on Instagram has exposed the alleged misuse. In it, a local contractor is seen photographing an unconstructed, damaged road and uploading the image to an AI image generator. He then reportedly instructed the tool to recreate the image as a finished cement concrete (CC) road—complete with clean white markings, smooth edges, and a drainage system.

In moments, the AI delivered a convincing “after” image. The contractor is believed to have sent this fabricated version to a government engineer on WhatsApp, captioning it: “Road completed.” According to reports, the engineer approved the bill without any physical inspection of the site.

While the incident has drawn laughter for its ingenuity, it also shines a spotlight on a serious lapse in administrative verification. Civil projects traditionally require on-site evaluation before funds are cleared. But with government departments increasingly relying on digital updates and WhatsApp for communication, such loopholes are becoming easier to exploit.

Though ChatGPT doesn’t create images, it is suspected that the contractor used AI tools like Midjourney or DALL·E, possibly combined with ChatGPT-generated prompts to craft the manipulated photo. As one Twitter user put it, “This is not just digital fraud—it’s a governance loophole. Earlier, work wasn’t done, and bills got passed with a signature. Now, it’s ‘make it with AI, send it, and the money comes in.’”

The clip, shared by Instagram user “naughtyworld,” has quickly racked up millions of views. While some viewers praised the tech-savviness, others expressed alarm at the implications.

“This is just the beginning. AI can now be used to deceive the government itself,” one user warned. Another added, “Forget smart cities. This is smart corruption.”

The incident has fueled widespread calls on social media for stronger regulation of AI use, more transparent public work verification processes, and a legal probe into the matter. Experts caution that if left unchecked, this could open the door to more sophisticated forms of digital fraud in governance.
Read more »
Technology
AI AI Chatbot AI Misuse LLM Technology

AI In Wrong Hands: The Underground Demand for Malicious LLMs

AI In Wrong Hands: The Underground Demand for Malicious LLMs

In recent times, Artificial Intelligence (AI) has offered various perks across industries. But, as with any powerful tool, threat actors are trying to use it for malicious reasons. Researchers suggest that the underground market for illicit large language models is enticing, highlighting a need for strong safety measures against AI misuse. 

These underground markets that deal with malicious large language models (LLMs) are called Mallas. This blog dives into the details of this dark industry and discusses the impact of these illicit LLMs on cybersecurity. 

The Rise of Malicious LLMs

LLMs, like OpenAI' GPT-4 have shown fine results in natural language processing, bringing applications like chatbots for content generation. However, the same tech that supports these useful apps can be misused for suspicious activities. 

Recently, researchers from Indian University Bloomington found 212 malicious LLMs on underground marketplaces between April and September last year. One of the models "WormGPT" made around $28,000 in just two months, revealing a trend among threat actors misusing AI and a rising demand for these harmful tools. 

How Uncensored Models Operate 

Various LLMs in the market were uncensored and built using open-source standards, few were jailbroken commercial models. Threat actors used Mallas to write phishing emails, build malware, and exploit zero days. 

Tech giants working in the AI models industry have built measures to protect against jailbreaking and detecting malicious attempts. But threat actors have also found ways to jump the guardrails and trick AI models like Google Meta, OpenAI, and Anthropic into providing malicious info. 

Underground Market for LLMs

Experts found two uncensored LLMs: DarkGPT, which costs 78 cents per 50 messages, and Escape GPT, a subscription model that charges $64.98 a month. Both models generate harmful code that antivirus tools fail to detect two-thirds of the time. Another model "WolfGPT" costs $150, and allows users to write phishing emails that can escape most spam detectors. 

The research findings suggest all harmful AI models could make malware, and 41.5% could create phishing emails. These models were built upon OpenAI's GPT-3.5 and GPT-4, Claude Instant, Claude-2-100k, and Pygmalion 13B. 

To fight these threats, experts have suggested a dataset of prompts used to make malware and escape safety features. AI companies should release models with default censorship settings and allow access to illicit models only for research purposes.

Read more »
Subscribe to: Posts (Atom)