#Factcheck-Allu Arjun visits Shiva temple after success of Pushpa 2? No, image is from 2017

Introduction

Artificial Intelligence (AI) driven autonomous weapons are reshaping military strategy, acting as force multipliers that can independently assess threats, adapt to dynamic combat environments, and execute missions with minimal human intervention, pushing the boundaries of modern warfare tactics. AI has become a critical component of modern technology-driven warfare and has simultaneously impacted many spheres in a technology-driven world. Nations often prioritise defence for significant investments, supporting its growth and modernisation. AI has become a prime area of investment and development for technological superiority in defence forces. India’s focus on defence modernisation is evident through initiatives like the Defence AI Council and the Task Force on Strategic Implementation of AI for National Security.

The main requirement that Autonomous Weapons Systems (AWS) require is the “autonomy” to perform their functions when direction or input from a human actor is absent. AI is not a prerequisite for the functioning of AWSs, but, when incorporated, AI could further enable such systems. While militaries seek to apply increasingly sophisticated AI and automation to weapons technologies, several questions arise. Ethical concerns have been raised for AWS as the more prominent issue by many states, international organisations, civil society groups and even many distinguished figures.

Ethical Concerns Surrounding Autonomous Weapons

The delegation of life-and-death decisions to machines is the ethical dilemma that surrounds AWS. A major concern is the lack of human oversight, raising questions about accountability. What if AWS malfunctions or violates international laws, potentially committing war crimes? This ambiguity fuels debate over the dangers of entrusting lethal force to non-human actors. Additionally, AWS poses humanitarian risks, particularly to civilians, as flawed algorithms could make disastrous decisions. The dehumanisation of warfare and the violation of human dignity are critical concerns when AWS is in question, as targets become reduced to mere data points. The impact on operators’ moral judgment and empathy is also troubling, alongside the risk of algorithmic bias leading to unjust or disproportionate targeting. These ethical challenges are deeply concerning.

Balancing Ethical Considerations and Innovations

It is immaterial how advanced a computer becomes in simulating human emotions like compassion, empathy, altruism, or other emotions as the machine will only be imitating them, not experiencing them as a human would. A potential solution to this ethical predicament is using a 'human-in-the-loop' or 'human-on-the-loop' semi-autonomous system. This would act as a compromise between autonomy and accountability.

A “human-on-the-loop” system is designed to provide human operators with the ability to intervene and terminate engagements before unacceptable levels of damage occur. For example, defensive weapon systems could autonomously select and engage targets based on their programming, during which a human operator retains full supervision and can override the system within a limited period if necessary.

In contrast, a ‘human-in-the-loop” system is intended to engage individual targets or specific target groups pre-selected by a human operator. Examples would include homing munitions that, once launched to a particular target location, search for and attack preprogrammed categories of targets within the area.

International Debate and Regulatory Frameworks

The regulation of autonomous weapons that employ AI, in particular, is a pressing global issue due to the ethical, legal, and security concerns it contains. There are many ongoing efforts at the international level which are in discussion to regulate such weapons. One such example is the initiative under the United Nations Convention on CertainConventional Weapons (CCW), where member states, India being an active participant, debate the limits of AI in warfare. However, existing international laws, such as the Geneva Conventions, offer legal protection by prohibiting indiscriminate attacks and mandating the distinction between combatants and civilians. The key challenge lies in achieving global consensus, as different nations have varied interests and levels of technological advancement. Some countries advocate for a preemptive ban on fully autonomous weapons, while others prioritise military innovation. The complexity of defining human control and accountability further complicates efforts to establish binding regulations, making global cooperation both essential and challenging.

The Future of AI in Defence and the Need for Stronger Regulations

The evolution of autonomous weapons poses complex ethical and security challenges. As AI-driven systems become more advanced, a growing risk of its misuse in warfare is also advancing, where lethal decisions could be made without human oversight. Proactive regulation is crucial to prevent unethical use of AI, such as indiscriminate attacks or violations of international law. Setting clear boundaries on autonomous weapons now can help avoid future humanitarian crises. India’s defence policy already recognises the importance of regulating the use of AI and AWS, as evidenced by the formation of bodies like the Defence AI Project Agency (DAIPA) for enabling AI-based processes in defence Organisations. Global cooperation is essential for creating robust regulations that balance technological innovation with ethical considerations. Such collaboration would ensure that autonomous weapons are used responsibly, protecting civilians and combatants, while encouraging innovation within a framework prioritising human dignity and international security.

Conclusion

AWS and AI in warfare present significant ethical, legal, and security challenges. While these technologies promise enhanced military capabilities, they raise concerns about accountability, human oversight, and humanitarian risks. Balancing innovation with ethical responsibility is crucial, and semi-autonomous systems offer a potential compromise. India’s efforts to regulate AI in defence highlight the importance of proactive governance. Global cooperation is essential in establishing robust regulations that ensure AWS is used responsibly, prioritising human dignity and adherence to international law, while fostering technological advancement.

References

●     https://indianexpress.com/article/explained/reaim-summit-ai-war-weapons-9556525/

●     https://blogs.icrc.org/law-and-policy/2024/04/25/the-road-less-travelled-ethics-in-the-international-regulatory-debate-on-autonomous-weapon-systems/

●     https://disarmament.unoda.org/the-convention-on-certain-conventional-weapons/background-on-laws-in-the-ccw/

●     https://www.cambridge.org/core/services/aop-cambridge-core/content/view/5FD01B5A96116766C3B1273490B24897/S0892679423000357a.pdf/banning-autonomous-weapons-a-legal-and-ethical-mandate.pdf

●     https://www.pib.gov.in/PressReleasePage.aspx?PRID=1846937

Artificial intelligence is growing at a rapid pace, with startups promising breakthroughs in industries and attracting billions in investment. Among these was Builder.ai, a London-based company founded in 2016 by an Indian entrepreneur. Once valued at over $1.5 billion, it was known for its game-changing platform that could let anyone build custom apps quickly and affordably with the help of AI.

Yet in 2025, Builder.ai collapsed dramatically, filing for bankruptcy across multiple countries and laying off nearly 80% of its workforce. What was once a celebrated unicorn has become a cautionary tale, exposing not only the risks of hype-driven growth in AI but also inflicting reputational damage on Indian founders in the global startup ecosystem.

The Rise: Big Promises, Big Investors

Builder.ai branded itself as a no-code/low-code app development platform, where its AI assistant “Natasha” would guide customers in creating apps without technical expertise. The pitch was simple and attractive: app development was made “as easy as ordering pizza.” The story resonated with major investors. Backed by SoftBank, Microsoft, and Qatar’s sovereign wealth fund, Builder.ai raised more than $450 million. It scaled rapidly, positioning itself as one of Europe’s most promising AI startups.

The Cracks Appear

Behind the glamour, the first cracks appeared as early as 2019, when The Wall Street Journal reported that Builder.ai’s platform depended far more on human engineers than on the AI automation it advertised. In reality, the much-hyped AI assistant “Natasha” was often just “a guy instead”, i.e., skilled developers in India manually writing code behind the scenes on whose backs the company expanded aggressively. 

The real blow came from Builder.ai’s finances. The company was accused of inflating revenue figures by 300%, with alleged use of round-tripping tactics involving fake invoices that inflated financials.  While it publicly projected revenues of $220 million in 2024, its actual figure was closer to $55 million. When this reality surfaced, investor confidence was lost quickly, and the company’s liabilities ballooned to nearly $100 million, with less than $ 10 million in assets remaining. 

Collapse and Legal Scrutiny

By 2025, the company’s foundations had crumbled. The founder stepped down as CEO but retained the unusual title of “Chief Wizard.” Massive debts to AWS, Microsoft, and other partners mounted into the hundreds of millions. Assets were seized, and the company filed for bankruptcy in the U.S., UK, India, and the UAE.

For clients, the collapse meant abandoned projects. For employees, around 1,000 of them, it meant sudden unemployment. And for investors, it was a devastating loss. The Securities and Exchange Commission and U.S. Attorney’s Office in New York have since launched investigations into potential fraud and investor misrepresentation.

Reputational Damage: Impact on Indian Founders

Perhaps the most enduring consequence of Builder.ai’s downfall is the hit to the credibility of Indian founders on the global stage.

For years, Indian entrepreneurs have earned trust in global tech circles, with leaders heading companies from Google to Microsoft. Indian-led startups abroad were viewed as reliable, innovative, and growth-driven. Builder.ai’s collapse disrupts this narrative.

The allegations of inflated revenue, AI exaggeration, and questionable governance risk reinforcing skepticism among global investors regarding Indian organisational ethics. For other Indian founders seeking international capital, the road has now become tougher: stricter due diligence, harsher scrutiny of claims, and slower trust-building.

This reputational damage arrives at a critical time when India is positioning itself as a global hub for AI and leads the world in AI skill penetration. Rather than highlighting the strength of India’s entrepreneurial and talent ecosystem, the fall of Builder.ai has drawn attention to the risks of overpromising and underdelivering.

Conclusion

The fall of Builder.ai is more than the bankruptcy of one AI unicorn. It is a warning to companies against chasing hyper growth fueled by the riding of the AI wave. While the company’s downfall exposed flaws in governance and accountability, its deeper impact lies in how it dented trust. To drive AI and technology innovation, startups must move beyond flashy valuations and commit to authentic innovation, transparency, and financial integrity.

References

• https://www.moodys.com/web/en/us/insights/lending/moodys-early-warning-in-action-builder-ai.html#:~:text=Despite%20marketing%20itself%20as%20an,fake%20invoices%20that%20inflated%20financials. 
• https://today-innovation.webflow.io/unveiling-the-power-of-natasha-an-ai-assistant-of-builder-ai-to-revolutionize-app-generation 
• https://finance.yahoo.com/news/builder-ais-shocking-450m-fall-170009323.html
• https://www.pib.gov.in/PressReleasePage.aspx?PRID=2108810 
• https://www.cnbctv18.com/technology/how-a-london-based-startups-artificial-ai-gambit-backfired-ws-l-19613692.htm# 

‍

March 3rd 2023, New Delhi: If you have received any message that contains a link asking users to download an application to avail Income Tax Refund or KYC benefits with the name of Income Tax Department or reputed Banks, Beware!

CyberPeace Foundation and Autobot Infosec Private Limited along with the academic partners under CyberPeace Center of Excellence (CCoE) recently conducted five different studies on phishing campaigns that have been circulating on the internet by using misleading tactics to convince users to install malicious applications on their devices. The first campaign impersonates the Income Tax Department, while the rest of the campaigns impersonate ICICI Bank, State Bank of India, IDFC Bank and Axis bank respectively. The phishing campaigns aim to trick users into divulging their personal and financial information.

After a detailed study, the research team found that:

• All campaigns appear to be an offer from reputed entities, however hosted on third-party domains instead of the official website of the Income Tax Department or the respective Banks, raising suspicion.
• The applications ask several access permissions of the device. Moreover some of them seek users to provide full control of the device. Allowing such access permission could result in a complete compromise of the system, including access to sensitive information such as microphone recordings, camera footage, text messages, contacts, pictures, videos, and even banking applications.
• Cybercriminals created malicious applications using icons that closely resemble those of legitimate entities with the intention of enticing users into downloading the malicious applications.
• The applications collect user’s personal and banking information. Getting into this type of trap could lead users to face significant financial losses.
• While investigating the impersonated Income Tax Department’s application, the Research team identified the application sends http traffic to a remote server which acts as a Command and Control (CnC/C2) for the application.
• Customers who desire to avail benefits or refunds from respective banks, download relevant apps, believing that the chosen app will assist them. However, they are not always aware that the app may be fraudulent.

“The Research highlights the importance of being vigilant while browsing the internet and not falling prey to such phishing attacks. It is crucial to be cautious when clicking on links or downloading attachments from unknown sources, as they may contain malware that can harm the device or compromise the data.” spokesperson, CyberPeace added.

In addition to this in an earlier report released in last month, the same research team had drawn attention to the WhatsApp messages masquerading as an offer from Tanishq Jewellers with links luring unsuspecting users with the promise of free valentine’s day  presents making the rounds on the app.

CyberPeace Advisory:

• The Research team recommends that people should avoid opening such messages sent via social platforms. One must always think before clicking on such links, or downloading any attachments from unauthorised sources.
• Downloading any application from any third party sources instead of the official app store should be avoided. This will greatly reduce the risk of downloading a malicious app, as official app stores have strict guidelines for app developers and review each app before it gets published on the store.
• Even if you download the application from an authorised source, check the app’s permissions before you install it. Some malicious apps may request access to sensitive information or resources on your device. If an app is asking for too many permissions, it’s best to avoid it.
• Keep your device and the app-store app up to date. This will ensure that you have the latest security updates and bug fixes.
• Falling into such a trap could result in a complete compromise of the system, including access to sensitive information such as microphone recordings, camera footage, text messages, contacts, pictures, videos, and even banking applications and could lead users to financial loss.
• Do not share confidential details like credentials, banking information with such types of Phishing scams.
• Never share or forward fake messages containing links on any social platform without proper verification.

Source : https://www.aninews.in/news/business/business/alert-cybercriminals-target-taxpayers-and-banking-customers-with-phishing-campaign-and-malicious-application20230303182938/