Video walkthrough

Tech Mining with LLMs: Unveiling Trends from Corporate Websites

Overview 4:09 CC AI

paperi.ai
0:00 / 0:00

Xavier Martínez-Barbero, Ana Pastor-Merino, Josep Domènech

A company's website may reveal where its technology is heading, but only if someone can separate real signals from polished marketing. This study turns those public pages into a moving map of industrial change.

Abstract

Technology mining enables the systematic extraction and analysis of trends regard­ing scientific and technological developments from diverse Science, Technology, and Innovation (ST&I) data sources. Traditionally, indicators such as patents, sur­veys, and R&D statistics have been widely used to monitor technological change and innovation. This study proposes a novel methodology leveraging semantic analysis of corporate website content using large language models (LLMs) to fa­cilitate real-time monitoring of technological developments. Specifically, we focus on Spanish manufacturing firms that have adopted artificial intelligence (AI). A pipeline was developed to automatically extract and classify bigrams and unigrams from corporate websites into technological and non-technological terms, enabling a temporal analysis of technologies for the years 2023 and 2025. The results indicate an increase in AI-related mentions, as well as notable patterns of co-occurrence with Internet of Things (IoT) and Industry 4.0 technologies. Our study demon­strates the utility of the combination of corporate websites and LLMs as scalable, dynamic, and cost-effective sources for technology mining, contributing method­ologically through advanced text analytics and empirically by providing granular, web-derived insights into technological dynamics within the manufacturing sector.

Transcript

A company's website may reveal where its technology is heading—but only if someone can separate real signals from polished marketing. This study turns those public pages into a moving map of industrial change. Monitoring technological trends matters, but traditional sources such as surveys, interviews, and patents are costly, resource intensive, and unable to capture technological change in real time.

Those limits create a need for flexible, scalable approaches that use changing sources of information to follow technology and emerging trends more effectively. The proposed approach uses corporate web content to identify and track technological trends, rather than relying only on traditional sources or fixed categories.

It first identifies firms whose websites provide evidence of artificial intelligence adoption, then pulls out words and short phrases and sorts them into technological or non-technological terms. Finally, equivalent terms are grouped, and the results are organized for each time point so changes can be compared.

The collected website material was cleaned and combined into one body of text for each company, then narrowed to passages most closely related to artificial intelligence. This narrowing acts like sorting a huge pile of mail before reading it: it reduces the amount of text needing deeper review while preserving different kinds of context.

A deeper reading then determines whether those selected passages provide actual evidence that a company uses artificial intelligence. Using this approach, three hundred fifty-six companies were classified as artificial intelligence adopters in 2023. By 2025, the number had risen to four hundred sixty-seven companies, indicating increased artificial-intelligence engagement across the sector.

The model achieved very high overall accuracy, but it was less complete when judging individual words than when judging clearer multi-word technology expressions. That tradeoff came from a cautious strategy: it prioritized avoiding false alarms, which preserved high overall accuracy but missed some less obvious technology references.

The comparison tracks how often the most referenced technologies appeared on company websites between 2023 and 2025. Most terms increased, with several more than doubling, while only a small number declined modestly. The spread is striking: predictive maintenance reaches one hundred percent, while mobile devices and neural networks decline, leaving a wide gap between the fastest risers and laggards.

The study also examined which technologies appeared together, revealing that firms often present them as complementary bundles rather than isolated tools. Automation frequently appeared alongside computer vision, robotics, real-time systems, machine learning, and Industry 4.0, framing automation as part of a broader digital production system.

Connected devices and data streams also appeared with real-time systems and machine learning, pointing to a close relationship between connectivity, automation, and intelligence in smart production. There is an important catch: company websites are a form of self-presentation, so firms may exaggerate fashionable technologies or hide capabilities for secrecy or compliance reasons.

The comparison between 2023 and 2025 may also be affected by the rapid spread of generative artificial intelligence and the growing use of artificial-intelligence-assisted writing on websites. The study focuses on Spanish manufacturing firms, which limits how broadly the findings can be applied, although the framework can be used in other settings and languages.

Corporate websites can provide a fast, detailed view of how manufacturing firms talk about artificial intelligence and the technologies around it. But the map reflects both real activity and what companies choose to say publicly.

A derivative work by Paperi · AI-generated script, voice and captions · pages and figures unaltered

Made with Paperi.

Drop in a research PDF — get a narrated video walkthrough like this one, with highlights that follow the narration. Free to start.

Try it with your paper →

More in Social Sciences

A qualitative quantitative mixed methods study of domestic violence against women 3:59

A qualitative quantitative mixed methods study of domestic violence against women

Domestic violence is not only a private crisis. This study finds that it can be widespread, hidden by silence, and tied to beliefs that make harmful behavior seem ordinary.

Factors Associated with Fertility Intention among Chinese Married Youth during the COVID-19 Pandemic 5:00

Factors Associated with Fertility Intention among Chinese Married Youth during the COVID-19 Pandemic

Why would married young people want fewer children even when governments encourage larger families? This study points to an unexpected answer: pandemic-related worries may matter more than money or job security.

Language endangerment: Using analytical methods from conservation biology to illuminate loss of linguistic diversity 4:02

Language endangerment: Using analytical methods from conservation biology to illuminate loss of linguistic diversity

A language can disappear even while its community grows. This paper asks what the science of disappearing species can teach us about protecting the words, stories, and knowledge carried by human languages.

All 18 papers in Social Sciences →