In[]:=
ImageSynthesize["Diagram about lexical search vs semantic search",3]
Out[]=
,
,
This is an example about how to get answers from documents. Those documents can be at internal website at the intranet, product documentation and manuals, wiki, WP, LMS or CMS, sets of PDFs and so one. It is possible to add knowledge from different sources to LLMs and automate the search of information giving life to the static texts siting in the organization.
The AI machine learning vector databases and semantic search rocks!!! Make it easy to find big sets of documents and images local or online for business and research.
It can scale up dealing with million of documents (text or images) assist you to find “closest” objects.
The Wolfram Language function SemanticSearch uses machine learning methods to find “vectors” of numbers that represent the semantics of text, sound or image data.
The SemanticSearch computes the vector, it means, text, sound, image data or features are transformed in numerical vector/list for ML processing, it makes easy and fast to check what documents are closest.
It can scale up dealing with million of documents (text or images) assist you to find “closest” objects.
The Wolfram Language function SemanticSearch uses machine learning methods to find “vectors” of numbers that represent the semantics of text, sound or image data.
The SemanticSearch computes the vector, it means, text, sound, image data or features are transformed in numerical vector/list for ML processing, it makes easy and fast to check what documents are closest.
Now, loading data from a different WEB pages about crypto, from the companies Kaspersky, PwC and Deloitte public data:
In[]:=
cryptocurrencyTextKaspersky=Import["https://www.kaspersky.com/resource-center/definitions/what-is-cryptocurrency"];
cryptocurrencyTextPwC=Import["https://www.pwc.com/us/en/industries/financial-services/fintech/bitcoin-blockchain-cryptocurrency.html"]<>"\n"<>Import["https://www.pwc.com/us/en/tech-effect/emerging-tech/understanding-cryptocurrency-digital-assets.html"];
In[]:=
cryptocurrencyTextDeloitte=Import["https://www2.deloitte.com/us/en/pages/about-deloitte/solutions/blockchain-digital-assets-definition.html"];
Combining and create a SemanticSearchIndex, transforming the text in a numerical vector index:
index=CreateSemanticSearchIndex@TextSentences[cryptocurrencyTextKaspersky<>"\n\n"<>cryptocurrencyTextPwC<>"\n\n"<>cryptocurrencyTextDeloitte]
Out[]=
SemanticSearchIndex
Searching and summarizing, a couple of examples, like “Talk to your PDF”:
In[]:=
SemanticSearch[index,"cryptocurrency definition",MaxItems->10]TextSummarize[%]
Out[]=
{What is cryptocurrency?,What is cryptocurrency?,Cryptocurrency – meaning and definition Cryptocurrency, sometimes called crypto-currency or crypto, is any form of currency that exists digitally or virtually and uses cryptography to secure transactions.,What is Cryptocurrency and how does it work?,What is Cryptocurrency and how does it work?,Cryptocurrency is a medium of exchange, created and stored electronically on the blockchain, using cryptographic techniques to verify the transfer of funds and an algorithm to control the creation of monetary units.,A cryptocurrency is a medium of exchange such as the US dollar, but is digital and uses cryptographic techniques and its protocol to verify the transfer of funds and control the creation of monetary units.,Based on blockchain technology, cryptocurrency is a decentralized medium of exchange or store of value designed to enable online transactions without the need for a trusted third-party intermediary.,Bitcoin, cryptocurrency, blockchain... So what does it all mean?,How does cryptocurrency work?}
Out[]=
Cryptocurrency, often referred to as crypto, is a form of digital or virtual currency that employs cryptographic techniques to secure transactions. Unlike traditional currencies, cryptocurrencies are created and stored electronically on blockchain technology, which is a decentralized system that verifies the transfer of funds and controls the creation of new monetary units. This eliminates the need for a trusted third-party intermediary, enabling secure and transparent online transactions. Bitcoin is one of the most well-known examples of cryptocurrency, illustrating the broader concept and functionality of digital currencies.
In[]:=
SemanticSearch[index,"DAO",MaxItems->3]TextSummarize[%]
Out[]=
{A decentralized autonomous organization (DAO) is a web-native, self-governing entity that executes the rule sets established by the member community.,DAO member communities are groups of people who agree to abide by certain rules for a common purpose.,Yes No}
Out[]=
A decentralized autonomous organization (DAO) is a self-governing, web-native entity that operates based on rules set by its member community. These communities consist of individuals who agree to follow specific guidelines to achieve a common goal.
In[]:=
SemanticSearch[index,"digital asset"]TextSummarize[%]
Out[]=
{What are digital assets?,Digital asset types,Digital assets are changing the game Take your digital assets vision from plan to reality Learn more,We generally place digital assets in five categories.,For a deeper understanding of digital assets, we recommend these resources.,We provide an introduction into the mechanics of the digital asset world, how it functions, the various categories of assets, and where the future of this space could lead.,Think of the term “digital assets” as a broad container that encompasses anything minted and exchanged on a blockchain.,Learn more about digital assets and what these mean for your businesses.,Digital asset storage Digital assets are stored and recorded on the blockchain ledger where they were issued (in most cases).,What this will look like in the future Financial opportunities being built into the options on purchase of a digital asset.}
Out[]=
Abstract:Digital assets, broadly defined as anything minted and exchanged on a blockchain, are revolutionizing various industries. This text categorizes digital assets into five main types and delves into their mechanics, storage, and future potential. Stored and recorded on blockchain ledgers, digital assets offer new financial opportunities and transformative possibilities for businesses. For a comprehensive understanding, additional resources are recommended to explore how digital assets function and their implications for the future.
In[]:=
SemanticSearch[index,"decentralized applications"]TextSummarize[%]
Out[]=
{Decentralized applications (dApps) are digital applications or programs built on peer-to-peer blockchain networks.,dApps Decentralized apps (dApps) includes any other applications built on a blockchain.,Sustainability Improved management of resources by collecting decentralized data and distributing it to system participants.,Potential applications can include enterprise blockchain applications, sustainability, tokenization, fund transfers, supply chain tracking and many other areas.,Blockchain’s potential applications,DeFi Decentralized finance is an umbrella term for a variety of financial applications provided through digital assets.,Collaborative technology, such as blockchain, proclaims the ability to improve the business processes that occur between companies, radically lowering the “cost of trust.”,A decentralized autonomous organization (DAO) is a web-native, self-governing entity that executes the rule sets established by the member community.,It’s a distributed ledger that cryptographically enables digital assets to be created, stored, transferred, and transacted in a real-time, immutable manner across a decentralized peer-to-peer network.,Based on blockchain technology, cryptocurrency is a decentralized medium of exchange or store of value designed to enable online transactions without the need for a trusted third-party intermediary.}
Out[]=
Decentralized applications (dApps) are digital programs built on peer-to-peer blockchain networks, encompassing a wide range of applications including enterprise solutions, sustainability initiatives, tokenization, fund transfers, and supply chain tracking. Blockchain technology, which underpins these applications, offers improved resource management by collecting and distributing decentralized data among system participants. Decentralized finance (DeFi) represents a subset of blockchain applications that provide financial services through digital assets. Additionally, decentralized autonomous organizations (DAOs) are self-governing entities that operate based on community-established rules. Blockchain's distributed ledger technology enables the creation, storage, transfer, and transaction of digital assets in a secure, real-time, and immutable manner, facilitating online transactions without the need for intermediaries.
In[]:=
SemanticSearch[index,"define NTF"]TextSummarize[%]
Out[]=
{A non-fungible token (NFT) is a unique, cryptographic unit of data that exists on a distributed ledger and cannot be replicated.,What it can be used for Payments Foreign exchange Cross-border payments and transfers Non-fungible tokens (NFTs) A token that represents ownership of a unique digital item (think a work of art, a government ID, a specific unit of production).,NFTs can also represent things like identities, property rights, or even a bundle of rights—all encoded into digital contracts or attestations.,An NFT certifies that the holder owns the underlying digital asset and can sell, trade or redeem it.,Individual NFTs are not mutually interchangeable, which means no two are the same.,These can include digital asset products such as NFTs but may also include things beyond the blockchain ecosystem like tickets to real world experiences or the deed to a real world asset.,Job Function * Accounting Advisor Analytics Audit Committee Chair Audit Committee Member Beneficiary Board Member Business Unit/P&L Owner Chair of the Board Client Experience Compliance Corporate Development Digital Distribution Diversity Executive Family Officer Finance Human Resources Information Security Information Technology Internal Audit Investments Investor Relations Legal Marketing Operations Other Owner Private Equity Investment Professionals Private Equity Operating Partners Procurement Real Estate/Facility Management Risk Sales Strategy Supply Chain Sustainability Tax Transformation Trustee,What it can be used for Proving your identity and granting access (to either a virtual or physical space) Tokenizing your supply chain to track inventory movement and ownership Ownership of virtual items (games, avatars, virtual land) Central bank digital currencies (CBDCs) A type of digital asset that represents a nation’s fiat currency and is backed by its central bank.,The metaverse is a network of 3D digital spaces that combine aspects of social media, online gaming, augmented reality, virtual reality, and cryptocurrency to enable users to interact and transact in a rich virtual environment.,How to build a sustainable NFT strategy discusses how an NFT strategy can drive revenue and growth by building a foundation for the future.}
Out[]=
A non-fungible token (NFT) is a unique, cryptographic unit of data on a distributed ledger that cannot be replicated. NFTs represent ownership of unique digital items, such as art, government IDs, or specific units of production, and can also signify identities, property rights, or bundles of rights encoded into digital contracts. They certify ownership of the underlying digital asset, allowing the holder to sell, trade, or redeem it. Unlike fungible tokens, individual NFTs are not interchangeable. NFTs can extend beyond the blockchain ecosystem to include real-world assets like event tickets or property deeds. They can be used for proving identity, granting access to virtual or physical spaces, and tokenizing supply chains. Central bank digital currencies (CBDCs) are another type of digital asset representing a nation’s fiat currency, backed by its central bank. The metaverse, a network of 3D digital spaces, integrates social media, online gaming, augmented reality, virtual reality, and cryptocurrency, enabling rich user interactions and transactions. Developing a sustainable NFT strategy can drive revenue and growth by establishing a future-oriented foundation.
In[]:=
SemanticSearch[index,"define WEB 3.0"]TextSummarize[%]
Out[]=
{What is Web3?,Web3 refers to a decentralized, blockchain-based online ecosystem posited to be the next iteration of the World Wide Web. Platforms and apps built on Web3 aren’t owned or governed by a central authority; rather, they are owned by network participants who earn their ownership stake by helping to develop and maintain those services.,For an overview into web3, we recommend Demystifying web3 which discusses what business leaders should know about web3, its potential, and what no regrets decisions you can make to prepare.,It’s been called the future of the web and the next frontier of finance.,Privacy Data Privacy Framework Cookie info Legal Terms and conditions Site provider Site map Your Privacy ChoicesDemystifying cryptocurrency and digital assets The crypto space is vast, and it can be easy to get lost in a sea of terms and definitions.,The metaverse is a network of 3D digital spaces that combine aspects of social media, online gaming, augmented reality, virtual reality, and cryptocurrency to enable users to interact and transact in a rich virtual environment.,Five ways to deepen customer engagement and loyalty with web3 which discusses how loyalty programs can be improved using web3 technology.,PwC 2023 Digital Asset Predictions provides our thoughts on where the industry is heading to help business leaders craft the strategy that this promising but volatile space requires — one that matches innovation with trust.,A decentralized autonomous organization (DAO) is a web-native, self-governing entity that executes the rule sets established by the member community.,They use open-source code and operate on distributed protocols, which means users can view, audit, and verify how they work and directly engage with them without the need for access credentials.}
References
References
CITE THIS NOTEBOOK
CITE THIS NOTEBOOK
Using AI to get textual answers from documents
by Daniel Carvalho
Wolfram Community, STAFF PICKS, September 8, 2024
https://community.wolfram.com/groups/-/m/t/3269144
by Daniel Carvalho
Wolfram Community, STAFF PICKS, September 8, 2024
https://community.wolfram.com/groups/-/m/t/3269144