Anton Antonov
​MathematicaForPrediction at WordPress​
​MathematicaForPrediction at GitHub​
March 2024

Introduction

In this notebook we provide aids and computational workflows for the analysis of Joe Biden's State of the Union address given on March 7th, 2024. We use Large Language Models (LLMs). We walk through various steps involved in examining and understanding the speech in a systematic and reproducible manner.
The speech transcript is taken from whitehouse.gov .
The computations are done with Wolfram Language (WL) chatbook. The LLM functions used in the workflows are explained and demonstrated in [SW2, AAn1]. The workflows are done with OpenAI's models. Currently the models of Google's (PaLM, Gemini) and MistralAI cannot be used with the workflows below because their input token limits are too low.
Similar set of workflows and prompts are described in:
◼
  • "LLM aids for processing of the first Carlson-Putin interview" , [AA2, AAn2]
    • ◼
  • "LLM aids for processing Putin’s State-Of-The-Nation speech" , [AA3, AAn3]
    • ◼
  • "LLM over Trump vs. Anderson", [AA4, AAn4]
    • ◼
  • "Comprehension AI Aids for “Can AI Solve Science?” , [AA5, AAn5]
    • The prompts of the latter are used below.
    The "rendering" of the LLM results that are in Markdown format can be done:
    ◼
  • Manually -- that is quick and easy enough
    • ◼
  • Using ExternalEvaluate and the Raku package "Markdown::Grammar", [AAp1], discussed in [AAn6]
    • ◼
  • Using LLM functions as discussed in [AAn2, AAn7].
    • Remark: Some of the LLM workflows are run several times and there might some differences between the rendered texts and the stored in the notebook LLM results.

    Most important or provocative statements

    The following table -- derived from Biden's address -- has the most important or provocative statements (found by an LLM):
    Out[]=
    #
    subject
    statement
    1
    Global Challenges
    Not since President Lincoln and the Civil War have freedom and democracy been under assault here at home as they are today.
    2
    Support for Ukraine
    But Ukraine can stop Putin if we stand with Ukraine and provide the weapons it needs to defend itself.
    3
    Critique of Predecessor
    Now, my predecessor, a former Republican President, tells Putin, 'Do whatever the hell you want.'
    4
    NATO
    Today, we’ve made NATO stronger than ever.
    5
    January 6th Insurrection
    January 6th and the lies about the 2020 election, and the plots to steal the election, posed the gravest threat to our democracy since the Civil War.
    6
    Reproductive Rights
    If Americans send me a Congress that supports the right to choose, I promise you, I will restore Roe v. Wade as the law of the land again!
    7
    Economic Recovery
    15 million new jobs in just three years – that’s a record!
    8
    Climate Action
    I’m taking the most significant action on climate ever in the history of the world.
    9
    Gun Violence
    I’m proud we beat the NRA when I signed the most significant gun safety law in nearly 30 years!
    10
    Israeli-Palestinian Conflict
    This crisis began on October 7th with a massacre by the terrorist group Hamas.
    11
    Vision for America
    To lead America, the land of possibilities, you need a vision for the future of what America can and should be.

    Structure

    The structure of the notebook is as follows:
    1
    .
    Getting the speech text and setup​
    Standard ingestion and setup.
    2
    .
    Themes​
    TL;DR via a table of themes.
    3
    .
    Flowchart​
    Instead of a mind-map.
    4
    .
    Most important or provocative statements​
    What are the most important or provocative statements?
    5
    .
    Summary and recommendations​
    Extracting speech wisdom.
    6
    .
    Hidden and propaganda messages​
    For people living in USA.

    Getting the speech text and setup

    Here we define a text statistics function:
    In[]:=
    Clear[TextStats];​​TextStats[t_String]:=AssociationThread[{"Chars","Words","Lines"},{StringLength[t],Length@TextWords[t],Length@StringSplit[t,"\n"]}];

    Ingest text

    Here we ingest the text of the speech:
    In[]:=
    txtEN=Import["https://www.whitehouse.gov/briefing-room/speeches-remarks/2024/03/07/remarks-of-president-joe-biden-state-of-the-union-address-as-prepared-for-delivery-2/","Plaintext"];​​txtEN=StringTake[txtEN,{StringPosition[txtEN,"March 07, 2024"]〚1,1〛,StringPosition[txtEN,"Next Post:"]〚1,1〛-1}];​​TextStats[txtEN]
    Out[]=
    Chars38063,Words6480,Lines463

    LLM access configuration

    Here we configure LLM access -- we use OpenAI's model "gpt-4-turbo-preview" since it allows inputs with 128K tokens:
    In[]:=
    conf=LLMConfiguration[<|"Model"->"gpt-4-turbo-preview","MaxTokens"->4096,"Temperature"->0.6|>]
    Out[]=
    LLMConfiguration
    Model: ServiceAutomatic,Namegpt-4-turbo-preview
    

    Themes

    Here we extract the themes found in the speech and tabulate them (using the prompt "ThemeTableJSON" ):
    tblThemes=LLMResourceFunction["ThemeTableJSON"][txtEN]
    In[]:=
    tblThemes2=FromJSON[tblThemes];​​DeduceType[tblThemes2]
    Out[]=
    Vector[Struct[{theme,content},{Atom[String],Atom[String]}],15]
    Here we tabulate the found themes:
    In[]:=
    ResourceFunction["GridTableForm"][Values/@tblThemes2,TableHeadings->{Automatic,Keys@First@tblThemes2}]
    Out[]=
    #
    theme
    content
    1
    Introduction
    President Joe Biden begins his State of the Union Address by referencing historical moments of crisis and leadership, drawing parallels to the current challenges facing the United States, emphasizing the unprecedented moment in history and the assault on freedom and democracy both domestically and internationally.
    2
    International Affairs and Security
    Biden discusses the global challenges posed by Russia's actions in Ukraine, the importance of supporting Ukraine, and strengthening NATO. He criticizes his predecessor's approach to Russia and underscores the importance of American leadership in defending democracy and freedom worldwide.
    3
    Domestic Challenges and Democracy
    The President addresses the January 6 insurrection, the ongoing threats to democracy, and the importance of truth and unity in defending democratic values. He calls for bipartisan cooperation to protect the nation's democratic institutions and principles.
    4
    Reproductive Rights
    Biden highlights the impact of the Supreme Court's decision to overturn Roe v. Wade on families and individuals, advocating for the protection of reproductive rights and access to healthcare, including IVF and abortion services.
    5
    Economic Recovery and Policy
    The President outlines the economic progress made during his tenure, including job creation, reduction in unemployment, and efforts to rebuild the economy post-pandemic. He emphasizes policies aimed at strengthening the middle class and ensuring fair economic opportunities for all Americans.
    6
    Infrastructure and Innovation
    Biden discusses significant investments in infrastructure, clean energy, and technology, including the Chips and Science Act, to enhance America's competitiveness and create jobs. He highlights the importance of 'Buy American' policies and federal support for American manufacturing and innovation.
    7
    Healthcare and Social Issues
    The President addresses healthcare affordability, the expansion of Medicare, and the need for further action to reduce prescription drug costs. He also discusses efforts to improve women's health research and the importance of accessible and affordable housing.
    8
    Education and Workforce Development
    Biden advocates for increased access to education, from preschool to college, and emphasizes the importance of connecting education with workforce development. He calls for support for teachers and efforts to make higher education more affordable.
    9
    Tax Policy and Economic Fairness
    The President proposes changes to the tax code to ensure that corporations and the wealthiest Americans pay their fair share, aiming to reduce the deficit and fund critical services and programs that benefit the middle class and the economy.
    10
    Immigration and Border Security
    Biden discusses the need for comprehensive immigration reform and border security measures, criticizing political obstruction and emphasizing the importance of a humane and effective approach to immigration policy.
    11
    Voting Rights and Civil Liberties
    The President calls for the passage of voting rights legislation to protect democracy and ensure fair access to the ballot. He also addresses the importance of diversity and inclusion, advocating for the protection of rights for all Americans.
    12
    Climate Action and Environmental Policy
    Biden outlines his administration's actions to combat climate change, protect the environment, and transition to clean energy, emphasizing the creation of jobs and the importance of environmental justice.
    13
    Public Safety and Gun Control
    The President discusses efforts to reduce crime and violence, including gun control measures and support for community policing. He highlights the importance of public safety and the need for action to prevent gun violence.
    14
    Foreign Policy and Global Challenges
    Biden addresses the conflict in the Middle East, advocating for a ceasefire and humanitarian aid. He emphasizes the need for a two-state solution and discusses efforts to contain threats from Iran and manage relations with China.
    15
    Bipartisanship and Future Vision
    The President concludes by calling for unity and bipartisan cooperation to address the nation's challenges. He shares his optimistic vision for America's future, emphasizing democracy, freedom, and the potential for progress when Americans work together.

    Flowchart

    Here we generate Mermaid-JS flowchart for the “big picture” concepts connections in the speech:
    Here we define “big picture” styling theme:
    Here we create the flowchart from LLM’s specification (using [AAp2]):

    Most important or provocative statements

    Here we find important or provocative statements in the speech via an LLM synthesis:
    Show the important or provocative statements in a table:

    Summary and recommendations

    Here we get a summary and extract ideas, quotes, and recommendations from the speech:
    The result is rendered below.

    SUMMARY

    President Joe Biden delivered the State of the Union Address on March 7, 2024, focusing on the challenges and opportunities facing the United States. He discussed the assault on democracy, the situation in Ukraine, domestic policies including healthcare and economy, and the need for unity and progress in addressing national and international issues.

    IDEAS:

    ◼
  • The historical context of challenges to freedom and democracy, drawing parallels between past and present threats.
    • ◼
  • The role of the United States in supporting Ukraine against Russian aggression.
    • ◼
  • The importance of bipartisan support for national security and democracy.
    • ◼
  • The need for America to take a leadership role in NATO and support its allies.
    • ◼
  • The dangers of political figures undermining democratic values for personal or political gain.
    • ◼
  • The connection between domestic policies and the strength of democracy, including reproductive rights and healthcare.
    • ◼
  • The economic recovery and growth under the Biden administration, emphasizing job creation and infrastructure improvements.
    • ◼
  • The focus on middle-class prosperity and the role of unions in economic recovery.
    • ◼
  • The commitment to addressing climate change and promoting clean energy jobs.
    • ◼
  • The significance of education, from pre-school access to college affordability, in securing America's future.
    • ◼
  • The need for fair taxation and closing loopholes for the wealthy and corporations.
    • ◼
  • The importance of healthcare reform, including lowering prescription drug costs and expanding Medicare.
    • ◼
  • The commitment to protecting Social Security and Medicare from cuts.
    • ◼
  • The approach to immigration reform and border security as humanitarian and security issues.
    • ◼
  • The stance on gun violence prevention and the need for stricter gun control laws.
    • ◼
  • The emphasis on America's resilience and optimism for the future.
    • ◼
  • The call for unity in defending democracy and building a better future for all Americans.
    • ◼
  • The vision of America as a land of possibilities, with a focus on progress and inclusivity.
    • ◼
  • The acknowledgment of America's role in the world, including support for Israel and a two-state solution with Palestine.
    • ◼
  • The importance of scientific research and innovation in solving major challenges like cancer.

    • QUOTES:

    ◼
  • "Not since President Lincoln and the Civil War have freedom and democracy been under assault here at home as they are today."
    • ◼
  • "America is a founding member of NATO the military alliance of democratic nations created after World War II to prevent war and keep the peace."
    • ◼
  • "History is watching, just like history watched three years ago on January 6th."
    • ◼
  • "You can’t love your country only when you win."
    • ◼
  • "Inflation has dropped from 9% to 3% – the lowest in the world!"
    • ◼
  • "The racial wealth gap is the smallest it’s been in 20 years."
    • ◼
  • "I’ve been delivering real results in a fiscally responsible way."
    • ◼
  • "Restore the Child Tax Credit because no child should go hungry in this country!"
    • ◼
  • "No billionaire should pay a lower tax rate than a teacher, a sanitation worker, a nurse!"
    • ◼
  • "We are the only nation in the world with a heart and soul that draws from old and new."

    • HABITS:

    ◼
  • Advocating for bipartisan cooperation in Congress.
    • ◼
  • Emphasizing the importance of education in personal growth and national prosperity.
    • ◼
  • Promoting the use of clean energy and sustainable practices to combat climate change.
    • ◼
  • Prioritizing healthcare reform to make it more affordable and accessible.
    • ◼
  • Supporting small businesses and entrepreneurship as engines of economic growth.
    • ◼
  • Encouraging scientific research and innovation, especially in healthcare.
    • ◼
  • Upholding the principles of fair taxation and economic justice.
    • ◼
  • Leveraging diplomacy and international alliances for global stability.
    • ◼
  • Committing to the protection of democratic values and institutions.
    • ◼
  • Fostering community engagement and civic responsibility.

    • FACTS:

    ◼
  • The United States has welcomed Finland and Sweden into NATO, strengthening the alliance.
    • ◼
  • The U.S. economy has created 15 million new jobs in three years, a record number.
    • ◼
  • Inflation in the United States has decreased from 9% to 3%.
    • ◼
  • More people have health insurance in the U.S. today than ever before.
    • ◼
  • The racial wealth gap is the smallest it has been in 20 years.
    • ◼
  • The United States is investing more in research and development than ever before.
    • ◼
  • The Biden administration has made the largest investment in public safety ever through the American Rescue Plan.
    • ◼
  • The murder rate saw the sharpest decrease in history last year.
    • ◼
  • The United States is leading international efforts to provide humanitarian assistance to Gaza.
    • ◼
  • The U.S. has revitalized its partnerships and alliances in the Pacific region.

    • REFERENCES:

    ◼
  • NATO military alliance.
    • ◼
  • Bipartisan National Security Bill.
    • ◼
  • Chips and Science Act.
    • ◼
  • Bipartisan Infrastructure Law.
    • ◼
  • Affordable Care Act (Obamacare).
    • ◼
  • Voting Rights Act.
    • ◼
  • Freedom to Vote Act.
    • ◼
  • John Lewis Voting Rights Act.
    • ◼
  • PRO Act for worker's rights.
    • ◼
  • PACT Act for veterans exposed to toxins.

    • RECOMMENDATIONS:

    ◼
  • Stand with Ukraine and support its defense against Russian aggression.
    • ◼
  • Strengthen NATO and support new member states.
    • ◼
  • Pass the Bipartisan National Security Bill to enhance U.S. security.
    • ◼
  • Guarantee reproductive rights nationwide and protect healthcare decisions.
    • ◼
  • Continue economic policies that promote job creation and infrastructure development.
    • ◼
  • Implement fair taxation for corporations and the wealthy to ensure economic justice.
    • ◼
  • Expand Medicare and lower prescription drug costs for all Americans.
    • ◼
  • Protect and strengthen Social Security and Medicare.
    • ◼
  • Pass comprehensive immigration reform and secure the border humanely.
    • ◼
  • Address climate change through significant investments in clean energy and jobs.
    • ◼
  • Promote education access from pre-school to college to ensure a competitive workforce.
    • ◼
  • Implement stricter gun control laws, including bans on assault weapons and universal background checks.
    • ◼
  • Support a two-state solution for Israel and Palestine and work towards peace in the Middle East.
    • ◼
  • Harness the promise of artificial intelligence while protecting against its perils.

    • Hidden and propaganda messages

    In this section we try to find is the speech apolitical and propaganda-free.
    Remark: We leave to reader as an exercise to verify that both the overt and hidden messages found by the LLM below are explicitly stated in speech.
    Here we find the hidden and “propaganda” messages in the article:
    Remark: The prompt "FindPropagandaMessage" has an explicit instruction to say that it is intentionally cynical. It is also, marked as being "For fun."
    The LLM result is rendered below.
    OVERT MESSAGE
    President Biden emphasizes democracy, support for Ukraine, and domestic advancements in his address.
    HIDDEN MESSAGE
    Biden seeks to consolidate Democratic power by evoking fear of Republican governance and foreign threats.
    HIDDEN OPINIONS
    ◼
  • Democratic policies ensure national and global security effectively.
    • ◼
  • Republican opposition jeopardizes both national unity and international alliances.
    • ◼
  • Historical comparisons highlight current threats to democracy as unprecedented.
    • ◼
  • Support for Ukraine is a moral and strategic imperative for global democracy.
    • ◼
  • Criticism of the Supreme Court's decisions reflects a push for legislative action on contentious issues.
    • ◼
  • Emphasis on job creation and economic policies aims to showcase Democratic governance success.
    • ◼
  • Investments in infrastructure and technology are crucial for future American prosperity.
    • ◼
  • Health care reforms and education investments underscore a commitment to social welfare.
    • ◼
  • Climate change initiatives are both a moral obligation and economic opportunity.
    • ◼
  • Immigration reforms are positioned as essential to American identity and values.
    • SUPPORTING ARGUMENTS and QUOTES
    ◼
  • Comparisons to past crises underscore the urgency of current threats.
    • ◼
  • Criticism of Republican predecessors and Congress members suggests a need for Democratic governance.
    • ◼
  • References to NATO and Ukraine highlight a commitment to international democratic principles.
    • ◼
  • Mention of Supreme Court decisions and calls for legislative action stress the importance of Democratic control.
    • ◼
  • Economic statistics and policy achievements are used to argue for the effectiveness of Democratic governance.
    • ◼
  • Emphasis on infrastructure, technology, and climate investments showcases forward-thinking policies.
    • ◼
  • Discussion of health care and education reforms highlights a focus on social welfare.
    • ◼
  • The portrayal of immigration reforms reflects a foundational American value under Democratic leadership.
    • DESIRED AUDIENCE OPINION CHANGE
    ◼
  • See Democratic policies as essential for both national and global security.
    • ◼
  • View Republican opposition as a threat to democracy and unity.
    • ◼
  • Recognize the urgency of supporting Ukraine against foreign aggression.
    • ◼
  • Agree with the need for legislative action on Supreme Court decisions.
    • ◼
  • Appreciate the success of Democratic economic and infrastructure policies.
    • ◼
  • Support Democratic initiatives on climate change as crucial for the future.
    • ◼
  • Acknowledge the importance of health care and education investments.
    • ◼
  • Value immigration reforms as core to American identity and values.
    • ◼
  • Trust in Democratic leadership for navigating global crises.
    • ◼
  • Believe in the effectiveness of Democratic governance for social welfare.
    • DESIRED AUDIENCE ACTION CHANGE
    ◼
  • Support Democratic candidates in elections.
    • ◼
  • Advocate for legislative action on contentious Supreme Court decisions.
    • ◼
  • Endorse and rally for Democratic economic and infrastructure policies.
    • ◼
  • Participate in initiatives supporting climate change action.
    • ◼
  • Engage in advocacy for health care and education reforms.
    • ◼
  • Embrace and promote immigration reforms as fundamental to American values.
    • ◼
  • Voice opposition to Republican policies perceived as threats to democracy.
    • ◼
  • Mobilize for international solidarity, particularly regarding Ukraine.
    • ◼
  • Trust in and amplify the successes of Democratic governance.
    • ◼
  • Actively defend democratic principles both nationally and internationally.
    • MESSAGES
    President Biden wants you to believe he is advocating for democracy and progress, but he is actually seeking to consolidate Democratic power and diminish Republican influence.
    PERCEPTIONS
    President Biden wants you to believe he is a unifier and protector of democratic values, but he's actually a strategic politician emphasizing Democratic successes and Republican failures.
    ELLUL'S ANALYSIS
    According to Jacques Ellul's "Propaganda: The Formation of Men's Attitudes," Biden's address exemplifies modern political propaganda through its strategic framing of issues, historical comparisons, and appeals to democratic ideals. Ellul would likely note the address's dual function: to solidify in-group unity (among Democratic supporters) and to subtly influence the broader public's perceptions of domestic and international challenges. The speech leverages crises as opportunities for reinforcing the necessity of Democratic governance, illustrating Ellul's observation that effective propaganda exploits existing tensions to achieve political objectives.
    BERNAYS' ANALYSIS
    Based on Edward Bernays' "Propaganda" and "Engineering of Consent," Biden's speech can be seen as an exercise in shaping public opinion towards Democratic policies and leadership. Bernays would recognize the sophisticated use of symbols (e.g., references to historical events and figures) and emotional appeals to construct a narrative that positions Democratic governance as essential for the nation's future. The speech's emphasis on bipartisan achievements and calls for legislative action also reflect Bernays' insights into the importance of creating a perception of consensus and societal progress.
    LIPPMANN'S ANALYSIS
    Walter Lippmann's "Public Opinion" offers a perspective on how Biden's address attempts to manufacture consent for Democratic policies by presenting a carefully curated version of reality. Lippmann would likely point out the strategic selection of facts, statistics, and stories designed to reinforce the audience's existing preconceptions and to guide them towards desired conclusions. The address's focus on bipartisan accomplishments and urgent challenges serves to create an environment where Democratic solutions appear both reasonable and necessary.
    FRANKFURT'S ANALYSIS
    Harry G. Frankfurt's "On Bullshit" provides a lens for criticizing the speech's relationship with truth and sincerity. Frankfurt might argue that while the address purports to be an honest assessment of the nation's state, it strategically blurs the line between truth and falsehood to serve political ends. The speech's selective presentation of facts and omission of inconvenient truths could be seen as indicative of a broader political culture where the distinction between lying and misleading is increasingly irrelevant.
    NOTE: This AI is tuned specifically to be cynical and politically-minded. Don't take it as perfect. Run it multiple times and/or go consume the original input to get a second opinion.

    References

    Articles

    [AA1] Anton Antonov, "Workflows with LLM functions" , (2023), RakuForPrediction at WordPress .
    [AA2] Anton Antonov, "LLM aids for processing of the first Carlson-Putin interview" , (2024), RakuForPrediction at WordPress .
    [AA3] Anton Antonov, "LLM aids for processing Putin’s State-Of-The-Nation speech", (2024), RakuForPrediction at WordPress .
    [AA4] Anton Antonov, "LLM over Trump vs. Anderson", (2024), RakuForPrediction at WordPress .
    [AA5] Anton Antonov, "Comprehension AI Aids for “Can AI Solve Science?” , (2024), RakuForPrediction at WordPress .
    [OAIb1] OpenAI team, "New models and developer products announced at DevDay" , (2023), OpenAI/blog .

    Notebooks

    [AAn1] Anton Antonov, "Workflows with LLM functions (in WL)", (2023), Wolfram Community.
    [AAn2] Anton Antonov, "LLM aids for processing of the first Carlson-Putin interview", (2024), Wolfram Community.
    [AAn3] Anton Antonov, "LLM aids for processing Putin's State-Of-The-Nation speech given on 2/29/2024", (2024), Wolfram Community.
    [AAn4] Anton Antonov, "LLM over Trump vs. Anderson: analysis of the slip opinion of the Supreme Court of the United States", (2024), Wolfram Community.
    [AAn5] Anton Antonov, "Comprehension AI aids for Stephen Wolfram's article 'Can AI Solve Science?'", (2024), Wolfram Community.
    [AAn6] Anton Antonov, "Markdown to Mathematica converter", (2023), Wolfram Community.
    [AAn7] Anton Antonov, "Monte-Carlo demo notebook conversion via LLMs", (2024), Wolfram Community.

    Packages, paclets

    [AAp1] Anton Antonov, "Markdown::Grammar" Raku package, (2022-2024), GitHub/antononcube.
    [AAp2] Anton Antonov, "MermaidJS" paclet, (2023), Wolfram Language Paclet Repository.

    CITE THIS NOTEBOOK

    LLM aids for processing Biden's State of the Union address​
    by Anton Antonov​
    Wolfram Community, STAFF PICKS, March 14, 2024
    ​https://community.wolfram.com/groups/-/m/t/3141088