The Rise of Google Bard

Sakil Ansari
4 min readMar 25, 2023

--

What is Google Bard?

Bard is an experimental Google’s Conversational AI chatbot model.It is generative AI. It is a text-based generative AI that responds to prompts and performs out text-based tasks like answering questions, summarising information, and generating different kinds of content.It is designed to function similarly to chatgpt.Google Bard is a fine-tuned and prompted version of LaMDA 2, with a likely parameter count of 2B.Bard is based on the Language Model for Dialogue Application (LaMDA), Google’s own conversational AI chatbot.However, the model is currently a “lightweight” version of LaMDA, and the one being “requires significantly less computing power, enabling it to scale to more users.It is based on the Transformer architecture, which also serves as the foundation for ChatGPT and other AI bots.Bard has web access during inference.

Bard and ChatGPT :Evolution

According to Google, Bard was given the name because it is a “storyteller,”

Timeline to Google Bard

Timeline from Google Meena to Google Bard:Reference

Why Did Google Release Bard?

When OpenAI’s ChatGPT launched to great acclaim, it gave the impression that Google was lagging behind in terms of technology. This is why Google released Bard.It was believed that ChatGPT was a ground-breaking innovation with the power to upend the search market and tip the balance of power away from Google search and the lucrative search advertising sector.

The New York Times claimed that Google had declared a “code red” to immediately outline its response to the threat posed to its business model on December 21, 2022, which was three weeks after the debut of ChatGPT.Google announced the launch of Bard on February 6, 2023, which is 47 days after the code red strategy modification.

Google’s Infiniset Dataset

Google Bard is based on a language model called LaMDA, which is an acronym for Language Model for Dialogue Applications.A dataset known as Infiniset was used to train LaMDA.Infiniset is a collection of Internet information that was specifically picked to improve the model’s conversational skills.LaMDA 2 ‘s Infiniset contains 1.56T words (1,560B words), which Google tokenized to 2.81T tokens (2,810B tokens).Bard’s Infiniset contains 12.55TB of text data.

LaMDA 2 and Bard’s Infiniset dataset is made up of:

Google LaMDA 2/Bard dataset:Reference

How Does Google Bard Work?

LaMDA is a large language model that uses online data and dialogue datasets for training.LaMDA : The paper describes that :there are two important factors related to the training of LaMDA.

  • Safety : The model is tuned using data that was annotated by crowd workers, which results in a level of safety.
  • Groundedness:LaMDA grounds itself factually on external sources of information (through information retrieval, which is search).

There are three metrics which are used to evaluate LaMDA outputs:

  • Sensibleness: A way of gauging the logicality of a response.
  • Specificity: Determines whether the response is contextually particular or the reverse of general/vague.
  • Interestingness: This metric assesses whether LaMDA’s responses are insightful or inspire curiosity.

Crowdsourced raters evaluated each of the three measures, and the results were fed back into the system to keep it getting better.

ChatGPT VS Google Bard via NPR

ChatGPT VS Google Bard via NPR:Reference

Google Bard scored 66% higher than ChatGPT for maths (5 points vs 3 points) in an informal assessment by NPR assisted by Google engineers (15/Feb/2023), but ChatGPT was slightly better overall.

Bard Samples

Bard samples

Bard-Suggesting multiple drafts

Bard-Suggesting multiple drafts

Bard is providing the citation

Bard is providing the citation

The initial release of Bard does not support coding

The initial release of Bard does not support coding

Conclusion

The emergence of Google Bard highlights the growing sophistication of AI algorithms, and their ability to replicate human-like processes such as language generation. With the continued development of AI, we can expect to see more tools like Google Bard emerge in the coming years. As AI technology continues to improve, it will become increasingly important to consider the ethical implications of machine-generated content.

Overall, the rise of Google Bard represents an exciting development in the field of AI, and highlights the growing potential for collaboration between humans and machines in creative endeavors.

--

--

Sakil Ansari
Sakil Ansari

Written by Sakil Ansari

Working as a Data Scientist/ML/NLP/Speech Recognition/Deep learning

No responses yet