A prompt engineer at Anthropic was testing Claude 3 Opus internally using a "needle-in-the-haystack" evaluation This evaluation basically feeds a specific phrase (the needle) into multiple documents (the haystack) and then tests whether the model can recall that phrase and answer the question correctly The exciting thing about this test was that Opus not only got the answer right but also suspected that it was being tested. Here's the output when it was asked about the most ... Read More

Klarna, a company focused on global payments and shopping services, published a blog post highlighting how their AI assistant (powered by OpenAI) was able to handle two-thirds of their customer service chats in the first month. Here were some of their highlights in just one month(!) What does this mean for leaders? I can’t imagine any business leader looking at those statistics and not realizing that the impact of Gen AI solutions is almost immediate (and highly tangible). So if your ... Read More

Google’s Bard has been rebranded to Gemini, introducing a new mobile app and an advanced version called Gemini Advanced, aimed at enhancing AI collaboration. Gemini Advanced offers access to Ultra 1.0, Google's most advanced AI model (and a potentially a major competitor to OpenAI’s GPT-4), boasting improved capabilities in complex tasks such as coding, logical reasoning, and creative projects. How does it compare to other models in the real world? Ethan Mollick recently wrote ... Read More

In today's rapidly evolving business environment, integrating General AI (Gen AI) into your operations can be a significant change. However, doing so successfully requires a strategic approach. Here are a few best practices that will help. Appointing a Leader and Forming a Team The journey begins with the crucial step of assigning a project leader. This individual should possess a robust understanding of AI and its potential impact on the business. Their responsibility extends to forming a ... Read More

CEO Satya Nadella announced that Microsoft will help train two million people in India on AI skills. Microsoft invests millions of dollars in market research, so they definitely know that this AI revolution isn’t slowing down, and are therefore focusing heavily on training and upskilling workers. Update about the Generative AI for Busy Leaders Book I recently published a book called “Generative AI for Busy Business Leaders” and it hit the #1 Amazon bestseller and #1 new release spots ... Read More

In the rapidly evolving landscape of artificial intelligence, especially Generative AI, it’s crucial to understand the different risks and ethical considerations that come with its implementation. In this post, we'll cover a few of them. Understanding the Risks of Generative AI 1. Bias in AI Models AI models can inherit biases present in training data, leading to unfair outcomes. For instance, an AI used for hiring may show preference towards certain demographics, reflecting biases in ... Read More

In the ever-evolving world of technology, Generative AI (Gen AI) stands out as a groundbreaking innovation, reshaping how businesses approach tasks like content creation and data analysis. Understanding the pricing models of Gen AI solutions is crucial for any organization looking to leverage this technology. Understanding Generative AI Pricing Models Generative AI's versatility in producing text, images, audio, or video means each format comes with its unique pricing model. For instance, ... Read More

In the rapidly evolving world of Generative AI (Gen AI), understanding and prioritizing your return on investments (ROI) is essential. There are two main ROI components: your metrics or Key Performance Indicators (KPIs), and the time to value. This post will delve into these components, providing clarity on how to maximize your Gen AI investments. Understanding Metrics and KPIs Metrics or KPIs are the benchmarks that help gauge the success of your Gen AI investments. They answer the ... Read More

Understanding how to navigate the generative AI space is crucial for any organization looking to harness its potential. To aid in this journey, let's explore a structured approach to evaluating generative AI use cases, focusing on seven key dimensions: data, technology, industry, organization, function, role, and task. This post aims to simplify the complexities of generative AI and provide a clear path for its practical application. Dimension 1: Data When we talk about generative AI in ... Read More