The technology behind Amazon’s Genai-Powled Shopping Assistant, Rufus

The technology behind Amazon's Genai-Powled Shopping Assistant, Rufus

[Editor’s note: A condensed version of this blog post appeared previously in IEEE Spectrum] “What do I need for cold weather golf?” “What is the difference between trail shoes and running shoes?” “What’s the best dinosaur toy for a five-year-old beerol?” These are some of the open questions that customers can ask a useful sales … Read more

A quick guide to Amazon’s 50-Plus papers on Emnlp 2024

A quick guide to Amazon's 50-Plus papers on Emnlp 2024

Large Language Models (LLMs) have come to dominate the area of ​​natural-language processing, so it is not surprising that they also dominate the research that Amazon scientists present at this year’s conference on empirical methods in natural-language procedure (Emnlp ). LLM training is the subject with the largest number of Amazon papers, which are closely … Read more

Detoxification of large language models via regularized fine tuning

Detoxification of large language models via regularized fine tuning

Large language models (LLMs) have demonstrated impressive benefits across different tasks, but as it has been clear in several cases, they have the risk of producing inappropriate, unsafe or partial output. When generating resorts, a successful trained LLM must comply with a set of policies specified by its creator; For example, the developer may limit … Read more

Model produces pseudocode for security checks in seconds

Model produces pseudocode for security checks in seconds

One of the ways Amazon Web Services (AWS) helps customers stay secure in their cloud is with the AWS Security Hub, which aggregates, organizes, and prioritizes security alerts from AWS services and third-party tools. These alerts are based on security controls – rules that help ensure the services are configured securely and in accordance with … Read more

Amazon opens new AI lab in San Francisco with focus on long-term research bets

Amazon opens new AI lab in San Francisco with focus on long-term research bets

From left to right: David Luan, VP of Autonomy and Head of Amazon’s AGI SF Lab, and Pieter Abbeel, Amazon Scholar, Robotics. Today, we are excited to announce the formation of the Amazon AGI SF Lab, a new dedicated team based in San Francisco. The initial focus of our lab will be to develop new … Read more

A quick guide to Amazon’s papers on Neurips 2024

A quick guide to Amazon's papers on Neurips 2024

The 2024 Conference on Neural Information Processing Systems (Neurips)-the first conference in artificial intelligence-begins today, and the Amazon papers that were accepted there show the breadth of the company’s AI research. Large Language Models (LLMs) and other basic models have dominated the field for the past few years, and Amazon’s papers reflect this trend that … Read more

Unlock insights from qualitative text with LLM-enhanced topic modeling

Unlock insights from qualitative text with LLM-enhanced topic modeling

Whether collected through employee surveys, product feedback channels, voice-to-customer mechanisms, or other unstructured text sources, qualitative data offers invaluable insights that can complement and contextualize quantitative business intelligence. However, the manual effort required to analyze large volumes of open-ended responses has limited access to these insights. Topic modeling approaches such as latent Dirichlet allocation (LDA), … Read more

Understanding the Training Dynamics in Transformers

Understanding the Training Dynamics in Transformers

Most of today’s cutting-edge AI models are based on the transformer architecture, which is characterized by its use of an attention mechanism. In a large language model (LLM), for example, the transformer determines which words in the text string should be given special attention when generating the next word; in a vision language model, it … Read more

The 10 most viewed blog posts in 2024

The 10 most viewed blog posts in 2024

Amazon is looking for a passionate, talented and inventive Applied Scientist with a strong machine learning background to help build industry-leading language technology. Our mission is to provide Amazon customers with a delightful experience by pushing the boundaries of Natural Language Processing (NLP), Generative AI, Large Language Model (LLM), Natural Language Understanding (NLU), Machine Learning … Read more