In this post, we will build a hypothetical auction vehicle damage assessment and valuation application using generative AI technologies. Based on the vehicle identification number (VIN) and images showing vehicle damage, we will use machine learning and generative AI technologies to assess the vehicle’s value for auction and create a detailed vehicle description. Major technologies include OpenCLIP, an open-source implementation of OpenAI’s CLIP (Contrastive Language-Image Pre-training), Amazon’s recently announced Vector Engine for Amazon OpenSearch Serverless (Preview), and AI21 Labs’ Jurassic-2 (J2) Ultra Foundation Model, accessed through Amazon Bedrock. The application can be easily adapted for multiple other industries as well where evaluating the cost of damage is required, including insurance claims, shipping, and retail.
This post was inspired by a series of Generative AI hackathons I recently competed in with two of my close AWS peers, Jigna Gandhi and Chad Jodon. As a team, we developed this winning solution for the vehicle auction industry.