Why construct an AI assembly assistant?
Right this moment, AI assembly notetakers like Fireflies and Fathom are anticipated to be in conferences to document conversations, generate transcripts, and ship summaries. Extra lately, desktop apps like Granola have gained recognition by permitting customers to document conferences with out a bot. The recognition of desktop apps has prompted groups to construct their very own Granola AI options.
As recording a gathering is now the expectation, differentiation comes from what occurs after the assembly, not from the recording type issue itself. That is the place AI assembly assistants are available in: understanding context, automating workflows and turning conversations into significant outcomes past summarizing conferences.
Infrastructure wanted to construct an AI assembly assistant
Most groups constructing AI assembly assistants use Recall.ai for assembly recording infrastructure. Recall.ai is an inexpensive software that helps builders get to market quicker by eliminating the complexity of constructing and sustaining dependable assembly recording infrastructure throughout platforms and programs.
At a excessive stage, the next infrastructure is required to construct an AI assembly assistant:
- Cross-platform assembly detection and be a part of infrastructure throughout assembly platforms
- Assembly recording infrastructure for each assembly platform
- Extract structured information from captured assembly information
- Pipeline to funnel assembly information into LLM prompts/workflows
- Any infrastructure for the tip consumer going through product
Builders constructing with Recall.ai get structured assembly information out of the field and may give attention to constructing differentiated AI merchandise.
For builders who select to construct their very own seize answer, they should both combine with assembly platform APIs together with the Google Meet API, Microsoft Graph APIs and Zoom Recording APIs (Zoom RTMS or Recording API) or construct a desktop assembly recording app.
Managing a number of assembly platform integration is troublesome as a result of every platform has totally different guidelines for assembly recording. Most builders depend on assembly bot APIs and desktop recording SDKs/APIs to construct a extra uniform solution to seize assembly information.
Constructing a desktop assembly recorder from scratch requires capturing display screen content material, accessing system audio and recording microphone audio reliably throughout working programs and gadgets. Abstracting away this complexity is without doubt one of the many the explanation why builders select to construct with Recall.ai.
Recall.ai offers you flexibility with assembly recording
Not solely does utilizing a supplier like Recall.ai take away the complexity that comes with constructing assembly infrastructure, it additionally offers you the pliability of selecting between two type components for assembly recording.
| Assembly Bot API | Desktop Recording SDK | Constructing a Assembly Bot/Desktop App in-house | Native APIs | |
|---|---|---|---|---|
| Be a part of conferences throughout platforms | Sure | Sure | Relies upon | No |
| Bot is current in assembly | Sure | No | No | No |
| Finish consumer must obtain a desktop app | No | Sure | Relies upon | No |
| Requires upkeep | No | No | Sure | Sure |
| Time to market | Days | Days | Months | Months |
Whether or not you employ a Microsoft Groups bot for assembly recording or a desktop recorder to document a Slack huddle, builders who use a gathering bot API or desktop recording SDK get structured assembly information like transcripts with speaker labels, audio streams with diarization and wealthy assembly metadata.
Structured assembly information is completely essential for AI assembly assistants. To precisely generate summaries, motion gadgets, and follow-up e mail drafts, an AI assembly assistant must know who mentioned what and when it was mentioned. Having assembly context permits builders to skip previous organizing and processing uncooked assembly information and fast-tracks constructing downstream workflows.
As a result of Recall.ai delivers all this performance out of the field, builders can get an AI assembly assistant into manufacturing in a matter of days.
Getting began with Recall.ai
To get began with Recall.ai, you want to enroll in a free account, get an API key and area.
Assembly Bot API
To ship a bot into a gathering, you should utilize this finish level:
curl -X POST https://$RECALLAI_REGION.recall.ai/api/v1/bot
-H 'Authorization: Token $RECALLAI_API_KEY'
-H 'Content material-Kind: utility/json'
-d '
{
"meeting_url": "$MEETING_URL",
"bot_name": "My Bot",
"recording_config": {"transcript": {"supplier": {"recallai_streaming": {}}}}
}'The response will embrace a Bot ID. As soon as the assembly is over, you may retrieve assembly artifacts like transcripts and video recordings utilizing this command:
curl -X GET https://$RECALLAI_REGION.recall.ai/api/v1/bot/$BOT_ID
-H 'Authorization: Token $RECALLAI_API_KEY'Desktop Recording SDK
You’ll be able to attempt one in every of the pattern apps to see how the Desktop Recording SDK works.
As soon as you might be able to combine the Desktop Recording SDK into your personal app, set up the SDK:
npm set up @recallai/desktop-sdkTo initialize the Desktop Recording SDK, add these traces of code:
const RecallAiSdk = require('@recallai/desktop-sdk');
await RecallAiSdk.init({
apiUrl: RECALLAI_REGION
});
RecallAiSdk.addEventListener("permissions-granted", async (evt) => {
});
RecallAiSdk.addEventListener("meeting-detected", async (evt) => {
const { window } = evt;
});With these traces of your code, your utility can detect conferences mechanically and document conferences as soon as they start. If you would like entry to different assembly artifacts, extra configuration is required.
Alternatives within the AI assembly assistant ecosystem
AI assembly assistants are usually not simply assembly summarization instruments. They will clear up many issues throughout totally different verticals. The extra particular the use case, the extra worth it can provide the tip consumer. These are a number of the hottest conditions the place an AI assembly assistant may also help:
Productiveness
You’re a founder who simply had a string of espresso chats right now with buyers and prospects. It’s good to schedule comply with up conferences and ship emails with subsequent steps as soon as the assembly is finished.
Your AI assembly assistant makes use of notes out of your AI notetaker and drafts follow-up emails and assembly invitations so that you simply have to evaluation and approve them.
Gross sales
You might be an account govt in a name with a prospect who’s asking particular questions on a technical characteristic. Whereas you’ll prepare for a gathering between the prospect and an engineer on the staff, the prospect has some speedy questions.
Your AI assembly assistant helps you get solutions to prospect questions in actual time by looking out your engineering documentation and surfacing related data through the name, permitting you to shortly verify whether or not a characteristic is supported.
Hiring
You’re a recruiter and wish to fulfill with 10 candidates right now. Every name is 45 minutes lengthy. After every name, it is advisable summarize the conferences, assign a rating to every candidate, and replace your hiring database.
Your AI assembly assistant generates a abstract, extracts key candidate insights, and automates interview scorecards, saving recruiters hours of handbook work every week and enabling them to maneuver certified candidates via the interview pipeline extra effectively.
Mission administration
You’re a product supervisor in a gathering discussing the work that must be accomplished earlier than the tip of the week. A number of last-minute tickets have been added, and the staff is debating priorities and particular person bandwidth.
Your AI assembly assistants mechanically create and assign points and notify house owners primarily based on what was mentioned within the assembly so groups can give attention to execution as an alternative of delegation.
Healthcare
You’re a psychiatrist who meets over 5 shoppers in a day. After every session, it is advisable doc the dialog, monitor the affected person’s progress, and enter data into the EHR.
Your AI assembly assistants replace affected person data and extract related data so psychiatrists can spend much less time on documentation and extra time specializing in affected person care.
FAQ on constructing an AI assembly assistant
What’s an AI assembly assistant?
An AI assembly assistant captures and understands conversations from conferences, then takes motion primarily based on the context of what was mentioned. Past transcribing conferences, it could extract insights, determine motion gadgets, generate summaries, and set off downstream workflows in different programs.
How do you select an AI assembly assistant?
The best AI assembly assistant depends upon your business and use case. Some groups want gross sales intelligence and CRM automation, whereas others want documentation, buyer insights, or compliance recording API. You will additionally wish to take into account whether or not you favor an answer that makes use of a gathering bot that joins a name or a desktop-based recording answer.
Why must you construct your personal AI assembly assistant?
Constructing your personal AI assembly assistant is sensible when off-the-shelf instruments do not meet your necessities or should you’re growing a product that does not exist for a particular business or workflow.
What are frequent issues you will encounter while you construct your personal AI assembly assistant?
The principle problem you will encounter whereas constructing your personal AI assembly assistant is reliably capturing assembly information. Whether or not you are constructing a desktop assembly recorder or a gathering bot, assembly seize infrastructure is extra advanced than it initially seems. Builders should account for numerous edge instances, keep compatibility with adjustments throughout assembly platforms and working programs, and guarantee reliability throughout massive numbers of concurrent conferences. In consequence, constructing and sustaining assembly seize infrastructure requires extra engineering effort than anticipated.
How do you construct an AI assembly assistant?
An AI assembly assistant consists of two core parts: assembly seize infrastructure and downstream AI workflows. First, you want a dependable solution to document conferences throughout platforms akin to Zoom, Google Meet, and Microsoft Groups. Constructing the assembly seize infrastructure is probably the most difficult a part of the stack. Many groups use Recall.ai to allow them to give attention to constructing differentiated AI experiences as an alternative of constructing and sustaining assembly seize infrastructure.
Is Recall.ai free?
You’ll be able to join a free account and begin constructing instantly. Recall.ai provides pay-as-you-go pricing and is designed to stay inexpensive for startups, indie builders, and rising firms.
What type components do Recall.ai present?
Recall.ai helps each assembly bots and desktop-based recording. Builders can use the Assembly Bot API to deploy bots that be a part of calls, or the Desktop Recording SDK for purposes that seize conferences with out including a participant to the decision.
Why ought to we belief Recall.ai?
Recall.ai is probably the most dependable choice available in the market with over 99.9% reliability. Trusted by Fortune 500 firms and main AI startups together with ClickUp, Circleback and Mem to construct production-grade merchandise on prime of assembly information.
