Sieve is the cloud for video & audio AI. Leading product teams use Sieve's APIs, tools, and infrastructure to ship AI-powered capabilities faster, together.
External link for Sieve
San Francisco, CA, US
Sieve reposted this
🔎 Today we’re launching a redesign to the Sieve explore page! - Faster, more accurate search - Filter by function tags (understand, video, generate, audio) - Function card improvements Find exactly what you need to understand, manipulate, and generate video at scale. On sievedata.com/explore! And that's a wrap to launch week 🚀
Sieve reposted this
🌍 Sieve Dubbing 2.0 is here. Since launch, we’ve partnered with top video platforms who’ve helped refine the pipeline. Today, see why 2.0 is the highest-quality automated dubbing solution available. Most AI dubbing still suffers from issues like awkward translations, monotone speech, and unnatural timing. These problems arise because dubbing involves transcribing, translating, cloning voices, and syncing speech, with small errors compounding at each step. The biggest issues developers face with other dubbing tools: 1. hallucinations, where TTS models produce gibberish 2. speaking speed, as matching timing across languages often results in speech that's too fast or slow With Ahmed Hanzala's lead on these efforts, we solved both! Learn more about the issues and see side-by-side comparisons in our blog (in comments). Day 4 of launch week ✅
We are excited to announce our partnership with Kaiber as they launch Superstudio, an AI-native platform redefining how creatives interact with generative AI. Kaiber partnered with Sieve as their AI infrastructure provider in April 2023 amid rapid growth. Sieve enabled Kaiber to run AI video workloads at scale while minimizing R&D time and reducing infrastructure spend by over 50%. So today, it’s with great excitement that we officially announce our partnership as they launch Superstudio. Superstudio offers creators a highly curated selection of foundational models for image and video creation through an intuitive Canvas interface. Sieve’s flexible GPU infrastructure, pipeline orchestration, and pre-built components for video-focused use cases made it the perfect choice. Check out their launch and learn more about the partnership (in comments section).
Sieve reposted this
👀 LAUNCH WEEK DAY 2: The first generally available API for eye contact correction! - Redirect eye gaze to focus on the camera automatically - Costs $0.10 / min of video processed - Process videos up to 8x realtime Over a year ago, there were some impressive demos of this, but many required complex software or were too slow. We took inspiration from NVIDIA's Broadcast and LivePortrait's facial expression control to build this pipeline on Sieve. Try it for free now and learn more from our blog (both links in comments).
Sieve reposted this
🚀 LAUNCH WEEK DAY 1: A new playground interface for Sieve functions! We’re kicking of launch week with a refresh to our function UI - Easier to navigate layout - Compare job outputs - Tweak job inputs …all on the same page It’s going to be easier than ever for developers to find the right function parameters for their use case! P.S. This was Sourabh Mane's first ship since joining Sieve. Our interfaces are only getting more slick from here on out 😎
We were already the fastest way to run SAM2 (2x faster than the next best in-fact). Now we support the newly released 2.1 checkpoints! Meta frontend + Sieve backend soon?
Meta open-sourced the code of their impressive SAM demo! I'm Milan this week for #ECCV2024, a big computer vision conference. It allows for meeting up with a lot of researchers, and discuss how to increase the discoverability of their work by releasing on Hugging Face. We encourage researchers to index their paper (by going to hf.co/papers/<your-arxiv-id>). Next: - models could be uploaded based on https://lnkd.in/emjZjgQJ - datasets could be uploaded using https://lnkd.in/eRC5z8Xj - a Gradio demo could be made based on https://lnkd.in/edJThZDv. I also met the incredible team behind Segment-Anything 2! Meta just released fresh SAM-2.1 checkpoints on Hugging Face: https://lnkd.in/ecUSuXMH. The authors just open-sourced the code (both front- and backend) of their super impressive demo at https://lnkd.in/egciaxH2. The code can be found at https://lnkd.in/eGFrQhrZ #segmentanything #sam2 #huggingface
🔥 OpenAI just released whisper-v3-turbo ahead of DevDay 2024. It's 8x faster than large-v3 with minimal quality degradation, and you can now run it on Sieve! Try it via `sieve/speech_transcriber`: https://lnkd.in/gVmNREQ4 Access Whisper directly: https://lnkd.in/garUvi6x
Sieve reposted this
It’s incredible that you can transcribe + summarize videos 50x faster than realtime 💨 Our out-of-the-box pipeline for this on Sieve just got a major update where we processed a ~19 min video is 22 seconds. Transcribed, summarized, tagged, and chapterized. It’s a simple, table stakes use case but it’s cool to see how new model optimizations get it to really blaze.