sayzard田中義弘 | taziku CEO / AI × Creative (@taziku_co)
긴 동영상의 가치가 '전부 보기'가 아니라는 관찰과 함께, Grok에 URL을 보내면 영상 전체의 요점을 반환한다는 사례 소개. 정보 섭취가 재생시간 대신 추출 정밀도의 경쟁으로 바뀔 수 있으며, 구조를 먼저 받는 시대가 도래할 수 있다고 전망.
Tech ChilliHow to Summarize YouTube Videos with Google Gemini (Step-by-Step Guide)?
See here - https://techchilli.com/artificial-intelligence/how-to-summarize-youtube-videos-with-google-gemini/
#GoogleGemini #YouTubeSummarizer #DigitalTool #ContentCreation #Research #Education #TechGuide #Productivity #StepByStep #HowTo #VideoSummarization #TechTips #Efficiency #DigitalLearning
J. de CurtòNew preprint: Summarization of Videos with the Signature Transform #TechRxiv #VideoSummarization #LargeLanguageModels #VisualLanguageModels #SignatureTransform
https://doi.org/10.36227/techrxiv.21546900.v1
https://doi.org/10.36227/techrxiv.21546900.v1
Summarization of Videos with the Signature Transform
This manuscript proposes a new benchmark to assess the goodness of visual summaries without the necessity of human annotators. It is based on the Signature Transform, specifically on RMSE and MAE Signature and Log-Signature, and builds on the assumption that uniform random sampling can provide accurate summarization capabilities. First, we introduce a preliminary baseline for automatic video summarization, which has at its core a Vision Transformer, an image-text model pre-trained with contrastive learning (CLIP), as well as a module of object detection. Our baseline leverages video text descriptions to determine the most frequent nouns to use as anchors, and then it performs an open-vocabulary image search on the video frames. This enables a zero-shot text-conditioned object detection to select the frames for the final video summary. Despite not needing any proper fine-tuning, our approach provides accurate summaries on a wide range of video data. Since there are not many datasets available for this task, a new dataset consisting of videos from Youtube and the corresponding automatic audio transcriptions is provided. Then, a state-of-the-art accurate technique based on the harmonic components that the Signature Transform is able to capture, and that achieves compelling accuracy and outperforms previous methodologies, is proposed. The analytical measures are extensively evaluated, and we can conclude that correlate very well with the notion of a good summary.