From 0687c0372185e918bbe34c9aedf0ce8d3b37da29 Mon Sep 17 00:00:00 2001 From: xilin1991 Date: Tue, 23 Jan 2024 14:21:08 +0800 Subject: [PATCH] update project page --- docs/index.html | 174 ++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 174 insertions(+) create mode 100644 docs/index.html diff --git a/docs/index.html b/docs/index.html new file mode 100644 index 0000000..c737d1d --- /dev/null +++ b/docs/index.html @@ -0,0 +1,174 @@ + + + + + + + + + XMem + + + + + + + + + + +



+
+
+
+ XMem: Long-Term Video Object Segmentation with an Atkinson-Shiffrin Memory Model +
+
+ +
+
+
+ ECCV 2022 +
+
+
+ +
+
+ Ho Kei Cheng +
+
+ Alexander Schwing +
+
+ +
+ +
+
+ [arXiv] +
+
+ [Paper] +
+
+ [Code] +
+
+ +
+ +
+ Interactive GUI demo available [here]! +
+ + framework + +
+
+ +
+ +
+
+ Abstract +
+
+
+
+
+

+ We present XMem, a video object segmentation architecture for long videos with unified feature memory stores inspired by the Atkinson-Shiffrin memory model. + Prior work on video object segmentation typically only uses one type of feature memory. For videos longer than a minute, a single feature memory model tightly links memory consumption and accuracy. + In contrast, following the Atkinson-Shiffrin model, we develop an architecture that incorporates multiple independent yet deeply-connected feature memory stores: a rapidly updated sensory memory, a high-resolution working memory, and a compact thus sustained long-term memory. + Crucially, we develop a memory potentiation algorithm that routinely consolidates actively used working memory elements into the long-term memory, which avoids memory explosion and minimizes performance decay for long-term prediction. + Combined with a new memory reading mechanism, XMem greatly exceeds state-of-the-art performance on long-video datasets while being on par with state-of-the-art methods (that do not work on long videos) on short-video datasets. +

+
+
+
+
+
+ framework +
+
+ +
+
+
+ +
+
+ Handling long-term occlusion +
+
+
+
+ +
+ +
+
+
+ +
+
+ Very-long video; masked layer insertion +
+
+
+
+ + Source: https://www.youtube.com/watch?v=q5Xr0F4a0iU +
+ +
+
+
+ +
+
+ Out-of-domain case +
+
+
+
+ + Source: かぐや様は告らせたい ～天才たちの恋愛頭脳戦～ Ep.3; A1 Pictures +
+ +

+ +
+ Contact: Ho Kei (Rex) Cheng +
+ +
+
+

+ +
+ + + \ No newline at end of file