Local video Transformers

How this idea evolved

Suggested from citations. No curator has recorded what this idea builds on yet. These ideas from the same theme come from papers that Video Swin cites, directly or one step removed. Citation is a fact; the connection between the ideas is not verified.

• Shifted-window hierarchical ViTSwin · 2021cited directly

  Attention inside local windows that shift between layers, with multi-scale feature maps.

• Distillation token (data-efficient ViT)DeiT · 2020cited directly

  Train ViTs on ImageNet alone by adding a token that learns from a CNN teacher.

• Vision Transformer (ViT)ViT · 2020cited directly

  Split an image into patches and feed them to a plain Transformer as tokens.