1、Image/Video Captioning(图像/视频字幕)
- Visual Fact Checker: Enabling High-Fidelity Detailed Caption Generation
- Polos: Multimodal Metric Learning from Human Feedback for Image Captioning
⭐code
🏠project - Panda-70M: Captioning 70M Videos with Multiple Cross-Modality Teachers
⭐code - MeaCap: Memory-Augmented Zero-shot Image Captioning
⭐code - Sieve: Multimodal Dataset Pruning using Image Captioning Models
- [EVCap: Retrieval-Augmented Image Captioning with External Visual--Name Memory for Open-World Comprehension]
- EVCap: Retrieval-Augmented Image Captioning with External Visual-Name Memory for Open-World Comprehension
- 视频描述/字幕
- Streaming Dense Video Captioning
⭐code
⭐code - Video ReCap: Recursive Captioning of Hour-Long Videos
⭐code
🏠project
🌻dataset - Do You Remember? Dense Video Captioning with Cross-Modal Memory Retrieval
- VideoCon: Robust Video-Language Alignment via Contrast Captions
⭐code
🏠project - Retrieval-Augmented Egocentric Video Captioning
- 密集字幕
- A Picture is Worth More Than 77 Text Tokens: Evaluating CLIP-Style Models on Dense Captions
- DIBS: Enhancing Dense Video Captioning with Unlabeled Videos via Pseudo Boundary Enrichment and Online Refinement
- 生成图解说明
- Generating Illustrated Instructions
⭐code
🏠project
2、Image/Video Compression(图像/视频压缩)
- 视频压缩
- Neural Video Compression with Feature Modulation
⭐code - C3: High-Performance and Low-Complexity Neural Compression from a Single Image or Video
⭐code
🏠project - Task-Aware Encoder Control for Deep Video Compression
- 图像压缩
- Towards Backward-Compatible Continual Learning of Image Compression
⭐code - Generative Latent Coding for Ultra-Low Bitrate Image Compression
- Dual Prior Unfolding for Snapshot Compressive Imaging
- Enhancing Quality of Compressed Images by Mitigating Enhancement Bias Towards Compression Domain
- SCINeRF: Neural Radiance Fields from a Snapshot Compressive Image
⭐code - JDEC: JPEG Decoding via Enhanced Continuous Cosine CoefficientsJPEG 解码
- Learned Lossless Image Compression based on Bit Plane Slicing
3、Image/Video Super-Resolution(图像超分辨率)
- Image Processing GNN: Breaking Rigidity in Super-Resolution
- Learning Large-Factor EM Image Super-Resolution with Generative Priors
- Super-Resolution Reconstruction from Bayer-Pattern Spike Streams
- Continuous Optical Zooming: A Benchmark for Arbitrary-Scale Image Super-Resolution in Real World
- Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary
⭐code - Learning Coupled Dictionaries from Unpaired Data for Image Super-Resolution
- SinSR: Diffusion-Based Image Super-Resolution in a Single Step
⭐code - CAMixerSR: Only Details Need More "Attention"
- Text-guided Explorable Image Super-resolution
- CFAT: Unleashing Triangular Windows for Image Super-resolution
- SeD: Semantic-Aware Discriminator for Image Super-Resolution
- Training Generative Image Super-Resolution Models by Wavelet-Domain Losses Enables Better Control of Artifacts
- Boosting Flow-based Generative Super-Resolution Models via Learned Prior
⭐code - Beyond Image Super-Resolution for Image Recognition with Task-Driven Perceptual Loss
⭐code - AdaBM: On-the-Fly Adaptive Bit Mapping for Image Super-Resolution
⭐code - Uncertainty-Aware Source-Free Adaptive Image Super-Resolution with Wavelet Augmentation Transformer
- DiSR-NeRF: Diffusion-Guided View-Consistent Super-Resolution NeRF超分辨率
- Neural Super-Resolution for Real-time Rendering with Radiance Demodulation
- Self-Adaptive Reality-Guided Diffusion for Artifact-Free Super-Resolution
⭐code - Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning
- CoSeR: Bridging Image and Language for Cognitive Super-Resolution
⭐code
🏠project - Navigating Beyond Dropout: An Intriguing Solution towards Generalizable Image Super Resolution
- Bilateral Event Mining and Complementary for Event Stream Super-Resolution
- 盲图像超分辨率
- CDFormer: When Degradation Prediction Embraces Diffusion Model for Blind Image Super-Resolution
- A Dynamic Kernel Prior Model for Unsupervised Blind Image Super-Resolution
- 真实世界超分辨率 Universal Robustness via Median Randomized Smoothing for Real-World Super-Resolution
- APISR: Anime Production Inspired Real-World Anime Super-Resolution
- SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution
- VSR
- Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution
- Enhancing Video Super-Resolution via Implicit Resampling-based Alignment
- Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution
🏠project - Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attention
⭐code
- 文本图像超分
- Diffusion-based Blind Text Image Super-Resolution
4、Image Classification(图像分类)
- Fair-VPT: Fair Visual Prompt Tuning for Image Classification
- Logarithmic Lenses: Exploring Log RGB Data for Image Classification
- SLICE: Stabilized LIME for Consistent Explanations for Image Classification
- Classes Are Not Equal: An Empirical Study on Image Recognition Fairness
- MCPNet: An Interpretable Classifier via Multi-Level Concept Prototypes
- SURE: SUrvey REcipes for building reliable and robust deep networks
⭐code - A Bayesian Approach to OOD Robustness in Image Classification
- Fourier-basis Functions to Bridge Augmentation Gap: Rethinking Frequency Augmentation in Image Classification
- Hyperspherical Classification with Dynamic Label-to-Prototype Assignment
⭐code - Discover and Mitigate Multiple Biased Subgroups in Image Classifiers
⭐code - Deep Imbalanced Regression via Hierarchical Classification Adjustment
- Large Language Models are Good Prompt Learners for Low-Shot Image Classification
⭐code - Modeling Collaborator: Enabling Subjective Vision Classification With Minimal Human Effort via LLM Tool-Use
- Bayesian Exploration of Pre-trained Models for Low-shot Image Classification
- Enhance Image Classification via Inter-Class Image Mixup with Diffusion Model
- Leveraging Cross-Modal Neighbor Representation for Improved CLIP Classification
⭐code - In-distribution Public Data Synthesis with Diffusion Models for Differentially Private Image Classification
- 域泛化图像分类
- Leveraging Vision-Language Models for Improving Domain Generalization in Image Classification
🏠project
- 长尾识别
- LTGC: Long-tail Recognition via Leveraging LLMs-driven Generated Content
- 小样本图像分类
- Frozen Feature Augmentation for Few-Shot Image Classification
- 零样本分类
- Label Propagation for Zero-shot Classification with Vision-Language Models
⭐code - CARZero: Cross-Attention Alignment for Radiology Zero-Shot Classification
⭐code - Improved Zero-Shot Classification by Adapting VLMs with Text Descriptions
⭐code零样本分类
- 细粒度
- Fine-grained Bipartite Concept Factorization for Clustering
- Novel Class Discovery for Ultra-Fine-Grained Visual Categorization
⭐code
- 开集分类
- ProTeCt: Prompt Tuning for Taxonomic Open Set Classification
- 小样本识别
- Instance-based Max-margin for Practical Few-shot Recognition
- GCD(广义类别发现)
- Federated Generalized Category Discovery
- Active Generalized Category Discovery
⭐code - Contrastive Mean-Shift Learning for Generalized Category Discovery
- Solving the Catastrophic Forgetting Problem in Generalized Category Discovery
