Our research focuses on video signal processing and transmission. We develop intelligent video analytics, work on efficient compression methods for image and video signals, and improve the energy efficiency of video communication systems. Moreover, we develop advanced image sensing systems such as camera arrays, non-regular sampling sensors, and multispectral imaging.
Research projects
Intelligent video analytics using model- and data-driven approaches
Efficient compression methods for image and video signals, including medical data
Energy efficiency of medical picture archiving systems
Advanced image sensing systems using camera arrays, non-regular sampling sensors, and multispectral imaging
Current projects
Learning Predictive Maintenance of Fleets of Networked Systems
(Third Party Funds Single)
Term: 1. September 2023 - 31. August 2026Funding source: Bayerische Forschungsstiftung
The project aims at advancing predictive maintenance for networked device fleets using learning approaches and integrating expert knowledge. To this end, we will combine machine learning with physical models and analyze data flows between systems as well as integrate expertise on system behavior and failure modes. The resulting predictive maintenance approach for networked systems will be transferred to various classes of systems. Besides investigating industrial applications, we will create a fleet of mobile robots to demonstrate the capabilities of the predictive maintenance approach and make it available to academia, industry, and beyond.
Codierung von multimodalen Körperhüllendaten
(Third Party Funds Group – Sub project)
Overall project: Empathokinästhetische Sensorik - Sensortechniken und Datenanalyseverfahren zur empathokinästhetischen
Modellbildung und Zustandsbestimmung (EmpkinS)
Term: 1. July 2020 - 30. June 2025
Funding source: DFG / Sonderforschungsbereich (SFB)
URL: https://www.empkins.de/
Ziel des Teilprojekts ist es, ein Quellencodierungsverfahren für multimodale Körperhüllendaten zu entwickeln, welches eine effiziente Übertragung der menschlichen Körperhülle einschließlich ihrer Bewegung ermöglicht. Für die Codierung sollen die räumliche Korrelation der Tiefensignale, die zeitliche Kohärenz der menschlichen Bewegung und die Verbundabhängigkeiten zwischen Mikrodoppler-Apertursynthese-Radardaten und Tiefensignalen genutzt werden. Abhängig von der Rekonstruktionsgenauigkeit der biomechanischen und psychomotorischen Anwendungen im SFB wird eine Reduktion des Datenvolumens um mindestens zwei Größenordnungen erwartet.
Recent publications
2025
Nguyen, D.T., & Kaup, A. (2025). Learning-based Lossless Point Cloud Geometry Coding using Sparse Tensors .
Nguyen, D.T., Nambiar, K.G., & Kaup, A. (2025). Deep probabilistic model for lossless scalable point cloud attribute compression .
2024
Bergmann, S., Moussa, D., Brand, F., Kaup, A., & Rieß, C. (2024). Forensic analysis of AI-compression traces in spatial and frequency domain . Pattern Recognition Letters .
Brand, F., Seiler, J., & Kaup, A. (2024). Conditional Residual Coding: A Remedy for Bottleneck Problems in Conditional Inter Frame Coding . IEEE Transactions on Circuits and Systems For Video Technology , 1-1. https://doi.org/10.1109/TCSVT.2024.3359948
Brand, F., Seiler, J., Sauer, J., Alshina, E., & Kaup, A. (2024). Adaptive Variance-Threshold-Based Skip Modes for Learned Video Compression Using a Motion Complexity Criterion . In 2024 Picture Coding Symposium, PCS 2024 - Proceedings . Taichung, TWN: Institute of Electrical and Electronics Engineers Inc..
Eichermüller, L., Chaudhari, G., Katsavounidis, I., Lei, Z., Tmar, H., Herglotz, C., & Kaup, A. (2024). Encoding Time and Energy Model for SVT-AV1 based on Video Complexity . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024 . Seoul, KR.
Eichermüller, L., Chaudhari, G., Katsavounidis, I., Lei, Z., Tmar, H., Herglotz, C., & Kaup, A. (2024). SVT-AV1 Encoding Bitrate Estimation Using Motion Search Information . In Proceedings of the 32nd European Signal Processing Conference . Lyon, FR.
Herglotz, C., Kränzler, M., Dai, R., & Kaup, A. (2024). Complexity Metrics for VVC Decoder Power Reduction in Green Metadata . In Proceedings of the Picture Coding Symposium . Taichung, Taiwan, TW.
Herglotz, C., Kränzler, M., Xu, B., & Kaup, A. (2024). Decoding Energy Optimization for Video Coding Using Model-Driven Gradient Descent . In Proceedings of the IEEE 26th International Workshop on Multimedia Signal Processing (MMSP) . Purdue Universty, West Lafayette, Indiana, USA, US.
Herglotz, C., Och, H., Meyer, A., Ramasubbu, G., Eichermüller, L., Kränzler, M.,... Kaup, A. (2024). The Bjøntegaard Bible - Why your Way of Comparing Video Codecs May Be Wrong . IEEE Transactions on Image Processing , 33 , 987 - 1001. https://doi.org/10.1109/TIP.2023.3346695
Jia, P., Koyuncu, A.B., Mao, J., Cui, Z., Ma, Y., Guo, T.,... Kaup, A. (2024). Bit Rate Matching Algorithm Optimization in JPEG-AI Verification Model . In 2024 Picture Coding Symposium, PCS 2024 - Proceedings . Taichung, TWN: Institute of Electrical and Electronics Engineers Inc..
Kossira, K., Schön, D., Seiler, J., & Kaup, A. (2024). Conditional Optimal Filter Selection for Multispectral Object Classification . In Proceedings of the International Conference on Image Processing (ICIP) . Abu Dhabi, AE.
Kossira, K., Seiler, J., & Kaup, A. (2024). Inter-Camera Color Correction for Multispectral Imaging with Camera Arrays Using a Consensus Image . In Proceedings of the International Workshop on Multimedia Signal Processing (MMSP) . West Lafayette, US.
Kränzler, M., Herglotz, C., & Kaup, A. (2024). A Comprehensive Review of Software and Hardware Energy Efficiency of Video Decoders . In Proceedings of the Picture Coding Symposium (PCS) . Taichung, Taiwan, TW.
Meyer, A., Prativadibhayankaram, S., & Kaup, A. (2024). Efficient Learned Wavelet Image and Video Coding . In Proceedings of the 2024 IEEE International Conference on Image Processing (ICIP) . Abu Dhabi.
Nguyen, D.T., Zieger, D., Gambietz, M., Koelewijn, A., Stamminger, M., & Kaup, A. (2024). Multiresolution point cloud compression for real-time visualization and streaming of large 3D datasets . In Proceedings of the Asilomar Conferense on Signals, Systems, and Computers .
Och, H., Uddehal, S.R., Strutz, T., & Kaup, A. (2024). Enhanced Color Palette Modeling for Lossless Screen Content Compression . In Proceedings of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing . Seoul, KR.
Och, H., Uddehal, S.R., Strutz, T., & Kaup, A. (2024). Improved Screen Content Coding in VVC Using Soft Context Formation . In Proceedings of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing . Seoul, KR.
Prativadibhayankaram, S., Richter, T., Fößel, S., & Kaup, A. (2024). Latent Channel Energy in Learned Image Codecs . In Andrew G. Tescher, Touradj Ebrahimi (Eds.), Proceedings of SPIE - The International Society for Optical Engineering . San Diego, CA, USA: SPIE.
Ramasubbu, G., Kaup, A., & Herglotz, C. (2024). Modeling the Energy Consumption of the HEVC Software Encoding Process using Processor Events . In 2024 IEEE 26th International Workshop on Multimedia Signal Processing (MMSP) . Purdue University, West Lafayette, Indiana, USA.
Ramasubbu, G., Kaup, A., & Herglotz, C. (2024). Towards Video Codec Performance Evaluation: A Rate-Energy-Distortion Perspective . In 2024 16th International Conference on Quality of Multimedia Experience (QoMEX) . Karlshamn, Sweden.
Regensky, A., Brand, F., & Kaup, A. (2024). Analysis of Neural Video Compression Networks for 360-Degree Video Coding . In IEEE (Eds.), Proceedings of the Picture Coding Symposium (PCS) . Taichung, TW.
Regensky, A., & Kaup, A. (2024). Geometry-Corrected Geodesic Motion Modeling with Per-Frame Camera Motion for 360-Degree Video Compression . In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) (pp. 3215-3219). Seoul, KR.
Rückert, R., Li, Y., Herglotz, C., Sura, O., Kaup, A., & Vossiek, M. (2024). Compression of Preprocessed Automotive Radar Data by Using Context-Adaptive Binary Arithmetic Coding . In IEEE (Eds.), Proceedings of the 2024 21st European Radar Conference (EuRAD) (pp. 336-339). Paris, France.
Rückert, R., Ullmann, I., Vossiek, M., Kaup, A., & Herglotz, C. (2024). Data Compression for Close-Range Radar Imaging . IEEE Transactions on Radar Systems , 1 (2), 421-433. https://doi.org/10.1109/TRS.2024.3387288
Sippel, F., Genser, N., Och, H., Seiler, J., & Kaup, A. (2024). Color Agnostic Cross-Spectral Disparity Estimation . In Proceedings of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing . Seoul, KR.
Sippel, F., Seiler, J., & Kaup, A. (2024). A Guided Upsampling Network for Short Wave Infrared Images Using Graph Regularization . In Proceedings of the 2024 IEEE International Conference on Acoustics, Speech and Signal Processing . Seoul, KR.
Sippel, F., Seiler, J., & Kaup, A. (2024). Fast Edge-Aware Occlusion Detection in the Context of Multispectral Camera Arrays . In Proceedings of the 2024 IEEE International Conference on Image Processing . Abu Dhabi, AE.
Sippel, F., Seiler, J., & Kaup, A. (2024). High-resolution hyperspectral video imaging using a hexagonal camera array . Journal of the Optical Society of America A: Optics and Image Science, and Vision , 41 (12), 2303-2315. https://doi.org/10.1364/JOSAA.536572
Windsheimer, M., Brand, F., & Kaup, A. (2024). Multiscale Augmented Normalizing Flows for Image Compression . In Proceedings of the International Conference on Acoustics, Speech and Signal Processing . Seoul, KR.
Windsheimer, M., Brand, F., & Kaup, A. (2024). On Annotation-free Optimization of Video Coding for Machines . In Proceedings of the International Conference on Image Processing (ICIP) (pp. 1857-1863). Abu Dhabi, KR.
2023
Bergmann, S., Moussa, D., Brand, F., Kaup, A., & Rieß, C. (2023). Frequency-Domain Analysis of Traces for the Detection of AI-based Compression . In IEEE (Eds.), 2023 International Workshop on Biometrics and Forensics (IWBF) . Barcelona, ES.
Brand, F., Herglotz, C., & Kaup, A. (2023). On Interpolation of Subjective Rate-Distortion Curves for Video Coder Comparison . In 2023 15th International Conference on Quality of Multimedia Experience (QoMEX) . Ghent, BE: IEEE.
Brand, F., Kopte, A., Fischer, K., & Kaup, A. (2023). Spatially-Adaptive Learning-Based Image Compression with Hierarchical Multi-Scale Latent Spaces . In 2023 IEEE International Conference on Image Processing (ICIP) . Kuala Lumpur, MY: IEEE.
Eichermüller, L., Chaudhari, G., Katsavounidis, I., Lei, Z., Tmar, H., Kaup, A., & Herglotz, C. (2023). Encoder Complexity Control in SVT-AV1 by Speed-Adaptive Preset Switching . In Proceedings of the IEEE International Conference on Image Processing (ICIP) . Kuala Lumpur, MY.
Grosche, S., Regensky, A., Seiler, J., & Kaup, A. (2023). Image Super-Resolution Using T-Tetromino Pixels . In Proceedings of the Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) (pp. 9989-9998).
Herglotz, C., Brand, F., Regensky, A., Rievel, F., & Kaup, A. (2023). Processing Energy Modeling for Neural Network Based Image Compression . In Proceedings of the accepted for IEEE International Conference on Image Processing (ICIP) . Kuala Lumpur, MY.
Herglotz, C., Kränzler, M., Chu, X., Francois, E., He, Y., & Kaup, A. (2023). Extended Signaling Methods for Reduced Video Decoder Power Consumption Using Green Metadata . IEEE Transactions on Circuits and Systems II: Express Briefs .
Herglotz, C., Kränzler, M., Ludwig, R., & Kaup, A. (2023). Video Decoding Energy Reduction Using Temporal-Domain Filtering . In ACM (Eds.), Proceedings of the First International Workshop on Green Multimedia Systems (GMSys '23) on the ACM Multimedia Systems (MMSys) (pp. 22-27). Vancouver, CA.
Herglotz, C., Kränzler, M., Ramasubbu, G., Eichermüller, L., & Kaup, A. (2023). Energy Efficiency in Video Compression . IEEE MMTC Communications - Frontiers , 18 (3), 8-14.
Herglotz, C., Kränzler, M., Schober, R., & Kaup, A. (2023). Sweet Streams are Made of This: The System Engineer’s View on Energy Efficiency in Video Communications (Preprint) . Ieee Circuits and Systems Magazine , 23 (1), 57-77. https://doi.org/10.1109/MCAS.2023.3234739
Herglotz, C., Robitza, W., Raake, A., Hoßfeld, T., & Kaup, A. (2023). Power Reduction Opportunities on End-User Devices in Quality-Steady Video Streaming . In Proceedings of the 15th International Conference on Quality of Multimedia Experience (QoMEX) . Gent, BE.
Herglotz, C., Robitza, W., Raake, A., Hoßfeld, T., & Kaup, A. (2023). Power Reduction Opportunities on End-User Devices in Quality-Steady Video Streaming . In Proceedings of the 15th International Conference on Quality of Multimedia Experience . Gent, BE.
Kränzler, M., Kaup, A., & Herglotz, C. (2023). Estimating Software and Hardware Video Decoder Energy Using Software Decoder Profiling . In Proceedings of the 2023 36th SBC/SBMicro/IEEE/ACM Symposium on Integrated Circuits and Systems Design (SBCCI) . Rio de Janeiro, Brazil, BR.
Meyer, A., Brand, F., & Kaup, A. (2023). Learned Wavelet Video Coding using Motion Compensated Temporal Filtering . IEEE Access . https://doi.org/10.1109/ACCESS.2023.3323873
Meyer, A., & Kaup, A. (2023). A novel Cross-Component Context Model for End-to-End Wavelet Image Coding . In Proceedings of the ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Rhodes Island, Greece.
Nguyen, D.T., & Kaup, A. (2023). Lossless Point Cloud Geometry and Attribute Compression Using a Learned Conditional Probability Model . IEEE Transactions on Circuits and Systems For Video Technology , 1-1. https://doi.org/10.1109/TCSVT.2023.3239321
Nguyen, D.T., Nambiar, K.G., & Kaup, A. (2023). DEEP PROBABILISTIC MODEL FOR LOSSLESS SCALABLE POINT CLOUD ATTRIBUTE COMPRESSION . In International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2023 . Rodos Palace Luxury Convention Resort, Rhodes Island, Greece, GR.
Regensky, A., Heimann, V., Zhang, R., & Kaup, A. (2023). Improving Spherical Image Resampling through Viewport-Adaptivity . In Proceedings of the IEEE International Conference on Image Processing (ICIP) (pp. 1730-1734). Kuala Lumpur, MY.
Regensky, A., Herglotz, C., & Kaup, A. (2023). Motion Plane Adaptive Motion Modeling for Spherical Video Coding in H.266/VVC . In Proceedings of the IEEE International Conference on Image Processing (ICIP) (pp. 875-879). Kuala Lumpur, MY.
Regensky, A., Herglotz, C., & Kaup, A. (2023). Multi-Model Motion Prediction for 360-Degree Video Compression . IEEE Access , 11 , 117004-117017. https://doi.org/10.1109/ACCESS.2023.3326717
Sippel, F., Seiler, J., & Kaup, A. (2023). Cross Spectral Image Reconstruction Using a Deep Guided Neural Network . In Proceedings of the 2023 IEEE International Conference on Image Processing (ICIP) . Kuala Lumpur, MY.
Sippel, F., Seiler, J., & Kaup, A. (2023). Synthetic hyperspectral array video database with applications to cross-spectral reconstruction and hyperspectral video coding . Journal of the Optical Society of America A-Optics Image Science and Vision , 40 (3), 479-491. https://doi.org/10.1364/JOSAA.479552
Uddehal, S.R., Strutz, T., Och, H., & Kaup, A. (2023). Image Segmentation for Improved Lossless Screen Content Compression . In Proceedings of the 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (pp. 5). Rhode Islands, Greece, GR: ieee.org: IEEE.
Ulreich, F., Moser, E., Olbrich, F., Ebert, M., Bierl, R., & Kaup, A. (2023). Luminance Simulation in CARLA under Cloud Coverage - Model Validation and Implications . In 2023 IEEE International Workshop on Metrology for Automotive, MetroAutomotive 2023 - Proceedings (pp. 228-233). Modena, ITA: Institute of Electrical and Electronics Engineers Inc..
Zhao, M., Zhang, X., & Kaup, A. (2023). Multitask Learning for SAR Ship Detection with Gaussian-Mask Joint Segmentation . IEEE Transactions on Geoscience and Remote Sensing , 61 . https://doi.org/10.1109/TGRS.2023.3304847
2022
Brand, F., Fischer, K., Kopte, A., & Kaup, A. (2022). Learning True Rate-Distortion-Optimization for End-To-End Image Compression . In DCC 2022: 2022 DATA COMPRESSION CONFERENCE (DCC) (pp. 443-443). Snowbird, UT, US: NEW YORK: IEEE.
Brand, F., Fischer, K., Kopte, A., Windsheimer, M., & Kaup, A. (2022). RDONet: Rate-Distortion Optimized Learned Image Compression with Variable Depth . In IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops (pp. 1758-1762). New Orleans, LA, USA: IEEE Computer Society.
Brand, F., Fischer, K., Kopte, A., Windsheimer, M., & Kaup, A. (2022). RDONet: Rate-Distortion Optimized Learned Image Compression With Variable Depth . In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops (pp. 1759-1763). New Orleans, US.
Brand, F., Herglotz, C., & Kaup, A. (2022). A Low-Parametric Model for Bit-Rate Estimation of VVC Residual Coding . In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 1860-1864). Online, SG: Institute of Electrical and Electronics Engineers Inc..
Brand, F., Seiler, J., & Kaup, A. (2022). On Benefits and Challenges of Conditional Interframe Video Coding in Light of Information Theory . In 2022 PICTURE CODING SYMPOSIUM (PCS) (pp. 289-293). San Jose, CA, US: NEW YORK: IEEE.
Brand, F., Seiler, J., & Kaup, A. (2022). P-Frame Coding with Generalized Difference: A Novel Conditional Coding Approach . In 2022 IEEE International Conference on Image Processing (ICIP) . Bordeaux, FR: IEEE.
Fischer, K., Brand, F., Herglotz, C., & Kaup, A. (2022). Learning Frequency-Specific Quantization Scaling in VVC for Standard-Compliant Task-Driven Image Coding . In Proceedings of the IEEE International Conference on Image Processing (ICIP) (pp. 1-5). Bordeaux, FR.
Fischer, K., Brand, F., & Kaup, A. (2022). Boosting Neural Image Compression for Machines Using Latent Space Masking . IEEE Transactions on Circuits and Systems For Video Technology . https://doi.org/10.1109/TCSVT.2022.3195322
Fischer, K., Hofbauer, M., Kuhn, C., Steinbach, E., & Kaup, A. (2022). Evaluation of Video Coding for Machines Without Ground Truth . In Proceedings of the 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Singapore, SG.
Grosche, S., Regensky, A., Sinn, A., Seiler, J., & Kaup, A. (2022). Fast Reconstruction of Three-Quarter Sampling Measurements Using Recurrent Local Joint Sparse Deconvolution and Extrapolation . IEEE Transactions on Circuits and Systems II: Express Briefs , 69 (5), 2398-2402. https://doi.org/10.1109/TCSII.2022.3160012
Gruber, M., Brand, F., Mosebach, A., Seiler, J., & Kaup, A. (2022). Domain Adaptation for Unknown Image Distortions in Instance Segmentation . In Proceedings of the IEEE International Conference on Image Processing (ICIP) . Bordeaux, FR.
Heimann, V., Spruck, A., & Kaup, A. (2022). Frequency-Selective Geometry Upsampling of Point Clouds . In Proceedings of the IEEE International Conference on Image Processing (ICIP) 2022 . Bordeaux, FR.
Heimann, V., Spruck, A., & Kaup, A. (2022). Jointly Resampling and Reconstructing Corrupted Images for Image Classification using Frequency-Selective Mesh-to-Grid Resampling . In 2022 IEEE 24TH INTERNATIONAL WORKSHOP ON MULTIMEDIA SIGNAL PROCESSING (MMSP) . NEW YORK: IEEE.
Heimann, V., Spruck, A., & Kaup, A. (2022). Resampling and Reconstructing Corrupted Images for Image Classification . In Proceedings of the IEEE International Workshop on Multimedia Signal Processing . Shanghai (virtually), CN.
Herglotz, C., Genser, N., & Kaup, A. (2022). Rate-Distortion Optimal Transform Coefficient Selection for Unoccupied Regions in Video-Based Point Cloud Compression . IEEE Transactions on Circuits and Systems For Video Technology , 1-1. https://doi.org/10.1109/TCSVT.2022.3185026
Herglotz, C., Kränzler, M., Mons, R., & Kaup, A. (2022). Beyond Bjontegaard: Limits of Video Compression Performance Comparisons . In Proceedings of the IEEE International Conference on Image Processing . Bordeaux, FR.
Herglotz, C., Robitza, W., Kränzler, M., Kaup, A., & Raake, A. (2022). Modeling of Energy Consumption and Streaming Video QoE using a Crowdsourcing Dataset . In Proceedings of the The 14th International Conference on Quality of Multimedia Experience (QoMEX) . Lippstadt, DE.
Jia, P., Koyuncu, A.B., Gaikov, G., Karabutov, A., Alshina, E., & Kaup, A. (2022). LEARNING-BASED CONDITIONAL IMAGE CODER USING COLOR SEPARATION . In 2022 PICTURE CODING SYMPOSIUM (PCS) (pp. 49-53). San Jose, CA: NEW YORK: IEEE.
Koyuncu, E., Solovyev, T., Alshina, E., & Kaup, A. (2022). Device Interoperability for Learned Image Compression with Weights and Activations Quantization . In 2022 PICTURE CODING SYMPOSIUM (PCS) (pp. 151-155). San Jose, CA: NEW YORK: IEEE.
Kränzler, M., Herglotz, C., & Kaup, A. (2022). Advanced Design Space Exploration for Joint Energy and Quality Optimization for VVC . In Proceedings of the Picture Coding Symposium (PCS) . San Jose, California, US.
Kränzler, M., Herglotz, C., & Kaup, A. (2022). Energy Efficient Video Decoding for VVC Using a Greedy Strategy Based Design Space Exploration . IEEE Transactions on Circuits and Systems For Video Technology , 32 (7), 4696-4709. https://doi.org/10.1109/TCSVT.2021.3130739
Kränzler, M., Wieckowski, A., Ramasubbu, G., Bross, B., Kaup, A., Marpe, D., & Herglotz, C. (2022). Optimized Decoding-Energy-Aware Encoding In Practical VVC Implementations . In Proceedings of the 29th IEEE International Conference on Image Processing (IEEE ICIP) . Bordeaux, FR.
Nguyen, D.T., & Kaup, A. (2022). Learning-based Lossless Point Cloud Geometry Coding using Sparse Tensors . In IEEE International Conference on Image Processing
ICIP 2022 . Bordeaux, France, FR.
Ramasubbu, G., Kaup, A., & Herglotz, C. (2022). A Bit Stream Feature-Based Energy Estimator for HEVC Software Encoding . In Proceedings of the Picture Coding Symposium (PCS 2022) . San Jose, California.
Ramasubbu, G., Kaup, A., & Herglotz, C. (2022). Modeling the HEVC Encoding Energy Using the Encoder Processing Time . In Proceedings of the IEEE International Conference on Image Processing (ICIP) 2022 . Bordeaux.
Sippel, F., Seiler, J., & Kaup, A. (2022). Optimal Filter Selection for Multispectral Object Classification Using Fast Binary Search . In Proceedings of the 24th International Workshop on Multimedia Signal Processing . Shanghai, CN.
Spruck, A., Heimann, V., & Kaup, A. (2022). Increasing the Accuracy of a Neural Network Using Frequency Selective Mesh-to-Grid Resampling . In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS) .
2021
Brand, F., Fischer, K., & Kaup, A. (2021). Rate-Distortion Optimized Learning-Based Image Compression using an Adaptive Hierachical Autoencoder with Conditional Hyperprior . In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW) (pp. 1-5). Virtual, US.
Brand, F., Seiler, J., & Kaup, A. (2021). Intra To Inter: Towards Intra Prediction for Learning-Based Video Coders Using Optical Flow . In Proc. 2021 IEEE International Conference on Image Processing (ICIP) (pp. 2119-2123). Anchorage, AK, USA, US.
Brand, F., Seiler, J., & Kaup, A. (2021). Switchable Motion Models for Non-Block-Based Inter Prediction in Learning-Based Video Coding . In Proceedings of the Picture Coding Symposium (PCS) (pp. 1-5). Bristol (Virtual).
Fischer, K., Blum, C., Herglotz, C., & Kaup, A. (2021). Robust Deep Neural Object Detection and Segmentation for Automotive Driving Scenario with Compressed Image Data . In Proceedings of the IEEE International Symposium on Circuits and Systems (ISCAS) . Daegu (Virtual Conference), KR.
Fischer, K., Fleckenstein, F., Herglotz, C., & Kaup, A. (2021). Saliency-Driven Versatile Video Coding for Neural Object Detection . In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Toronto (Virtual Conference), AE.
Fischer, K., Forsch, C., Herglotz, C., & Kaup, A. (2021). Analysis of Neural Image Compression Networks for Machine-to-Machine Communication . In Proceedings of the IEEE International Conference on Image Processing (ICIP) . Anchorage (virtual), US.
Grosche, S., Brand, F., & Kaup, A. (2021). A Novel End-To-End Network for Reconstruction of Non-Regularly Sampled Image Data Using Locally Fully Connected Layers . In Proceedings of the 23rd International Workshop on Multimedia Signal Processing (MMSP) . Tampere, Finland.
Grosche, S., Seiler, J., & Kaup, A. (2021). Novel Consistency Check for Fast Recursive Reconstruction of Non-Regularly Sampled Video Data . In Proceedings of the IEEE International Conference on Image Processing (ICIP) . Anchorage.
Heimann, V., Spruck, A., & Kaup, A. (2021). Frame Rate Up-Conversion Using Key Point Agnostic Frequency-Selective Mesh-to-Grid Resampling . In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing . Toronto (Virtual Conference), CA.
Heimann, V., Spruck, A., & Kaup, A. (2021). Frequency-Selective Mesh-to-Mesh Resampling for Color Upsampling of Point Clouds . In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP) . Tampere, FI.
Heindel, A., Prestele, B., Gehlert, A., & Kaup, A. (2021). Enhancement Layer Coding for Chroma Sub-Sampled Screen Content Video . IEEE Transactions on Circuits and Systems For Video Technology . https://doi.org/10.1109/TCSVT.2021.3061944
Herglotz, C., Grosche, S., Bharadwaj, A., & Kaup, A. (2021). Component-Wise Power Estimation of Electrical Devices Using Thermal Imaging . IEEE Transactions on Consumer Electronics , 67 (4), 383-392. https://doi.org/10.1109/TCE.2021.3122076
Körner, G., Hoffmann, M., Stief, P., Zhang, M., Rückert, R., Herglotz, C.,... Vossiek, M. (2021). Applicability and Performance of Standard Compression Methods for Efficient Data Transmission and Storage in Radar Networks . IEEE Journal of Microwaves , 2 (1), 78-96. https://doi.org/10.1109/JMW.2021.3119781
Och, H., Strutz, T., & Kaup, A. (2021). Optimization of Probability Distributions for Residual Coding of Screen Content . In Proceedings of the 2021 IEEE International Conference on Visual Communications and Image Processing (VCIP) . München, DE.
Regensky, A., Herglotz, C., & Kaup, A. (2021). A Novel Viewport-Adaptive Motion Compensation Technique for Fisheye Video . In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP) . Toronto, CA.
Sippel, F., Seiler, J., & Kaup, A. (2021). Hyperspectral Image Reconstruction from Multispectral Images Using Non-Local Filtering . In Proceedings of the 23rd International Workshop on Multimedia Signal Processing . Tampere, FI.
Sippel, F., Seiler, J., & Kaup, A. (2021). Spatio-spectral Image Reconstruction Using Non-local Filtering . In Proceedings of the 2021 IEEE International Conference on Visual Communications and Image Processing (VCIP) . München, DE.
Spruck, A., Hawesch, M., Maier, A., Rieß, C., Seiler, J., & Kaup, A. (2021). 3D Rendering Framework for Data Augmentation in Optical Character Recognition . In ISSCS 2021 - International Symposium on Signals, Circuits and Systems . Iasi, Romania (virtual), RO: Institute of Electrical and Electronics Engineers Inc..
2020
Brand, F., Seiler, J., Alshina, E., & Kaup, A. (2020). A Triangulation-Based Backward Adaptive Motion Field Subsampling Scheme . In Proceedings of the IEEE 22nd Workshop on Multimedia Signal Processing (MMSP) . Tampere (Virtual Conference).
Brand, F., Seiler, J., & Kaup, A. (2020). Intra-Frame Coding Using a Conditional Autoencoder . IEEE Journal of Selected Topics in Signal Processing , 15 (2), 354 - 365. https://doi.org/10.1109/JSTSP.2020.3034768
Brand, F., Seiler, J., & Kaup, A. (2020). Introducing Latent Space Correlation to Conditional Autoencoders for Intra Prediction . In Proceedings of the 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP) . Macau (Virtual Conference), CN.
Fischer, K., Brand, F., Herglotz, C., & Kaup, A. (2020). Video Coding for Machines with Feature-Based Rate-Distortion Optimization . In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP) . Tampere (Virtual Conference), FI.
Fischer, K., Herglotz, C., & Kaup, A. (2020). On Intra Video Coding and In-loop Filtering for Neural Object Detection Networks . In Proceedings of the IEEE International Conference on Image Processing (ICIP) (pp. 1147-1151). Abu Dhabi (virtual Conference), AE.
Fischer, K., Herglotz, C., & Kaup, A. (2020). On Versatile Video Coding at UHD with Machine-Learning-Based Super-Resolution . In 12th International Conference on Quality of Multimedia Experience (QoMEX) . Athlone, IE.
Genser, N., Seiler, J., & Kaup, A. (2020). Camera Array for Multi-Spectral Imaging . IEEE Transactions on Image Processing , 29 , 9234-9249. https://doi.org/10.1109/TIP.2020.3024738
Genser, N., Seiler, J., & Kaup, A. (2020). Joint Content-Adaptive Dictionary Learning And Sparse Selective Extrapolation For Cross-Spectral Image Reconstruction . In Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP) . Abu Dhabi, AE.
Genser, N., Spruck, A., Seiler, J., & Kaup, A. (2020). Deep Learning Based Cross-Spectral Disparity Estimation For Stereo Imaging . In Proceedings of the 2020 IEEE International Conference on Image Processing (ICIP) . Abu Dhabi, AE.
Grosche, S., Fischer, K., Brand, F., Seiler, J., & Kaup, A. (2020). Enhanced Image Reconstruction From Quarter Sampling Measurements Using an Adapted Very Deep Super Resolution Network . In Proceedings of the IEEE International Conference on Image Processing (ICIP) . Abu Dhabi (Virtual Conference).
Grosche, S., Koller, M., Seiler, J., & Kaup, A. (2020). Dynamic Image Sampling Using a Novel Variance Based Probability Mass Function . IEEE Transactions on Computational Imaging , 6 , 1440-1450. https://doi.org/10.1109/TCI.2020.3031077
Grosche, S., Regensky, A., Seiler, J., & Kaup, A. (2020). Boosting Compressed Sensing Using Local Measurements and Sliding Window Reconstruction . IEEE Transactions on Image Processing , 29 , 7931 - 7944. https://doi.org/10.1109/TIP.2020.3007822
Heimann, V., Genser, N., & Kaup, A. (2020). Key Point Agnostic Frequency-Selective Mesh-to-Grid Image Resampling using Spectral Weighting . In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP) . Tampere (Virtual Conference), FI.
Herglotz, C., Bader, M., Fischer, K., & Kaup, A. (2020). Decoding Energy Optimal Video Encoding for x265 . In Proceedings of the IEEE 22nd Workshop on Multimedia Signal Processing (MMSP) . Tampere, FI.
Herglotz, C., Coulombe, S., Vazquez, C., Vakili, A., Kaup, A., & Grenier, J.-C. (2020). Power Modeling for Video Streaming Applications on Mobile Devices . IEEE Access . https://doi.org/10.1109/ACCESS.2020.2986580
Herglotz, C., Ramasubbu, G., & Kaup, A. (2020). Matched Quality Evaluation of Temporally Downsampled Videos with Non-Integer Factors . In Proceedings of the International Conference on Quality of Multimedia Experience (QoMEX) . Athlone, IE.
Kränzler, M., Herglotz, C., & Kaup, A. (2020). A Comparative Analysis of the Time and Energy Demand of Versatile Video Coding and High Efficiency Video Coding Reference Decoders . In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP) . Tampere, Finland, FI.
Kränzler, M., Herglotz, C., & Kaup, A. (2020). Decoding Energy Modeling for Versatile Video Coding . In Proceedings of the IEEE International Conference on Image Processing (ICIP) . Abu Dhabi, AE.
Kränzler, M., Herglotz, C., & Kaup, A. (2020). DENESTO: A Tool for Video Decoding Energy Estimation and Visualization . In Proceedings of the 2020 IEEE International Conference on Visual Communications and Image Processing (VCIP) . Virtual Conference.
Lanz, D., & Kaup, A. (2020). Graph-Based Compensated Wavelet Lifting for Scalable Lossless Coding of Dynamic Medical Data . IEEE Transactions on Image Processing , 29 (1), 2439 - 2451. https://doi.org/10.1109/TIP.2019.2947138
Meyer, A., Genser, N., & Kaup, A. (2020). Multispectral Image Compression Based on HEVC Using Pel-Recursive Inter-Band Prediction . In Proceedings of the IEEE 22nd International Workshop on Multimedia Signal Processing (MMSP) . Tampere, FI.
Pöllot, M., Zhang, R., & Kaup, A. (2020). An Efficient Alternative to Network Pruning Through Ensemble Learning . In IEEE (Eds.), Proceedings of the International Conference on Acoustics, Speech and Signal Processing (pp. 4027-4031). Barcelona, ES.
Regensky, A., Grosche, S., Seiler, J., & Kaup, A. (2020). Real-Time Frequency Selective Reconstruction through Register-Based Argmax Calculation . In Proceedings of the IEEE International Workshop on Multimedia Signal Processing (MMSP) (pp. 1 - 6). Tampere, FI.
Regensky, A., Herglotz, C., & Kaup, A. (2020). FishUI: Interactive Fisheye Distortion Visualization . In Proceedings of the IEEE International Conference on Visual Communications and Image Processing (VCIP) (pp. 256). Macau, CN.
Sippel, F., Seiler, J., Genser, N., & Kaup, A. (2020). Structure-preserving spectral reflectance estimation using guided filtering . Journal of the Optical Society of America A-Optics Image Science and Vision , 37 (11), 1695-1710. https://doi.org/10.1364/JOSAA.400485
Spruck, A., Seiler, J., Roll, M., Dudziak, T., Eckstein, J., & Kaup, A. (2020). Quality Assurance of Weld Seams Using Laser Triangulation Imaging and Deep Neural Networks . In 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT . Rome (Virtual Conference), Italy.
Wokusch, D., & Kaup, A. (2020). Optimizing Rate-Distortion Performance of Motion Compensated Wavelet Lifting with Denoised Prediction and Update . In Proceedings of the IEEE Int. Workshop on Multimedia Signal Processing (MMSP) . Tampere.
Related Research Fields
Contact:
Our research focuses on video signal processing and transmission. We develop intelligent video analytics, work on efficient compression methods for image and video signals, and improve the energy efficiency of video communication systems. Moreover, we develop advanced image sensing systems such as camera arrays, non-regular sampling sensors, and multispectral imaging.
Research projects
Learning Predictive Maintenance of Fleets of Networked Systems
(Third Party Funds Single)
Funding source: Bayerische Forschungsstiftung
The project aims at advancing predictive maintenance for networked device fleets using learning approaches and integrating expert knowledge. To this end, we will combine machine learning with physical models and analyze data flows between systems as well as integrate expertise on system behavior and failure modes. The resulting predictive maintenance approach for networked systems will be transferred to various classes of systems. Besides investigating industrial applications, we will create a fleet of mobile robots to demonstrate the capabilities of the predictive maintenance approach and make it available to academia, industry, and beyond.
Codierung von multimodalen Körperhüllendaten
(Third Party Funds Group – Sub project)
Term: 1. July 2020 - 30. June 2025
Funding source: DFG / Sonderforschungsbereich (SFB)
URL: https://www.empkins.de/
Ziel des Teilprojekts ist es, ein Quellencodierungsverfahren für multimodale Körperhüllendaten zu entwickeln, welches eine effiziente Übertragung der menschlichen Körperhülle einschließlich ihrer Bewegung ermöglicht. Für die Codierung sollen die räumliche Korrelation der Tiefensignale, die zeitliche Kohärenz der menschlichen Bewegung und die Verbundabhängigkeiten zwischen Mikrodoppler-Apertursynthese-Radardaten und Tiefensignalen genutzt werden. Abhängig von der Rekonstruktionsgenauigkeit der biomechanischen und psychomotorischen Anwendungen im SFB wird eine Reduktion des Datenvolumens um mindestens zwei Größenordnungen erwartet.
2025
2024
2023
2022
2021
2020
Related Research Fields
Contact: