title: Scalable Probabilistic Forecasting in Retail with Gradient Boosted Trees: A Practitioner's Approach

abstract: The recent M5 competition has advanced the state-of-the-art in retail forecasting. However, we notice important differences between the competition challenge and the challenges we face in a large e-commerce company. The datasets in our scenario are larger (hundreds of thousands of time series), and e-commerce can afford to have a larger assortment than brick-and-mortar retailers, leading to more intermittent data. To scale to larger dataset sizes with feasible computational effort, firstly, we investigate a two-layer hierarchy and propose a top-down approach to forecasting at an aggregated level with less amount of series and intermittency, and then disaggregating to obtain the decision-level forecasts. Probabilistic forecasts are generated under distributional assumptions. Secondly, direct training at the lower level with subsamples can also be an alternative way of scaling. Performance of modelling with subsets is evaluated with the main dataset. Apart from a proprietary dataset, the proposed scalable methods are evaluated using the Favorita dataset and the M5 dataset. We are able to show the differences in characteristics of the e-commerce and brick-and-mortar retail datasets. Notably, our top-down forecasting framework enters the top 50 of the original M5 competition, even with models trained at a higher level under a much simpler setting.


title: LaughTalk: Expressive 3D Talking Head Generation with Laughter

abstract: Laughter is a unique expression, essential to affirmative social interactions of humans. Although current 3D talking head generation methods produce convincing verbal articulations, they often fail to capture the vitality and subtleties of laughter and smiles despite their importance in social context. In this paper, we introduce a novel task to generate 3D talking heads capable of both articulate speech and authentic laughter. Our newly curated dataset comprises 2D laughing videos paired with pseudo-annotated and human-validated 3D FLAME parameters and vertices. Given our proposed dataset, we present a strong baseline with a two-stage training scheme: the model first learns to talk and then acquires the ability to express laughter. Extensive experiments demonstrate that our method performs favorably compared to existing approaches in both talking head generation and expressing laughter signals. We further explore potential applications on top of our proposed method for rigging realistic avatars.


title: A Chronological Survey of Theoretical Advancements in Generative Adversarial Networks for Computer Vision

abstract: Generative Adversarial Networks (GANs) have been workhorse generative models for last many years, especially in the research field of computer vision. Accordingly, there have been many significant advancements in the theory and application of GAN models, which are notoriously hard to train, but produce good results if trained well. There have been many a surveys on GANs, organizing the vast GAN literature from various focus and perspectives. However, none of the surveys brings out the important chronological aspect: how the multiple challenges of employing GAN models were solved one-by-one over time, across multiple landmark research works. This survey intends to bridge that gap and present some of the landmark research works on the theory and application of GANs, in chronological order.


title: VCISR: Blind Single Image Super-Resolution with Video Compression Synthetic Data

abstract: In the blind single image super-resolution (SISR) task, existing works have been successful in restoring image-level unknown degradations. However, when a single video frame becomes the input, these works usually fail to address degradations caused by video compression, such as mosquito noise, ringing, blockiness, and staircase noise. In this work, we for the first time, present a video compression-based degradation model to synthesize low-resolution image data in the blind SISR task. Our proposed image synthesizing method is widely applicable to existing image datasets, so that a single degraded image can contain distortions caused by the lossy video compression algorithms. This overcomes the leak of feature diversity in video data and thus retains the training efficiency. By introducing video coding artifacts to SISR degradation models, neural networks can super-resolve images with the ability to restore video compression degradations, and achieve better results on restoring generic distortions caused by image compression as well. Our proposed approach achieves superior performance in SOTA no-reference Image Quality Assessment, and shows better visual quality on various datasets. In addition, we evaluate the SISR neural network trained with our degradation model on video super-resolution (VSR) datasets. Compared to architectures specifically designed for the VSR purpose, our method exhibits similar or better performance, evidencing that the presented strategy on infusing video-based degradation is generalizable to address more complicated compression artifacts even without temporal cues.


title: Gray matter volume correlates of Comorbid Depression in Autism Spectrum Disorder

abstract: Autism Spectrum Disorder (ASD) involves diverse neurodevelopmental syndromes with significant deficits in communication, motor behaviours, emotional and social comprehension. Often, individuals with ASD exhibit comorbid conditions, one of the most prevalent being depression characterized by a persistent change in mood and diminished interest in previously enjoyable activities. Due to communicative challenges and lack of appropriate assessments in individuals with ASD, comorbid depression can often go undiagnosed during routine clinical examinations, which may aggravate their problems. The current literature on comorbid depression in adults with ASD is limited. Therefore, understanding the neural basis of the comorbid psychopathology of depression in ASD is crucial for identifying objective brain-based markers for its timely and effective management. Towards this end, using structural MRI and phenotypic data from the Autism Brain Imaging Data Exchange II (ABIDE II) repository, we specifically examined the pattern of relationship regional grey matter volume (rGMV) has with comorbid depression and autism severity within regions of a priori interest in adults with ASD (n = 44). The severity of comorbid depression correlated negatively with the rGMV of the right thalamus. Additionally, a significant interaction was evident between the severity of comorbid depression and core ASD symptoms towards explaining the rGMV in the left cerebellum crus II. The whole-brain regional rGMV differences between ASD and typically developed (TD, n = 39) adults remained inconclusive. The results further the understanding of the neurobiological underpinnings of comorbid depression in adults with ASD and are relevant in exploring structural neuroimaging-based biomarkers in the same cohort.


title: Replicable Benchmarking of Neural Machine Translation (NMT) on Low-Resource Local Languages in Indonesia

abstract: Neural machine translation (NMT) for low-resource local languages in Indonesia faces significant challenges, including the need for a representative benchmark and limited data availability. This work addresses these challenges by comprehensively analyzing training NMT systems for four low-resource local languages in Indonesia: Javanese, Sundanese, Minangkabau, and Balinese. Our study encompasses various training approaches, paradigms, data sizes, and a preliminary study into using large language models for synthetic low-resource languages parallel data generation. We reveal specific trends and insights into practical strategies for low-resource language translation. Our research demonstrates that despite limited computational resources and textual data, several of our NMT systems achieve competitive performances, rivaling the translation quality of zero-shot gpt-3.5-turbo. These findings significantly advance NMT for low-resource languages, offering valuable guidance for researchers in similar contexts.


title: Isomorphism of Multiprojective Bundles and Projective Towers

abstract: We study when two projective bundles over two arbitrary smooth projective varieties of different dimensions can be isomorphic. We show that two multi-projective bundles (fibre product of projective bundles) over different projective spaces cannot be isomorphic, except in the trivial case. We also give necessary and sufficient conditions for the top varieties of two height 3 towers of projective bundles being isomorphic, under certain assumptions.


title: Optimal enhanced dissipation for contact Anosov flows

abstract: We show that for a contact Anosov flow on a compact manifold $ M $, the solutions to $ \partial_t u + X u = \nu \Delta u $, $ \nu > 0 $, where $ X $ is the generator of the flow and $ \Delta $, a (negative) Laplacian for some Riemannian metric on $ M $, satisfy \[ \| u ( t ) - \underline u \|_{L^2 ( M) } \leq C \nu^{-K} e^{ - \beta t } \| u( 0 ) \|_{L^2 ( M) }, \] where $ \underline u $ is the (conserved) average of $ u (0) $ with respect to the contact volume form, and $K$, $\beta$ are fixed positive constants. Since our class of flows includes geodesic flows on manifolds of negative curvature, this provides many examples of very precise optimal enhanced dissipation in the sense of [arXiv:1911.01561] and [arXiv:2304.05374]. The proof is based on results about stochastic stability of Pollicott--Ruelle resonances [arXiv:1407.8531].


title: Fully Quantized Always-on Face Detector Considering Mobile Image Sensors

abstract: Despite significant research on lightweight deep neural networks (DNNs) designed for edge devices, the current face detectors do not fully meet the requirements for "intelligent" CMOS image sensors (iCISs) integrated with embedded DNNs. These sensors are essential in various practical applications, such as energy-efficient mobile phones and surveillance systems with always-on capabilities. One noteworthy limitation is the absence of suitable face detectors for the always-on scenario, a crucial aspect of image sensor-level applications. These detectors must operate directly with sensor RAW data before the image signal processor (ISP) takes over. This gap poses a significant challenge in achieving optimal performance in such scenarios. Further research and development are necessary to bridge this gap and fully leverage the potential of iCIS applications. In this study, we aim to bridge the gap by exploring extremely low-bit lightweight face detectors, focusing on the always-on face detection scenario for mobile image sensor applications. To achieve this, our proposed model utilizes sensor-aware synthetic RAW inputs, simulating always-on face detection processed "before" the ISP chain. Our approach employs ternary (-1, 0, 1) weights for potential implementations in image sensors, resulting in a relatively simple network architecture with shallow layers and extremely low-bitwidth. Our method demonstrates reasonable face detection performance and excellent efficiency in simulation studies, offering promising possibilities for practical always-on face detectors in real-world applications.


title: Robust Data Pruning under Label Noise via Maximizing Re-labeling Accuracy

abstract: Data pruning, which aims to downsize a large training set into a small informative subset, is crucial for reducing the enormous computational costs of modern deep learning. Though large-scale data collections invariably contain annotation noise and numerous robust learning methods have been developed, data pruning for the noise-robust learning scenario has received little attention. With state-of-the-art Re-labeling methods that self-correct erroneous labels while training, it is challenging to identify which subset induces the most accurate re-labeling of erroneous labels in the entire training set. In this paper, we formalize the problem of data pruning with re-labeling. We first show that the likelihood of a training example being correctly re-labeled is proportional to the prediction confidence of its neighborhood in the subset. Therefore, we propose a novel data pruning algorithm, Prune4Rel, that finds a subset maximizing the total neighborhood confidence of all training examples, thereby maximizing the re-labeling accuracy and generalization performance. Extensive experiments on four real and one synthetic noisy datasets show that \algname{} outperforms the baselines with Re-labeling models by up to 9.1% as well as those with a standard model by up to 21.6%.


abstract: Minimum Snap Trajectory Generation and Control for an Under-actuated Flapping Wing Aerial VehicleThis paper presents both the trajectory generation and tracking control strategies for an underactuated flapping wing aerial vehicle (FWAV). First, the FWAV dynamics is analyzed in a practical perspective. Then, based on these analyses, we demonstrate the differential flatness of the FWAV system, and develop a general-purpose trajectory generation strategy. Subsequently, the trajectory tracking controller is developed with the help of robust control and switch control techniques. After that, the overall system asymptotic stability is guaranteed by Lyapunov stability analysis. To make the controller applicable in real flight, we also provide several instructions. Finally, a series of experiment results manifest the successful implementation of the proposed trajectory generation strategy and tracking control strategy. This work firstly achieves the closed-loop integration of trajectory generation and control for real 3-dimensional flight of an underactuated FWAV to a practical level.


title: Sam-Guided Enhanced Fine-Grained Encoding with Mixed Semantic Learning for Medical Image Captioning

abstract: With the development of multimodality and large language models, the deep learning-based technique for medical image captioning holds the potential to offer valuable diagnostic recommendations. However, current generic text and image pre-trained models do not yield satisfactory results when it comes to describing intricate details within medical images. In this paper, we present a novel medical image captioning method guided by the segment anything model (SAM) to enable enhanced encoding with both general and detailed feature extraction. In addition, our approach employs a distinctive pre-training strategy with mixed semantic learning to simultaneously capture both the overall information and finer details within medical images. We demonstrate the effectiveness of this approach, as it outperforms the pre-trained BLIP2 model on various evaluation metrics for generating descriptions of medical images.


title: Proper and Improper Variants of Mathias and Silver Forcing

abstract: In this paper we answer several questions in arXiv:2102.06009 regarding density variants of Mathias and Silver forcing. These questions include whether each of the forcing is proper, add dominating real, or add Cohen real. We also generalize one of the proofs to Mathias forcings parametrized by lower semi-continuous submeasures satisfying certain properties.


title: Enforce and selective operators of combinatorial games

abstract: We consider an {\em enforce operator} on impartial rulesets similar to the Muller Twist and the comply/constrain operator of Smith and St\u anic\u a, 2002. Applied to the rulesets $A$ and $B$, on each turn the opponent enforces one of the rulesets and the current player complies, by playing a move in that ruleset. If the outcome table of the enforce variation of $A$ and $B$ is the same as the outcome table of $A$, then we say that $A$ dominates $B$. We find necessary and sufficient conditions for this relation. Additionally, we define a {\em selective operator} and explore a distributive-lattice-like structure within applicable rulesets. Lastly, we define the nim-value of rulesets under the enforce operator and establish well-known properties for impartial games.


title: Effective Human-AI Teams via Learned Natural Language Rules and Onboarding

abstract: People are relying on AI agents to assist them with various tasks. The human must know when to rely on the agent, collaborate with the agent, or ignore its suggestions. In this work, we propose to learn rules, grounded in data regions and described in natural language, that illustrate how the human should collaborate with the AI. Our novel region discovery algorithm finds local regions in the data as neighborhoods in an embedding space where prior human behavior should be corrected. Each region is then described using a large language model in an iterative and contrastive procedure. We then teach these rules to the human via an onboarding stage. Through user studies on object detection and question-answering tasks, we show that our method can lead to more accurate human-AI teams. We also evaluate our region discovery and description algorithms separately.


title: On Linear Complementary Pairs of Algebraic Geometry Codes over Finite Fields

abstract: Linear complementary dual (LCD) codes and linear complementary pairs (LCP) of codes have been proposed for new applications as countermeasures against side-channel attacks (SCA) and fault injection attacks (FIA) in the context of direct sum masking (DSM). The countermeasure against FIA may lead to a vulnerability for SCA when the whole algorithm needs to be masked (in environments like smart cards). This led to a variant of the LCD and LCP problems, where several results have been obtained intensively for LCD codes, but only partial results have been derived for LCP codes. Given the gap between the thin results and their particular importance, this paper aims to reduce this by further studying the LCP of codes in special code families and, precisely, the characterisation and construction mechanism of LCP codes of algebraic geometry codes over finite fields. Notably, we propose constructing explicit LCP of codes from elliptic curves. Besides, we also study the security parameters of the derived LCP of codes $(\mathcal{C}, \mathcal{D})$ (notably for cyclic codes), which are given by the minimum distances $d(\mathcal{C})$ and $d(\mathcal{D}^\perp)$. Further, we show that for LCP algebraic geometry codes $(\mathcal{C},\mathcal{D})$, the dual code $\mathcal{C}^\perp$ is equivalent to $\mathcal{D}$ under some specific conditions we exhibit. Finally, we investigate whether MDS LCP of algebraic geometry codes exist (MDS codes are among the most important in coding theory due to their theoretical significance and practical interests). Construction schemes for obtaining LCD codes from any algebraic curve were given in 2018 by Mesnager, Tang and Qi in [``Complementary dual algebraic geometry codes", IEEE Trans. Inform Theory, vol. 64(4), 2390--3297, 2018]. To our knowledge, it is the first time LCP of algebraic geometry codes has been studied.


title: Revamping AI Models in Dermatology: Overcoming Critical Challenges for Enhanced Skin Lesion Diagnosis

abstract: The surge in developing deep learning models for diagnosing skin lesions through image analysis is notable, yet their clinical black faces challenges. Current dermatology AI models have limitations: limited number of possible diagnostic outputs, lack of real-world testing on uncommon skin lesions, inability to detect out-of-distribution images, and over-reliance on dermoscopic images. To address these, we present an All-In-One \textbf{H}ierarchical-\textbf{O}ut of Distribution-\textbf{C}linical Triage (HOT) model. For a clinical image, our model generates three outputs: a hierarchical prediction, an alert for out-of-distribution images, and a recommendation for dermoscopy if clinical image alone is insufficient for diagnosis. When the recommendation is pursued, it integrates both clinical and dermoscopic images to deliver final diagnosis. Extensive experiments on a representative cutaneous lesion dataset demonstrate the effectiveness and synergy of each component within our framework. Our versatile model provides valuable decision support for lesion diagnosis and sets a promising precedent for medical AI applications.


title: Fast Shapley Value Estimation: A Unified Approach

abstract: Shapley values have emerged as a widely accepted and trustworthy tool, grounded in theoretical axioms, for addressing challenges posed by black-box models like deep neural networks. However, computing Shapley values encounters exponential complexity as the number of features increases. Various approaches, including ApproSemivalue, KernelSHAP, and FastSHAP, have been explored to expedite the computation. In our analysis of existing approaches, we observe that stochastic estimators can be unified as a linear transformation of randomly summed values from feature subsets. Based on this, we investigate the possibility of designing simple amortized estimators and propose a straightforward and efficient one, SimSHAP, by eliminating redundant techniques. Extensive experiments conducted on tabular and image datasets validate the effectiveness of our SimSHAP, which significantly accelerates the computation of accurate Shapley values.


title: Tensor Trust: Interpretable Prompt Injection Attacks from an Online Game

abstract: While Large Language Models (LLMs) are increasingly being used in real-world applications, they remain vulnerable to prompt injection attacks: malicious third party prompts that subvert the intent of the system designer. To help researchers study this problem, we present a dataset of over 126,000 prompt injection attacks and 46,000 prompt-based "defenses" against prompt injection, all created by players of an online game called Tensor Trust. To the best of our knowledge, this is currently the largest dataset of human-generated adversarial examples for instruction-following LLMs. The attacks in our dataset have a lot of easily interpretable stucture, and shed light on the weaknesses of LLMs. We also use the dataset to create a benchmark for resistance to two types of prompt injection, which we refer to as prompt extraction and prompt hijacking. Our benchmark results show that many models are vulnerable to the attack strategies in the Tensor Trust dataset. Furthermore, we show that some attack strategies from the dataset generalize to deployed LLM-based applications, even though they have a very different set of constraints to the game. We release all data and source code at https://tensortrust.ai/paper


title: COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuances

abstract: We present COPAL-ID, a novel, public Indonesian language common sense reasoning dataset. Unlike the previous Indonesian COPA dataset (XCOPA-ID), COPAL-ID incorporates Indonesian local and cultural nuances, and therefore, provides a more natural portrayal of day-to-day causal reasoning within the Indonesian cultural sphere. Professionally written by natives from scratch, COPAL-ID is more fluent and free from awkward phrases, unlike the translated XCOPA-ID. In addition, we present COPAL-ID in both standard Indonesian and in Jakartan Indonesian-a dialect commonly used in daily conversation. COPAL-ID poses a greater challenge for existing open-sourced and closed state-of-the-art multilingual language models, yet is trivially easy for humans. Our findings suggest that general multilingual models struggle to perform well, achieving 66.91% accuracy on COPAL-ID. South-East Asian-specific models achieve slightly better performance of 73.88% accuracy. Yet, this number still falls short of near-perfect human performance. This shows that these language models are still way behind in comprehending the local nuances of Indonesian.


title: Evaluation Measures of Individual Item Fairness for Recommender Systems: A Critical Study

abstract: Fairness is an emerging and challenging topic in recommender systems. In recent years, various ways of evaluating and therefore improving fairness have emerged. In this study, we examine existing evaluation measures of fairness in recommender systems. Specifically, we focus solely on exposure-based fairness measures of individual items that aim to quantify the disparity in how individual items are recommended to users, separate from item relevance to users. We gather all such measures and we critically analyse their theoretical properties. We identify a series of limitations in each of them, which collectively may render the affected measures hard or impossible to interpret, to compute, or to use for comparing recommendations. We resolve these limitations by redefining or correcting the affected measures, or we argue why certain limitations cannot be resolved. We further perform a comprehensive empirical analysis of both the original and our corrected versions of these fairness measures, using real-world and synthetic datasets. Our analysis provides novel insights into the relationship between measures based on different fairness concepts, and different levels of measure sensitivity and strictness. We conclude with practical suggestions of which fairness measures should be used and when. Our code is publicly available. To our knowledge, this is the first critical comparison of individual item fairness measures in recommender systems.


title: Aspects of entanglement with background electric and magnetic fields in quantum field theoretic systems

abstract: This thesis investigates the impact of the background magnetic field on correlations or entanglement between pairs created by the background electric field in quantum field theoretic systems in the Minkowski, the primordial inflationary de Sitter and the Rindler spacetimes. These analyses might provide insight into the relativistic entanglement in the early inflationary universe scenario, where such background fields might exist due to primordial fluctuations, and in the near-horizon of non-extremal black holes, which are often endowed with background electromagnetic fields due to the accretion of plasma onto them.


title: Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphs

abstract: Most text-driven human motion generation methods employ sequential modeling approaches, e.g., transformer, to extract sentence-level text representations automatically and implicitly for human motion synthesis. However, these compact text representations may overemphasize the action names at the expense of other important properties and lack fine-grained details to guide the synthesis of subtly distinct motion. In this paper, we propose hierarchical semantic graphs for fine-grained control over motion generation. Specifically, we disentangle motion descriptions into hierarchical semantic graphs including three levels of motions, actions, and specifics. Such global-to-local structures facilitate a comprehensive understanding of motion description and fine-grained control of motion generation. Correspondingly, to leverage the coarse-to-fine topology of hierarchical semantic graphs, we decompose the text-to-motion diffusion process into three semantic levels, which correspond to capturing the overall motion, local actions, and action specifics. Extensive experiments on two benchmark human motion datasets, including HumanML3D and KIT, with superior performances, justify the efficacy of our method. More encouragingly, by modifying the edge weights of hierarchical semantic graphs, our method can continuously refine the generated motion, which may have a far-reaching impact on the community. Code and pre-training weights are available at https://github.com/jpthu17/GraphMotion.


title: Visual Analytics for Efficient Image Exploration and User-Guided Image Captioning

abstract: Recent advancements in pre-trained large-scale language-image models have ushered in a new era of visual comprehension, offering a significant leap forward. These breakthroughs have proven particularly instrumental in addressing long-standing challenges that were previously daunting. Leveraging these innovative techniques, this paper tackles two well-known issues within the realm of visual analytics: (1) the efficient exploration of large-scale image datasets and identification of potential data biases within them; (2) the evaluation of image captions and steering of their generation process. On the one hand, by visually examining the captions automatically generated from language-image models for an image dataset, we gain deeper insights into the semantic underpinnings of the visual contents, unearthing data biases that may be entrenched within the dataset. On the other hand, by depicting the association between visual contents and textual captions, we expose the weaknesses of pre-trained language-image models in their captioning capability and propose an interactive interface to steer caption generation. The two parts have been coalesced into a coordinated visual analytics system, fostering mutual enrichment of visual and textual elements. We validate the effectiveness of the system with domain practitioners through concrete case studies with large-scale image datasets.


title: Copilot4D: Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion

abstract: Learning world models can teach an agent how the world works in an unsupervised manner. Even though it can be viewed as a special case of sequence modeling, progress for scaling world models on robotic applications such as autonomous driving has been somewhat less rapid than scaling language models with Generative Pre-trained Transformers (GPT). We identify two reasons as major bottlenecks: dealing with complex and unstructured observation space, and having a scalable generative model. Consequently, we propose Copilot4D, a novel world modeling approach that first tokenizes sensor observations with VQVAE, then predicts the future via discrete diffusion. To efficiently decode and denoise tokens in parallel, we recast Masked Generative Image Transformer as discrete diffusion and enhance it with a few simple changes, resulting in notable improvement. When applied to learning world models on point cloud observations, Copilot4D reduces prior SOTA Chamfer distance by more than 65% for 1s prediction, and more than 50% for 3s prediction, across NuScenes, KITTI Odometry, and Argoverse2 datasets. Our results demonstrate that discrete diffusion on tokenized agent experience can unlock the power of GPT-like unsupervised learning for robotics.


title: Expanding Expressiveness of Diffusion Models with Limited Data via Self-Distillation based Fine-Tuning

abstract: Training diffusion models on limited datasets poses challenges in terms of limited generation capacity and expressiveness, leading to unsatisfactory results in various downstream tasks utilizing pretrained diffusion models, such as domain translation and text-guided image manipulation. In this paper, we propose Self-Distillation for Fine-Tuning diffusion models (SDFT), a methodology to address these challenges by leveraging diverse features from diffusion models pretrained on large source datasets. SDFT distills more general features (shape, colors, etc.) and less domain-specific features (texture, fine details, etc) from the source model, allowing successful knowledge transfer without disturbing the training process on target datasets. The proposed method is not constrained by the specific architecture of the model and thus can be generally adopted to existing frameworks. Experimental results demonstrate that SDFT enhances the expressiveness of the diffusion model with limited datasets, resulting in improved generation capabilities across various downstream tasks.


title: Superconducting Properties of Topological Semimetal 1$T$-RhSeTe

abstract: Platinum-group transition-metal dichalcogenides have emerged as a subject of considerable interest in condensed matter physics due to their remarkable topological properties and unconventional superconducting behavior. In this study, we report the synthesis and superconducting characteristics of a new Dirac-type topological semimetallic compound 1$T$-RhSeTe. It shows type-II superconductivity with a superconducting transition temperature of 4.72 K and a high upper critical field. The coexistence of superconductivity and topological properties makes it a prime candidate for hosting topological superconductivity.


title: Exploring the Problems, their Causes and Solutions of AI Pair Programming: A Study with Practitioners of GitHub Copilot

abstract: With the recent advancement of Artificial Intelligence (AI) and Large Language Models (LLMs), AI-based code generation tools become a practical solution for software development. GitHub Copilot, the AI pair programmer, utilizes machine learning models trained on a large corpus of code snippets to generate code suggestions using natural language processing. Despite its popularity in software development, there is limited empirical evidence on the actual experiences of practitioners who work with Copilot. To this end, we conducted an empirical study to understand the problems that practitioners face when using Copilot, as well as their underlying causes and potential solutions. We collected data from 476 GitHub issues, 706 GitHub discussions, and 142 Stack Overflow posts. Our results reveal that (1) Operation Issue and Compatibility Issue are the most common problems faced by Copilot users, (2) Copilot Internal Error, Network Connection Error, and Editor/IDE Compatibility Issue are identified as the most frequent causes, and (3) Bug Fixed by Copilot, Modify Configuration/Setting, and Use Suitable Version are the predominant solutions. Based on the results, we discuss the potential areas of Copilot for enhancement, and provide the implications for the Copilot users, the Copilot team, and researchers.


title: ABC-based Forecasting in State Space Models

abstract: Approximate Bayesian Computation (ABC) has gained popularity as a method for conducting inference and forecasting in complex models, most notably those which are intractable in some sense. In this paper we use ABC to produce probabilistic forecasts in state space models (SSMs). Whilst ABC-based forecasting in correctly-specified SSMs has been studied, the misspecified case has not been investigated, and it is that case which we emphasize. We invoke recent principles of 'focused' Bayesian prediction, whereby Bayesian updates are driven by a scoring rule that rewards predictive accuracy; the aim being to produce predictives that perform well in that rule, despite misspecification. Two methods are investigated for producing the focused predictions. In a simulation setting, 'coherent' predictions are in evidence for both methods: the predictive constructed via the use of a particular scoring rule predicts best according to that rule. Importantly, both focused methods typically produce more accurate forecasts than an exact, but misspecified, predictive. An empirical application to a truly intractable SSM completes the paper.


title: NeuroWrite: Predictive Handwritten Digit Classification using Deep Neural Networks

abstract: The rapid evolution of deep neural networks has revolutionized the field of machine learning, enabling remarkable advancements in various domains. In this article, we introduce NeuroWrite, a unique method for predicting the categorization of handwritten digits using deep neural networks. Our model exhibits outstanding accuracy in identifying and categorising handwritten digits by utilising the strength of convolutional neural networks (CNNs) and recurrent neural networks (RNNs).In this article, we give a thorough examination of the data preparation methods, network design, and training methods used in NeuroWrite. By implementing state-of-the-art techniques, we showcase how NeuroWrite can achieve high classification accuracy and robust generalization on handwritten digit datasets, such as MNIST. Furthermore, we explore the model's potential for real-world applications, including digit recognition in digitized documents, signature verification, and automated postal code recognition. NeuroWrite is a useful tool for computer vision and pattern recognition because of its performance and adaptability.The architecture, training procedure, and evaluation metrics of NeuroWrite are covered in detail in this study, illustrating how it can improve a number of applications that call for handwritten digit classification. The outcomes show that NeuroWrite is a promising method for raising the bar for deep neural network-based handwritten digit recognition.


title: Augmentation is AUtO-Net: Augmentation-Driven Contrastive Multiview Learning for Medical Image Segmentation

abstract: The utilisation of deep learning segmentation algorithms that learn complex organs and tissue patterns and extract essential regions of interest from the noisy background to improve the visual ability for medical image diagnosis has achieved impressive results in Medical Image Computing (MIC). This thesis focuses on retinal blood vessel segmentation tasks, providing an extensive literature review of deep learning-based medical image segmentation approaches while comparing the methodologies and empirical performances. The work also examines the limitations of current state-of-the-art methods by pointing out the two significant existing limitations: data size constraints and the dependency on high computational resources. To address such problems, this work proposes a novel efficient, simple multiview learning framework that contrastively learns invariant vessel feature representation by comparing with multiple augmented views by various transformations to overcome data shortage and improve generalisation ability. Moreover, the hybrid network architecture integrates the attention mechanism into a Convolutional Neural Network to further capture complex continuous curvilinear vessel structures. The result demonstrates the proposed method validated on the CHASE-DB1 dataset, attaining the highest F1 score of 83.46% and the highest Intersection over Union (IOU) score of 71.62% with UNet structure, surpassing existing benchmark UNet-based methods by 1.95% and 2.8%, respectively. The combination of the metrics indicates the model detects the vessel object accurately with a highly coincidental location with the ground truth. Moreover, the proposed approach could be trained within 30 minutes by consuming less than 3 GB GPU RAM, and such characteristics support the efficient implementation for real-world applications and deployments.


title: Distance-Based Propagation for Efficient Knowledge Graph Reasoning

abstract: Knowledge graph completion (KGC) aims to predict unseen edges in knowledge graphs (KGs), resulting in the discovery of new facts. A new class of methods have been proposed to tackle this problem by aggregating path information. These methods have shown tremendous ability in the task of KGC. However they are plagued by efficiency issues. Though there are a few recent attempts to address this through learnable path pruning, they often sacrifice the performance to gain efficiency. In this work, we identify two intrinsic limitations of these methods that affect the efficiency and representation quality. To address the limitations, we introduce a new method, TAGNet, which is able to efficiently propagate information. This is achieved by only aggregating paths in a fixed window for each source-target pair. We demonstrate that the complexity of TAGNet is independent of the number of layers. Extensive experiments demonstrate that TAGNet can cut down on the number of propagated messages by as much as 90% while achieving competitive performance on multiple KG datasets. The code is available at https://github.com/HarryShomer/TAGNet.


title: Integrating Language-Derived Appearance Elements with Visual Cues in Pedestrian Detection

abstract: Large language models (LLMs) have shown their capabilities in understanding contextual and semantic information regarding knowledge of instance appearances. In this paper, we introduce a novel approach to utilize the strengths of LLMs in understanding contextual appearance variations and to leverage this knowledge into a vision model (here, pedestrian detection). While pedestrian detection is considered one of the crucial tasks directly related to our safety (e.g., intelligent driving systems), it is challenging because of varying appearances and poses in diverse scenes. Therefore, we propose to formulate language-derived appearance elements and incorporate them with visual cues in pedestrian detection. To this end, we establish a description corpus that includes numerous narratives describing various appearances of pedestrians and other instances. By feeding them through an LLM, we extract appearance knowledge sets that contain the representations of appearance variations. Subsequently, we perform a task-prompting process to obtain appearance elements which are guided representative appearance knowledge relevant to a downstream pedestrian detection task. The obtained knowledge elements are adaptable to various detection frameworks, so that we can provide plentiful appearance information by integrating the language-derived appearance elements with visual cues within a detector. Through comprehensive experiments with various pedestrian detectors, we verify the adaptability and effectiveness of our method showing noticeable performance gains and achieving state-of-the-art detection performance on two public pedestrian detection benchmarks (i.e., CrowdHuman and WiderPedestrian).


title: A Constant Factor Approximation for Directed Feedback Vertex Set in Graphs of Bounded Genus

abstract: The minimum directed feedback vertex set problem consists in finding the minimum set of vertices that should be removed in order to make a directed graph acyclic. This is a well-known NP-hard optimization problem with applications in various fields, such as VLSI chip design, bioinformatics and transaction processing deadlock prevention and node-weighted network design. We show a constant factor approximation for the directed feedback vertex set problem in graphs of bounded genus.


title: Optimal $L^2$-growth of the generalized Rosenau equation

abstract: We report that the quantity measured in the $L^2$ norm of the solution itself of the generalized Rosenau equation, which was completely unknown in this equation, grows in the proper order at time infinity. It is also immediately apparent that this growth aspect does not occur in three or more spatial dimensions, so we will apply the results obtained in this study to provide another proof that Hardy-type inequalities do not hold in the case of one or two spatial dimensions.


title: Nonnegative/Binary Matrix Factorization for Image Classification using Quantum Annealing

abstract: Classical computing has borne witness to the development of machine learning. The integration of quantum technology into this mix will lead to unimaginable benefits and be regarded as a giant leap forward in mankind's ability to compute. Demonstrating the benefits of this integration now becomes essential. With the advance of quantum computing, several machine-learning techniques have been proposed that use quantum annealing. In this study, we implement a matrix factorization method using quantum annealing for image classification and compare the performance with traditional machine-learning methods. Nonnegative/binary matrix factorization (NBMF) was originally introduced as a generative model, and we propose a multiclass classification model as an application. We extract the features of handwritten digit images using NBMF and apply them to solve the classification problem. Our findings show that when the amount of data, features, and epochs is small, the accuracy of models trained by NBMF is superior to classical machine-learning methods, such as neural networks. Moreover, we found that training models using a quantum annealing solver significantly reduces computation time. Under certain conditions, there is a benefit to using quantum annealing technology with machine learning.


title: Probing interlayer interactions and commensurate-incommensurate transition in twisted bilayer graphene through Raman spectroscopy

abstract: Twisted 2D layered materials have garnered a lot of attention recently as a class of 2D materials whose interlayer interactions and electronic properties are dictated by the relative rotation / twist angle between the adjacent layers. In this work, we explore a prototype of such a twisted 2D system, artificially stacked twisted bilayer graphene (TBLG), where we probe the changes in the interlayer interactions and electron-phonon scattering pathways as the twist angle is varied from 0{\deg} to 30{\deg}, using Raman spectroscopy. The long range Moir\'e potential of the superlattice gives rise to additional intravalley and intervalley scattering of the electrons in TBLG which have been investigated through their Raman signatures. The density functional theory (DFT) calculations of the electronic band structure of the TBLG superlattices was found to be in agreement with the resonant Raman excitations across the van Hove singularities in the valence and conduction bands predicted for TBLG due to hybridization of bands from the two layers. We also observe that the relative rotation between the graphene layers has a marked influence on the second order overtone and combination Raman modes signalling a commensurate-incommensurate transition in TBLG as the twist angle increases. This serves as a convenient and rapid characterization tool to determine the degree of commensurability in TBLG systems.


title: Joint Learning of Local and Global Features for Aspect-based Sentiment Classification

abstract: Aspect-based sentiment classification (ASC) aims to judge the sentiment polarity conveyed by the given aspect term in a sentence. The sentiment polarity is not only determined by the local context but also related to the words far away from the given aspect term. Most recent efforts related to the attention-based models can not sufficiently distinguish which words they should pay more attention to in some cases. Meanwhile, graph-based models are coming into ASC to encode syntactic dependency tree information. But these models do not fully leverage syntactic dependency trees as they neglect to incorporate dependency relation tag information into representation learning effectively. In this paper, we address these problems by effectively modeling the local and global features. Firstly, we design a local encoder containing: a Gaussian mask layer and a covariance self-attention layer. The Gaussian mask layer tends to adjust the receptive field around aspect terms adaptively to deemphasize the effects of unrelated words and pay more attention to local information. The covariance self-attention layer can distinguish the attention weights of different words more obviously. Furthermore, we propose a dual-level graph attention network as a global encoder by fully employing dependency tag information to capture long-distance information effectively. Our model achieves state-of-the-art performance on both SemEval 2014 and Twitter datasets.


title: Shrinking parallelepiped targets in beta-dynamical systems

abstract: For $ \beta>1 $ let $ T_\beta $ be the $\beta$-transformation on $ [0,1) $. Let $ 1<\beta_1\le \cdots\le \beta_d $ and let $ (P_n) $ be a sequence of parallelepipeds on $ [0,1)^d $. Define \[W_d(P_n)=\{\textbf{x}\in[0,1)^d:(T_{\beta_1}\times\cdots \times T_{\beta_d})^n(\textbf{x})\in P_n\text{ infinitely often}\}.\] The `rectangle to rectangle' mass transference principle is usually used to obtain the lower bound of the Hausdorff dimension of $ W_d(P_n) $ when each $ P_n $ is a hyperrectangle with sides parallel to the axes. However, this principle no longer applies even if $ P_n $ is still a hyperrectangle but with rotation. Under some mild conditions on the sidelengths of each $ P_n $, we determine the Hausdorff dimension of $ W_d(P_n) $ and prove that $ W_d(P_n) $ has large intersection properties. If $ d=2 $, then the aforementioned condition can be removed. To further illustrate, we provide several examples that demonstrate how the rotations of rectangles impact the Hausdorff dimension of $ W_2(P_n) $.


title: Decentralized Generalized Approximate Message-Passing for Tree-Structured Networks

abstract: Decentralized generalized approximate message-passing (GAMP) is proposed for compressed sensing from distributed generalized linear measurements in a tree-structured network. Consensus propagation is used to realize average consensus required in GAMP via local communications between adjacent nodes. Decentralized GAMP is applicable to all tree-structured networks that do not necessarily have central nodes connected to all other nodes. State evolution is used to analyze the asymptotic dynamics of decentralized GAMP for zero-mean independent and identically distributed Gaussian sensing matrices. The state evolution recursion for decentralized GAMP is proved to have the same fixed points as that for centralized GAMP when homogeneous measurements with an identical dimension in all nodes are considered. Furthermore, existing long-memory proof strategy is used to prove that the state evolution recursion for decentralized GAMP with the Bayes-optimal denoisers converges to a fixed point. These results imply that the state evolution recursion for decentralized GAMP with the Bayes-optimal denoisers converges to the Bayes-optimal fixed point for the homogeneous measurements when the fixed point is unique. Numerical results for decentralized GAMP are presented in the cases of linear measurements and clipping. As examples of tree-structured networks, a one-dimensional chain and a tree with no central nodes are considered.


title: Non-Autoregressive Diffusion-based Temporal Point Processes for Continuous-Time Long-Term Event Prediction

abstract: Continuous-time long-term event prediction plays an important role in many application scenarios. Most existing works rely on autoregressive frameworks to predict event sequences, which suffer from error accumulation, thus compromising prediction quality. Inspired by the success of denoising diffusion probabilistic models, we propose a diffusion-based non-autoregressive temporal point process model for long-term event prediction in continuous time. Instead of generating events one at a time in an autoregressive way, our model predicts the future event sequence entirely as a whole. In order to perform diffusion processes on event sequences, we develop a bidirectional map between target event sequences and the Euclidean vector space. Furthermore, we design a novel denoising network to capture both sequential and contextual features for better sample quality. Extensive experiments are conducted to prove the superiority of our proposed model over state-of-the-art methods on long-term event prediction in continuous time. To the best of our knowledge, this is the first work to apply diffusion methods to long-term event prediction problems.


title: Learning to Adapt CLIP for Few-Shot Monocular Depth Estimation

abstract: Pre-trained Vision-Language Models (VLMs), such as CLIP, have shown enhanced performance across a range of tasks that involve the integration of visual and linguistic modalities. When CLIP is used for depth estimation tasks, the patches, divided from the input images, can be combined with a series of semantic descriptions of the depth information to obtain similarity results. The coarse estimation of depth is then achieved by weighting and summing the depth values, called depth bins, corresponding to the predefined semantic descriptions. The zero-shot approach circumvents the computational and time-intensive nature of traditional fully-supervised depth estimation methods. However, this method, utilizing fixed depth bins, may not effectively generalize as images from different scenes may exhibit distinct depth distributions. To address this challenge, we propose a few-shot-based method which learns to adapt the VLMs for monocular depth estimation to balance training costs and generalization capabilities. Specifically, it assigns different depth bins for different scenes, which can be selected by the model during inference. Additionally, we incorporate learnable prompts to preprocess the input text to convert the easily human-understood text into easily model-understood vectors and further enhance the performance. With only one image per scene for training, our extensive experiment results on the NYU V2 and KITTI dataset demonstrate that our method outperforms the previous state-of-the-art method by up to 10.6\% in terms of MARE.


title: Mathematical Properties of the Zadoff-Chu Sequences

abstract: This paper is a compilation of well-known results about Zadoff-Chu sequences, including all proofs with a consistent mathematical notation, for easy reference. Moreover, for a Zadoff-Chu sequence $x_u[n]$ of prime length $N_{\text{ZC}}$ and root index $u$, a formula is derived that allows computing the first term (frequency zero) of its discrete Fourier transform, $X_u[0]$, with constant complexity independent of the sequence length, as opposed to accumulating all its $N_{\text{ZC}}$ terms. The formula stems from a famous result in analytic number theory and is an interesting complement to the fact that the discrete Fourier transform of a Zadoff-Chu sequence is itself a Zadoff-Chu sequence whose terms are scaled by $X_u[0]$. Finally, the paper concludes with a brief analysis of time-continuous signals derived from Zadoff-Chu sequences, especially those obtained by OFDM-modulating a Zadoff-Chu sequence.


title: ATHENA: Mathematical Reasoning with Thought Expansion

abstract: Solving math word problems depends on how to articulate the problems, the lens through which models view human linguistic expressions. Real-world settings count on such a method even more due to the diverse practices of the same mathematical operations. Earlier works constrain available thinking processes by limited prediction strategies without considering their significance in acquiring mathematical knowledge. We introduce Attention-based THought Expansion Network Architecture (ATHENA) to tackle the challenges of real-world practices by mimicking human thought expansion mechanisms in the form of neural network propagation. A thought expansion recurrently generates the candidates carrying the thoughts of possible math expressions driven from the previous step and yields reasonable thoughts by selecting the valid pathways to the goal. Our experiments show that ATHENA achieves a new state-of-the-art stage toward the ideal model that is compelling in variant questions even when the informativeness in training examples is restricted.


title: Electronic properties and surface states of CeRh$_{2}$As$_{2}$

abstract: Locally noncentrosymmetric CeRh$_{2}$As$_{2}$ exhibits characteristic two-phase unconventional $H$--$T$ superconducting phase diagram. The transition from even- to odd-parity superconducting phase is supported by the P4/nmm crystal structure and it can be induced by the external magnetic field. Dual nature of the Ce $f$ electrons and competition between their itinerant and localized nature can be important for its physical proprieties. The existing electronic band structure in this material is still under debate. Energy scale occurring in the system can be important for adequate theoretical description of its supercomputing properties. In this paper, we discuss electronic band structure obtained from {\it ab initio} calculations. We analyze electronic surface states which can be compared with recently obtained angle-resolved photoemission spectroscopy measurement (ARPES). Additionally, we present the analyses of the hopping parameters obtained from the electronic band structure. The As-Rh layers are characterized by much more significant hopping parameters between atoms than these obtained for the Ce-Ce atoms. This suggests need of a revision of the tight binding model necessary for adequate description of the physical properties of CeRh$_{2}$As$_{2}$.


title: Better with Less: A Data-Active Perspective on Pre-Training Graph Neural Networks

abstract: Pre-training on graph neural networks (GNNs) aims to learn transferable knowledge for downstream tasks with unlabeled data, and it has recently become an active research area. The success of graph pre-training models is often attributed to the massive amount of input data. In this paper, however, we identify the curse of big data phenomenon in graph pre-training: more training data do not necessarily lead to better downstream performance. Motivated by this observation, we propose a better-with-less framework for graph pre-training: fewer, but carefully chosen data are fed into a GNN model to enhance pre-training. The proposed pre-training pipeline is called the data-active graph pre-training (APT) framework, and is composed of a graph selector and a pre-training model. The graph selector chooses the most representative and instructive data points based on the inherent properties of graphs as well as predictive uncertainty. The proposed predictive uncertainty, as feedback from the pre-training model, measures the confidence level of the model in the data. When fed with the chosen data, on the other hand, the pre-training model grasps an initial understanding of the new, unseen data, and at the same time attempts to remember the knowledge learned from previous data. Therefore, the integration and interaction between these two components form a unified framework (APT), in which graph pre-training is performed in a progressive and iterative way. Experiment results show that the proposed APT is able to obtain an efficient pre-training model with fewer training data and better downstream performance.


title: Cross-cultural electronic word-of-mouth: a systematic literature review

abstract: Purpose: Global adoption of the internet and mobile usage results in a huge variation in the cultural backgrounds of consumers who generate and consume electronic word-of-mouth (eWOM). Unsurprisingly, a research trend on cross-cultural eWOM has emerged. However, there has not been an attempt to synthesize this research topic. This paper aims to bridge this gap. Methodology: This research paper conducts a systematic literature review of the current research findings on cross-cultural eWOM. Journal articles published from 2006 to 2021 are included. This study then presents the key issues in the extant literature and suggests potential future research. Findings: The findings show that there has been an upward trend in the number of publications on cross-cultural eWOM since the early 2010s, with a relatively steeper increase toward 2020. The findings also synthesize cross-cultural eWOM research into four elements and suggest potential future research avenues. Value: To the best of the authors' knowledge, there is currently no exhaustive/integrated review of cross-cultural eWOM research. This research fills the need to summarize the current state of cross-cultural eWOM literature and identifies research questions to be addressed in the future.


title: The Roles of Culture in Online User Reviews: An Empirical Investigation

abstract: Electronic word-of-mouth (eWOM) is a prominent source of information that significantly influences consumer purchase decisions. Recent literature has extensively explored the impact of eWOM on consumers-generated reviews and purchase decisions. However, few studies have analyzed the role of culture on eWOM. We use a novel dataset of Airbnb eWOM messages in order to empirically extend the findings by Banerjee and Chai (2019). We find that the sentiment of individualistic customers is worse than that of their collectivistic counterparts when both groups experience the same level of negative disconfirmations. Furthermore, guests from a relatively more distant culture rely less on heuristics. In particular, quality signals, such as the "superhost" status, are more influential to consumers from a less distant cultural background.


title: Learn to Refuse: Making Large Language Models More Controllable and Reliable through Knowledge Scope Limitation and Refusal Mechanism

abstract: Large language models (LLMs) have demonstrated impressive language understanding and generation capabilities, enabling them to answer a wide range of questions across various domains. However, these models are not flawless and often produce responses that contain errors or misinformation. These inaccuracies, commonly referred to as hallucinations, render LLMs unreliable and even unusable in many scenarios. In this paper, our focus is on mitigating the issue of hallucination in LLMs, particularly in the context of question-answering. Instead of attempting to answer all questions, we explore a refusal mechanism that instructs LLMs to refuse to answer challenging questions in order to avoid errors. We then propose a simple yet effective solution called Learn to Refuse (L2R), which incorporates the refusal mechanism to enable LLMs to recognize and refuse to answer questions that they find difficult to address. To achieve this, we utilize a structured knowledge base to represent all the LLM's understanding of the world, enabling it to provide traceable gold knowledge. This knowledge base is separate from the LLM and initially empty. It can be filled with validated knowledge and progressively expanded. When an LLM encounters questions outside its domain, the system recognizes its knowledge scope and determines whether it can answer the question independently. Additionally, we introduce a method for automatically and efficiently expanding the knowledge base of LLMs. Through qualitative and quantitative analysis, we demonstrate that our approach enhances the controllability and reliability of LLMs.


title: Higher Mediterranean diet score is associated with longer time between relapses in Australian females with multiple sclerosis

abstract: A higher Mediterranean diet score has been associated with lower likelihood of multiple sclerosis. However, evidence regarding its association with disease activity and progression is limited. Using data from the AusLong Study, we tested longitudinal associations (over 10 years follow-up) between the alternate Mediterranean diet score (aMED) and aMED-Red (including moderate consumption of unprocessed red meat) and time between relapses and disability measured by Expanded Disability Status Scale (EDSS) (n=132; 27 males, 105 females). We used covariate-adjusted survival analysis for time between relapses, and time series mixed-effects negative binomial regression for EDSS. After adjusting for covariates, both higher aMED (aHR=0.94, 95%CI: 0.90, 0.99, p=0.009) and higher aMED-Red (aHR=0.93, 95%CI: 0.89, 0.97, p=0.001) were associated with significantly longer time between relapses in females. Whether specific dietary components of a Mediterranean diet are important in relation to relapses merits further study.


title: LLM4Drive: A Survey of Large Language Models for Autonomous Driving

abstract: Autonomous driving technology, a catalyst for revolutionizing transportation and urban mobility, has the tend to transition from rule-based systems to data-driven strategies. Traditional module-based systems are constrained by cumulative errors among cascaded modules and inflexible pre-set rules. In contrast, end-to-end autonomous driving systems have the potential to avoid error accumulation due to their fully data-driven training process, although they often lack transparency due to their "black box" nature, complicating the validation and traceability of decisions. Recently, large language models (LLMs) have demonstrated abilities including understanding context, logical reasoning, and generating answers. A natural thought is to utilize these abilities to empower autonomous driving. By combining LLM with foundation vision models, it could open the door to open-world understanding, reasoning, and few-shot learning, which current autonomous driving systems are lacking. In this paper, we systematically review a research line about \textit{Large Language Models for Autonomous Driving (LLM4AD)}. This study evaluates the current state of technological advancements, distinctly outlining the principal challenges and prospective directions for the field. For the convenience of researchers in academia and industry, we provide real-time updates on the latest advances in the field as well as relevant open-source resources via the designated link: https://github.com/Thinklab-SJTU/Awesome-LLM4AD.


title: Hidden-charm pentaquarks with strangeness in a chiral quark model

abstract: The LHCb collaboration has recently announced the discovery of two hidden-charm pentaquark states with also strange quark content, $P_{cs}(4338)$ and $P_{cs}(4459)$; its analysis points towards having both hadrons isospin equal to zero and spin-parity quantum numbers $\frac12^-$ and $\frac32^-$, respectively. We perform herein a systematical investigation of the $qqsc\bar{c}$ $(q=u,\,d)$ system by means of a chiral quark model, along with a highly accurate computational method, the Gaussian expansion approach combined with the complex-scaling technique. Baryon-meson configurations in both singlet- and hidden-color channels are considered. The $P_{cs}(4338)$ and $P_{cs}(4459)$ signals can be well identified as molecular bound states with dominant components $\Lambda J/\psi$ $(60\%)$ and $\Xi_c D$ $(23\%)$ for the lowest-energy case and $\Xi_c D^*$ $(72\%)$ for the highest-energy one. Besides, it seems that some narrow resonances can be also found in each allowed $I(J^P)$-channel in the energy region of $4.6-5.5$ GeV, except for the $1(\frac12^-)$ where a shallow bound state with dominant $\Xi^*_c D^*$ structure is obtained at $4673$ MeV with binding energy $E_B=-3$ MeV. These exotic states are expected to be confirmed in future high energy experiments.


title: Pseudo entropy and pseudo-Hermiticity in quantum field theories

abstract: In this paper, we explore the concept of pseudo R\'enyi entropy within the context of quantum field theories (QFTs). The transition matrix is constructed by applying operators situated in different regions to the vacuum state. Specifically, when the operators are positioned in the left and right Rindler wedges respectively, we discover that the logarithmic term of the pseudo R\'enyi entropy is necessarily real. In other cases, the result might be complex. We provide direct evaluations of specific examples within 2-dimensional conformal field theories (CFTs). Furthermore, we establish a connection between these findings and the pseudo-Hermitian condition. Our analysis reveals that the reality or complexity of the logarithmic term of pseudo R\'enyi entropy can be explained through this pseudo-Hermitian framework. Additionally, we investigate the divergent term of the pseudo R\'enyi entropy. Interestingly, we observe a universal divergent term in the second pseudo R\'enyi entropy within 2-dimensional CFTs. This universal term is solely dependent on the conformal dimension of the operator under consideration. For $n$-th pseudo R\'enyi entropy ($n\ge 3$), the divergent term is intricately related to the specific details of the underlying theory.


title: Time-Independent Information-Theoretic Generalization Bounds for SGLD

abstract: We provide novel information-theoretic generalization bounds for stochastic gradient Langevin dynamics (SGLD) under the assumptions of smoothness and dissipativity, which are widely used in sampling and non-convex optimization studies. Our bounds are time-independent and decay to zero as the sample size increases, regardless of the number of iterations and whether the step size is fixed. Unlike previous studies, we derive the generalization error bounds by focusing on the time evolution of the Kullback--Leibler divergence, which is related to the stability of datasets and is the upper bound of the mutual information between output parameters and an input dataset. Additionally, we establish the first information-theoretic generalization bound when the training and test loss are the same by showing that a loss function of SGLD is sub-exponential. This bound is also time-independent and removes the problematic step size dependence in existing work, leading to an improved excess risk bound by combining our analysis with the existing non-convex optimization error bounds.


title: Improving Robustness via Tilted Exponential Layer: A Communication-Theoretic Perspective

abstract: State-of-the-art techniques for enhancing robustness of deep networks mostly rely on empirical risk minimization with suitable data augmentation. In this paper, we propose a complementary approach motivated by communication theory, aimed at enhancing the signal-to-noise ratio at the output of a neural network layer via neural competition during learning and inference. In addition to standard empirical risk minimization, neurons compete to sparsely represent layer inputs by maximization of a tilted exponential (TEXP) objective function for the layer. TEXP learning can be interpreted as maximum likelihood estimation of matched filters under a Gaussian model for data noise. Inference in a TEXP layer is accomplished by replacing batch norm by a tilted softmax, which can be interpreted as computation of posterior probabilities for the competing signaling hypotheses represented by each neuron. After providing insights via simplified models, we show, by experimentation on standard image datasets, that TEXP learning and inference enhances robustness against noise and other common corruptions, without requiring data augmentation. Further cumulative gains in robustness against this array of distortions can be obtained by appropriately combining TEXP with data augmentation techniques. The code for all our experiments is available at https://github.com/bhagyapuranik/texp_for_robustness.


title: AI-assisted Learning for Electronic Engineering Courses in High Education

abstract: This study evaluates the efficacy of ChatGPT as an AI teaching and learning support tool in an integrated circuit systems course at a higher education institution in an Asian country. Various question types were completed, and ChatGPT responses were assessed to gain valuable insights for further investigation. The objective is to assess ChatGPT's ability to provide insights, personalized support, and interactive learning experiences in engineering education. The study includes the evaluation and reflection of different stakeholders: students, lecturers, and engineers. The findings of this study shed light on the benefits and limitations of ChatGPT as an AI tool, paving the way for innovative learning approaches in technical disciplines. Furthermore, the study contributes to our understanding of how digital transformation is likely to unfold in the education sector.


title: Multi-dimensional data refining strategy for effective fine-tuning LLMs

abstract: Data is a cornerstone for fine-tuning large language models, yet acquiring suitable data remains challenging. Challenges encompassed data scarcity, linguistic diversity, and domain-specific content. This paper presents lessons learned while crawling and refining data tailored for fine-tuning Vietnamese language models. Crafting such a dataset, while accounting for linguistic intricacies and striking a balance between inclusivity and accuracy, demands meticulous planning. Our paper presents a multidimensional strategy including leveraging existing datasets in the English language and developing customized data-crawling scripts with the assistance of generative AI tools. A fine-tuned LLM model for the Vietnamese language, which was produced using resultant datasets, demonstrated good performance while generating Vietnamese news articles from prompts. The study offers practical solutions and guidance for future fine-tuning models in languages like Vietnamese.


title: Application and Energy-Aware Data Aggregation using Vector Synchronization in Distributed Battery-less IoT Networks

abstract: The battery-less Internet of Things (IoT) devices are a key element in the sustainable green initiative for the next-generation wireless networks. These battery-free devices use the ambient energy, harvested from the environment. The energy harvesting environment is dynamic and causes intermittent task execution. The harvested energy is stored in small capacitors and it is challenging to assure the application task execution. The main goal is to provide a mechanism to aggregate the sensor data and provide a sustainable application support in the distributed battery-less IoT network. We model the distributed IoT network system consisting of many battery-free IoT sensor hardware modules and heterogeneous IoT applications that are being supported in the device-edge-cloud continuum. The applications require sensor data from a distributed set of battery-less hardware modules and there is provision of joint control over the module actuators. We propose an application-aware task and energy manager (ATEM) for the IoT devices and a vector-synchronization based data aggregator (VSDA). The ATEM is supported by device-level federated energy harvesting and system-level energy-aware heterogeneous application management. In our proposed framework the data aggregator forecasts the available power from the ambient energy harvester using long-short-term-memory (LSTM) model and sets the device profile as well as the application task rates accordingly. Our proposed scheme meets the heterogeneous application requirements with negligible overhead; reduces the data loss and packet delay; increases the hardware component availability; and makes the components available sooner as compared to the state-of-the-art.


title: Sponsorship Disclosure in Native Advertising: A Theoretical Framework

abstract: Native advertising is one of the fastest growing areas of online promotion. After reviewing extant literature via EBSCOhost database, this study draws on Persuasion Knowledge Model and develops a theoretical framework which facilitates a clearer understanding of the relationship between sponsorship disclosure in native advertising and consumer outcome. The framework suggests that sponsorship disclosure has a negative effect on electronic word of mouth (eWOM), and further proposes the interplay between the main effect with brand prominence and the type of device. This is highly relevant to marketer as regulators have been pressuring for the disclosure of native advertising. As this is likely to have detrimental effect to the eWOM, marketer may employ the boundary conditions proposed by this framework to attenuate that negative effect.


title: Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysis

abstract: We introduce Resilient Multiple Choice Learning (rMCL), an extension of the MCL approach for conditional distribution estimation in regression settings where multiple targets may be sampled for each training input. Multiple Choice Learning is a simple framework to tackle multimodal density estimation, using the Winner-Takes-All (WTA) loss for a set of hypotheses. In regression settings, the existing MCL variants focus on merging the hypotheses, thereby eventually sacrificing the diversity of the predictions. In contrast, our method relies on a novel learned scoring scheme underpinned by a mathematical framework based on Voronoi tessellations of the output space, from which we can derive a probabilistic interpretation. After empirically validating rMCL with experiments on synthetic data, we further assess its merits on the sound source localization problem, demonstrating its practical usefulness and the relevance of its interpretation.


title: A New Approach to the CO2 Airborne Fraction: Enhancing Statistical Precision and Tackling Zero Emissions

abstract: The global fraction of anthropogenically emitted CO2 that stays in the atmosphere, the CO2 airborne fraction, has been fluctuating around a constant value over the recent period of 1959-2021. The consensus estimate of the airborne fraction is around $44\%$, indicating that approximately $44\%$ of emitted CO2 stays in the atmosphere and the remaining $56\%$ is absorbed by the oceanic and terrestrial biospheres. In this study, we show that the conventional estimator of the airborne fraction suffers from a number of statistical deficiencies, such as non-existence of moments and a non-Gaussian limiting distribution. We formulate a new estimator of the airborne fraction that does not suffer from these deficiencies. We show that the new estimator is superconsistent, has a Gaussian limiting distribution, and is able to reduce estimation uncertainty substantially. Our empirical analysis leads to an estimate of the airborne fraction over 1959-2021 of $47.6\%$ ($\pm 1.1\%$; $1 \sigma$). Hence, our empirical results imply a higher, and better constrained, airborne fraction than the current consensus. Our theoretical results indicate that a conventional analysis of the airborne fraction may be problematic, especially in future low emissions scenarios such as those implied by "net zero" international agreements. Our newly proposed estimator avoids these issues and thus provides a promising approach to future studies of the airborne fraction, especially in low emission scenarios.


title: A feasible and unitary quantum programming language

abstract: We introduce a novel quantum programming language featuring higher-order programs and quantum controlflow which ensures that all qubit transformations are unitary. Our language boasts a type system guaranteeingboth unitarity and polynomial-time normalization. Unitarity is achieved by using a special modality forsuperpositions while requiring orthogonality among superposed terms. Polynomial-time normalization isachieved using a linear-logic-based type discipline employing Barber and Plotkin duality along with a specificmodality to account for potential duplications. This type discipline also guarantees that derived values havepolynomial size. Our language seamlessly combines the two modalities: quantum circuit programs upholdunitarity, and all programs are evaluated in polynomial time, ensuring their feasibility.


title: From 5G to 6G: Revolutionizing Satellite Networks through TRANTOR Foundation

abstract: 5G technology will drastically change the way satellite internet providers deliver services by offering higher data speeds, massive network capacity, reduced latency, improved reliability and increased availability. A standardised 5G ecosystem will enable adapting 5G to satellite needs. The EU-funded TRANTOR project will seek to develop novel and secure satellite network management solutions that allow scaling up heterogeneous satellite traffic demands and capacities in a cost-effective and highly dynamic way. Researchers also target the development of flexible 6G non-terrestrial access architectures. The focus will be on the design of a multi-orbit and multi-band antenna for satellite user equipment (UE), as well as the development of gNodeB (gNB) and UE 5G non-terrestrial network equipment to support multi-connectivity.


title: Collaboration and Transition: Distilling Item Transitions into Multi-Query Self-Attention for Sequential Recommendation

abstract: Modern recommender systems employ various sequential modules such as self-attention to learn dynamic user interests. However, these methods are less effective in capturing collaborative and transitional signals within user interaction sequences. First, the self-attention architecture uses the embedding of a single item as the attention query, making it challenging to capture collaborative signals. Second, these methods typically follow an auto-regressive framework, which is unable to learn global item transition patterns. To overcome these limitations, we propose a new method called Multi-Query Self-Attention with Transition-Aware Embedding Distillation (MQSA-TED). First, we propose an $L$-query self-attention module that employs flexible window sizes for attention queries to capture collaborative signals. In addition, we introduce a multi-query self-attention method that balances the bias-variance trade-off in modeling user preferences by combining long and short-query self-attentions. Second, we develop a transition-aware embedding distillation module that distills global item-to-item transition patterns into item embeddings, which enables the model to memorize and leverage transitional signals and serves as a calibrator for collaborative signals. Experimental results on four real-world datasets demonstrate the effectiveness of the proposed modules.


title: Ultra-Efficient On-Device Object Detection on AI-Integrated Smart Glasses with TinyissimoYOLO

abstract: Smart glasses are rapidly gaining advanced functionality thanks to cutting-edge computing technologies, accelerated hardware architectures, and tiny AI algorithms. Integrating AI into smart glasses featuring a small form factor and limited battery capacity is still challenging when targeting full-day usage for a satisfactory user experience. This paper illustrates the design and implementation of tiny machine-learning algorithms exploiting novel low-power processors to enable prolonged continuous operation in smart glasses. We explore the energy- and latency-efficient of smart glasses in the case of real-time object detection. To this goal, we designed a smart glasses prototype as a research platform featuring two microcontrollers, including a novel milliwatt-power RISC-V parallel processor with a hardware accelerator for visual AI, and a Bluetooth low-power module for communication. The smart glasses integrate power cycling mechanisms, including image and audio sensing interfaces. Furthermore, we developed a family of novel tiny deep-learning models based on YOLO with sub-million parameters customized for microcontroller-based inference dubbed TinyissimoYOLO v1.3, v5, and v8, aiming at benchmarking object detection with smart glasses for energy and latency. Evaluations on the prototype of the smart glasses demonstrate TinyissimoYOLO's 17ms inference latency and 1.59mJ energy consumption per inference while ensuring acceptable detection accuracy. Further evaluation reveals an end-to-end latency from image capturing to the algorithm's prediction of 56ms or equivalently 18 fps, with a total power consumption of 62.9mW, equivalent to a 9.3 hours of continuous run time on a 154mAh battery. These results outperform MCUNet (TinyNAS+TinyEngine), which runs a simpler task (image classification) at just 7.3 fps per second.


title: Continuous Fluid Antenna Systems: Modeling and Analysis

abstract: Fluid antennas (FAs) is a promising technology for introducing flexibility and reconfigurability in wireless networks. Recent research efforts have highlighted the potential gains that can be achieved in comparison to conventional antennas. These works assume that the FA has a discrete number of positions that the liquid can take. However, from a practical standpoint, the liquid moves in a continuous fashion to any point inside the FA. In this paper, we focus on a continuous FA system (CFAS) and present a general framework for its design and analytical evaluation. In particular, we derive closed-form analytical expressions for the level crossing rate (LCR) and the average fade duration of the continuous signal-to-interference ratio (SIR) process over the FA's length. Then, by leveraging the LCR expression, we characterize the system's outage performance with a bound on the cumulative distribution function of the SIR's supremum. Our results confirm that the CFAS outperforms its discrete counterpart and thus provides the performance limits of FA-based systems.


title: Adapt On-the-Go: Behavior Modulation for Single-Life Robot Deployment

abstract: To succeed in the real world, robots must cope with situations that differ from those seen during training. We study the problem of adapting on-the-fly to such novel scenarios during deployment, by drawing upon a diverse repertoire of previously learned behaviors. Our approach, RObust Autonomous Modulation (ROAM), introduces a mechanism based on the perceived value of pre-trained behaviors to select and adapt pre-trained behaviors to the situation at hand. Crucially, this adaptation process all happens within a single episode at test time, without any human supervision. We provide theoretical analysis of our selection mechanism and demonstrate that ROAM enables a robot to adapt rapidly to changes in dynamics both in simulation and on a real Go1 quadruped, even successfully moving forward with roller skates on its feet. Our approach adapts over 2x as efficiently compared to existing methods when facing a variety of out-of-distribution situations during deployment by effectively choosing and adapting relevant behaviors on-the-fly.


title: Reputation Systems for Supply Chains: The Challenge of Achieving Privacy Preservation

abstract: Consumers frequently interact with reputation systems to rate products, services, and deliveries. While past research extensively studied different conceptual approaches to realize such systems securely and privacy-preservingly, these concepts are not yet in use in business-to-business environments. In this paper, (1) we thus outline which specific challenges privacy-cautious stakeholders in volatile supply chain networks introduce, (2) give an overview of the diverse landscape of privacy-preserving reputation systems and their properties, and (3) based on well-established concepts from supply chain information systems and cryptography, we further propose an initial concept that accounts for the aforementioned challenges by utilizing fully homomorphic encryption. For future work, we identify the need of evaluating whether novel systems address the supply chain-specific privacy and confidentiality needs.


title: Deep Learning for real-time neural decoding of grasp

abstract: Neural decoding involves correlating signals acquired from the brain to variables in the physical world like limb movement or robot control in Brain Machine Interfaces. In this context, this work starts from a specific pre-existing dataset of neural recordings from monkey motor cortex and presents a Deep Learning-based approach to the decoding of neural signals for grasp type classification. Specifically, we propose here an approach that exploits LSTM networks to classify time series containing neural data (i.e., spike trains) into classes representing the object being grasped. The main goal of the presented approach is to improve over state-of-the-art decoding accuracy without relying on any prior neuroscience knowledge, and leveraging only the capability of deep learning models to extract correlations from data. The paper presents the results achieved for the considered dataset and compares them with previous works on the same dataset, showing a significant improvement in classification accuracy, even if considering simulated real-time decoding.


title: On some questions about composition operators on weighted Hardy spaces

abstract: We first consider some questions raised by N. Zorboska in her thesis. In particular she asked for which sequences $\beta$ every symbol $\varphi \colon \mathbb{D} \to \mathbb{D}$ with $\varphi \in H^2 (\beta)$ induces a bounded composition operator $C_\phi$ on the weighted Hardy space $H^2 (\beta)$. We give partial answers and investigate when $H^2 (\beta)$ is an algebra. We answer negatively another question in showing that there are a sequence $\beta$ and $\varphi \in H^2 (\beta)$ such that $\| \varphi \|_\infty < 1$ and the composition operator $C_\varphi$ is not bounded on $H^2 (\beta)$. In a second part, we show that for $p \neq 2$, no automorphism of $\mathbb{D}$, except those that fix $0$, induces a bounded composition operator on the Beurling-Sobolev space $\ell^p_A$, and even on any weighted version of this space.


title: Liouville theorem for one kind of elliptic equations on complete Riemannian manifold

abstract: We use maximum principle to give a new proof for the Liouville theorem of the equation $\Delta u + u^{\alpha} = 0, u \geq 0 , 0 < \alpha < \frac{n + 2}{n - 2}$ in $\mathbb R^n$. Besides we can use this method to prove the Liouville theorem of the equation $\Delta U + b\cdot \nabla U + h U^{\alpha} = 0, U \geq 0, 0 < \alpha < \frac{n + 2}{n - 2}$ on the complete Riemannian manifold.


title: Multimodal Foundation Models for Zero-shot Animal Species Recognition in Camera Trap Images

abstract: Due to deteriorating environmental conditions and increasing human activity, conservation efforts directed towards wildlife is crucial. Motion-activated camera traps constitute an efficient tool for tracking and monitoring wildlife populations across the globe. Supervised learning techniques have been successfully deployed to analyze such imagery, however training such techniques requires annotations from experts. Reducing the reliance on costly labelled data therefore has immense potential in developing large-scale wildlife tracking solutions with markedly less human labor. In this work we propose WildMatch, a novel zero-shot species classification framework that leverages multimodal foundation models. In particular, we instruction tune vision-language models to generate detailed visual descriptions of camera trap images using similar terminology to experts. Then, we match the generated caption to an external knowledge base of descriptions in order to determine the species in a zero-shot manner. We investigate techniques to build instruction tuning datasets for detailed animal description generation and propose a novel knowledge augmentation technique to enhance caption quality. We demonstrate the performance of WildMatch on a new camera trap dataset collected in the Magdalena Medio region of Colombia.


title: Novel View Synthesis from a Single RGBD Image for Indoor Scenes

abstract: In this paper, we propose an approach for synthesizing novel view images from a single RGBD (Red Green Blue-Depth) input. Novel view synthesis (NVS) is an interesting computer vision task with extensive applications. Methods using multiple images has been well-studied, exemplary ones include training scene-specific Neural Radiance Fields (NeRF), or leveraging multi-view stereo (MVS) and 3D rendering pipelines. However, both are either computationally intensive or non-generalizable across different scenes, limiting their practical value. Conversely, the depth information embedded in RGBD images unlocks 3D potential from a singular view, simplifying NVS. The widespread availability of compact, affordable stereo cameras, and even LiDARs in contemporary devices like smartphones, makes capturing RGBD images more accessible than ever. In our method, we convert an RGBD image into a point cloud and render it from a different viewpoint, then formulate the NVS task into an image translation problem. We leveraged generative adversarial networks to style-transfer the rendered image, achieving a result similar to a photograph taken from the new perspective. We explore both unsupervised learning using CycleGAN and supervised learning with Pix2Pix, and demonstrate the qualitative results. Our method circumvents the limitations of traditional multi-image techniques, holding significant promise for practical, real-time applications in NVS.


title: Dynamic Multimodal Information Bottleneck for Multimodality Classification

abstract: Effectively leveraging multimodal data such as various images, laboratory tests and clinical information is gaining traction in a variety of AI-based medical diagnosis and prognosis tasks. Most existing multi-modal techniques only focus on enhancing their performance by leveraging the differences or shared features from various modalities and fusing feature across different modalities. These approaches are generally not optimal for clinical settings, which pose the additional challenges of limited training data, as well as being rife with redundant data or noisy modality channels, leading to subpar performance. To address this gap, we study the robustness of existing methods to data redundancy and noise and propose a generalized dynamic multimodal information bottleneck framework for attaining a robust fused feature representation. Specifically, our information bottleneck module serves to filter out the task-irrelevant information and noises in the fused feature, and we further introduce a sufficiency loss to prevent dropping of task-relevant information, thus explicitly preserving the sufficiency of prediction information in the distilled feature. We validate our model on an in-house and a public COVID19 dataset for mortality prediction as well as two public biomedical datasets for diagnostic tasks. Extensive experiments show that our method surpasses the state-of-the-art and is significantly more robust, being the only method to remain performance when large-scale noisy channels exist. Our code is publicly available at https://github.com/ayanglab/DMIB.


title: A note on transition parameters defined with properties of fluid element

abstract: Laminar-turbulent transitions occur at different Reynolds numbers for different flow configurations and different fluids. In order to study quantitatively the similarity among the transition processes of wall-bounded shear flows, a uniform definition of transition parameter is required. The transition parameters defined with properties of fluid element are compared and discussed in terms of theoretical basis, physical definition, and expression, and their application limitations in plane-Poiseuille flow, plane-Couette flow, and Hagen-Poiseuille flow are clarified.


title: Impact of Yves Meyer's work on Kato's conjecture

abstract: We discuss how the works of Yves Meyer, together with Raphy Coifman, on Calder{\'o}n's program and singular integrals with minimal smoothness in the seventies, paved the way not only to a solution to Kato's conjecture for square roots of elliptic operators, but also to major developments in elliptic and parabolic boundary value problems with rough coefficients on rough domains.


title: Inverse of the Squared Distance Matrix of a Complete Multipartite Graph

abstract: Let $G$ be a connected graph on $n$ vertices and $d_{ij}$ be the length of the shortest path between vertices $i$ and $j$ in $G$. We set $d_{ii}=0$ for every vertex $i$ in $G$. The squared distance matrix $\Delta(G)$ of $G$ is the $n\times n$ matrix with $(i,j)^{th}$ entry equal to $0$ if $i = j$ and equal to $d_{ij}^2$ if $i \neq j$. For a given complete $t$-partite graph $K_{n_1,n_2,\cdots,n_t}$ on $n=\sum_{i=1}^t n_i$ vertices, under some condition we find the inverse $\Delta(K_{n_1,n_2,\cdots,n_t})^{-1}$ as a rank-one perturbation of a symmetric Laplacian-like matrix $\mathcal{L}$ with $\textup{rank} (\mathcal{L})=n-1$. We also investigate the inertia of $\mathcal{L}$.


title: Multilingual DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts

abstract: Whisper is a multitask and multilingual speech model covering 99 languages. It yields commendable automatic speech recognition (ASR) results in a subset of its covered languages, but the model still underperforms on a non-negligible number of under-represented languages, a problem exacerbated in smaller model versions. In this work, we propose DistilWhisper, an approach able to bridge the performance gap in ASR for these languages while retaining the advantages of multitask and multilingual capabilities. Our approach involves two key strategies: lightweight modular ASR fine-tuning of whisper-small using language-specific experts, and knowledge distillation from whisper-large-v2. This dual approach allows us to effectively boost ASR performance while keeping the robustness inherited from the multitask and multilingual pre-training. Results demonstrate that our approach is more effective than standard fine-tuning or LoRA adapters, boosting performance in the targeted languages for both in- and out-of-domain test sets, while introducing only a negligible parameter overhead at inference.


title: Magnesium hydride films deposited on flexible substrates: Structure, morphology and hydrogen sorption properties

abstract: 1.8 micrometer-thick magnesium hydride films were synthesized in a single-step process by reactive plasma-assisted sputtering. The MgH2 thin films, which were deposited on two types of flexible surfaces (namely graphite and polyimide foils) were found to adhere on both substrates. In all cases, XRD analysis revealed an as-deposited thin film consisting of alpha-MgH2, a tetragonal, rutile-type crystal structure (space group \#136). The hydrogen sorption capacities of the uncapped films were studied over successive desorption/absorption cycles performed at 350 {\textdegree}C. The first desorption always shows a slow kinetics that can be explained by a superficial oxidation of the films. However, once the passivating layer is removed, the following dehydrogenations occur faster. Multiple cycling of the film deposited on polyimide resulted in delamination of the film and its conversion into loose powder. As for MgH2 deposited on the flexible graphite substrate, a fully reversible capacity was observed over 28 cycles with no delamination of the film. Upon cycling, the microstructure of the film has evolved from homogeneous fibrous to an untextured morphology with a higher degree of crystallinity.


title: Exponential decay results for compressible viscous flows with vacuum

abstract: We are concerned with the isentropic compressible Navier-Stokes system in the two-dimensional torus, with rough data and vacuum : the initial velocity is in the Sobolev space H^1 and the initial density is only bounded and nonnegative. Arbitrary regions of vacuum are admissible, and no compatibility condition is required. Under these assumptions and for large enough bulk viscosity, global solutions have been constructed in [7]. The main goal of the paper is to establish that these solutions converge exponentially fast to a constant state, and to specify the convergence rate in terms of the viscosity coefficients. We also prove exponential decay estimates for the solutions to the inhomogeneous incompressible Navier-Stokes equations. This latter result extends to the torus case the recent paper [9] dedicated to this system in smooth bounded domains.