title: ChimpVLM: Ethogram-Enhanced Chimpanzee Behaviour Recognition

abstract: We show that chimpanzee behaviour understanding from camera traps can be enhanced by providing visual architectures with access to an embedding of text descriptions that detail species behaviours. In particular, we present a vision-language model which employs multi-modal decoding of visual features extracted directly from camera trap videos to process query tokens representing behaviours and output class predictions. Query tokens are initialised using a standardised ethogram of chimpanzee behaviour, rather than using random or name-based initialisations. In addition, the effect of initialising query tokens using a masked language model fine-tuned on a text corpus of known behavioural patterns is explored. We evaluate our system on the PanAf500 and PanAf20K datasets and demonstrate the performance benefits of our multi-modal decoding approach and query initialisation strategy on multi-class and multi-label recognition tasks, respectively. Results and ablations corroborate performance improvements. We achieve state-of-the-art performance over vision and vision-language models in top-1 accuracy (+6.34%) on PanAf500 and overall (+1.1%) and tail-class (+2.26%) mean average precision on PanAf20K. We share complete source code and network weights for full reproducibility of results and easy utilisation.


title: Enforcing Paraphrase Generation via Controllable Latent Diffusion

abstract: Paraphrase generation aims to produce high-quality and diverse utterances of a given text. Though state-of-the-art generation via the diffusion model reconciles generation quality and diversity, textual diffusion suffers from a truncation issue that hinders efficiency and quality control. In this work, we propose \textit{L}atent \textit{D}iffusion \textit{P}araphraser~(LDP), a novel paraphrase generation by modeling a controllable diffusion process given a learned latent space. LDP achieves superior generation efficiency compared to its diffusion counterparts. It facilitates only input segments to enforce paraphrase semantics, which further improves the results without external features. Experiments show that LDP achieves improved and diverse paraphrase generation compared to baselines. Further analysis shows that our method is also helpful to other similar text generations and domain adaptations. Our code and data are available at https://github.com/NIL-zhuang/ld4pg.


title: NeurIT: Pushing the Limit of Neural Inertial Tracking for Indoor Robotic IoT

abstract: Inertial tracking is vital for robotic IoT and has gained popularity thanks to the ubiquity of low-cost Inertial Measurement Units (IMUs) and deep learning-powered tracking algorithms. Existing works, however, have not fully utilized IMU measurements, particularly magnetometers, nor maximized the potential of deep learning to achieve the desired accuracy. To enhance the tracking accuracy for indoor robotic applications, we introduce NeurIT, a sequence-to-sequence framework that elevates tracking accuracy to a new level. NeurIT employs a Time-Frequency Block-recurrent Transformer (TF-BRT) at its core, combining the power of recurrent neural network (RNN) and Transformer to learn representative features in both time and frequency domains. To fully utilize IMU information, we strategically employ body-frame differentiation of the magnetometer, which considerably reduces the tracking error. NeurIT is implemented on a customized robotic platform and evaluated in various indoor environments. Experimental results demonstrate that NeurIT achieves a mere 1-meter tracking error over a 300-meter distance. Notably, it significantly outperforms state-of-the-art baselines by 48.21% on unseen data. NeurIT also performs comparably to the visual-inertial approach (Tango Phone) in vision-favored conditions and surpasses it in plain environments. We believe NeurIT takes an important step forward toward practical neural inertial tracking for ubiquitous and scalable tracking of robotic things. NeurIT, including the source code and the dataset, is open-sourced here: https://github.com/NeurIT-Project/NeurIT.


title: Introducing Super RAGs in Mistral 8x7B-v1

abstract: The relentless pursuit of enhancing Large Language Models (LLMs) has led to the advent of Super Retrieval-Augmented Generation (Super RAGs), a novel approach designed to elevate the performance of LLMs by integrating external knowledge sources with minimal structural modifications. This paper presents the integration of Super RAGs into the Mistral 8x7B v1, a state-of-the-art LLM, and examines the resultant improvements in accuracy, speed, and user satisfaction. Our methodology uses a fine-tuned instruct model setup and a cache tuning fork system, ensuring efficient and relevant data retrieval. The evaluation, conducted over several epochs, demonstrates significant enhancements across all metrics. The findings suggest that Super RAGs can effectively augment LLMs, paving the way for more sophisticated and reliable AI systems. This research contributes to the field by providing empirical evidence of the benefits of Super RAGs and offering insights into their potential applications.


title: A combinatorial approach to Berkovich type identities

abstract: Motivated by Berkovich's nine $q$-binomial identities involving the Legendre symbol $(\frac{d}{3})$, we establish a unified form of $q$-binomial identities of this type through a combinatorial approach. This unified form includes Berkovich's nine identities as special cases. Many such identities can be also deduced from this unified form.


title: Visual angle metric in the upper half plane

abstract: We prove an identity which connects the visual angle metric $v_{\mathbb{H}^2}$ and the hyperbolic metric $\rho_{\mathbb{H}^2}$ of the upper half plane $\mathbb{H}^2$. The proof is based on geometric arguments and uses computer algebra methods for formula manipulation. We also prove a sharp H\"older continuity result for quasiregular mappings with respect to the visual angle metric.


title: A Novel State-Centric Necessary Condition for Time-Optimal Control of Controllable Linear Systems Based on Augmented Switching Laws

abstract: Most existing necessary conditions for optimal control based on adjoining methods require both state information and costate information, yet the lack of costates for a given feasible trajectory in practice impedes the determination of optimality. This paper establishes a novel theoretical framework for time-optimal control of controllable linear systems, proposing the augmented switching law that represents the input control and the feasibility in a compact form. Given a feasible trajectory, the disturbed trajectory under the constraints of augmented switching law is guaranteed to be feasible, resulting in a novel state-centric necessary condition without dependence on costate information. A first order necessary condition is proposed that the Jacobian matrix of the augmented switching law is not full row rank, which also results in an approach to optimizing a given feasible trajectory further. The proposed necessary condition is applied to the chain-of-integrators systems with full box constraints, contributing to some conclusions challenging to reason by traditional costate-based necessary conditions.


title: Physics-Aware Iterative Learning and Prediction of Saliency Map for Bimanual Grasp Planning

abstract: Learning the skill of human bimanual grasping can extend the capabilities of robotic systems when grasping large or heavy objects. However, it requires a much larger search space for grasp points than single-hand grasping and numerous bimanual grasping annotations for network learning, making both data-driven or analytical grasping methods inefficient and insufficient. We propose a framework for bimanual grasp saliency learning that aims to predict the contact points for bimanual grasping based on existing human single-handed grasping data. We learn saliency corresponding vectors through minimal bimanual contact annotations that establishes correspondences between grasp positions of both hands, capable of eliminating the need for training a large-scale bimanual grasp dataset. The existing single-handed grasp saliency value serves as the initial value for bimanual grasp saliency, and we learn a saliency adjusted score that adds the initial value to obtain the final bimanual grasp saliency value, capable of predicting preferred bimanual grasp positions from single-handed grasp saliency. We also introduce a physics-balance loss function and a physics-aware refinement module that enables physical grasp balance, capable of enhancing the generalization of unknown objects. Comprehensive experiments in simulation and comparisons on dexterous grippers have demonstrated that our method can achieve balanced bimanual grasping effectively.


title: Next-to-leading-order relativistic and QCD corrections to prompt $\boldsymbol{J/\psi}$ pair photoproduction at future $\boldsymbol{e^+e^-}$ colliders

abstract: Within the framework of nonrelativistic-QCD factorization, we calculate both the next-to-leading-order relativistic and QCD corrections to prompt $J/\psi$ pair production, with feeddown from $\psi(2S)$ mesons, via photon-photon collisions at future $e^+e^-$ colliders including the Future Circular Lepton Collider (FCC-ee), the Circular Electron Positron Collider (CEPC), and the Compact Linear Collider (CLIC). We present total cross sections and distributions in single $J/\psi$ transverse momentum and rapidity, and in $J/\psi$ pair invariant mass. The relativistic and QCD corrections both turn out to be large and negative. Yet, the production rates are large enough for useful experimental studies.


title: Image Scanning Microscopy Reconstruction by Autocorrelation Inversion

abstract: Confocal laser scanning microscopy (CLSM) stands out as one of the most widely used microscopy techniques, thanks to its three-dimensional imaging capability and its sub-diffraction spatial resolution, achieved through the closure of a pinhole in front of a single-element detector. However, the pinhole also rejects useful photons and beating the diffraction limit comes at the price of irremediably compromising the signal-to-noise ratio (SNR) of the data. Image scanning microscopy (ISM) emerged as the natural evolution of CLSM, exploiting a small array detector in place of the pinhole and the single-element detector. Each sensitive element is small enough to achieve sub-diffraction resolution through the confocal effect, but the size of the whole detector is large enough to guarantee excellent collection efficiency and SNR. However, the raw data produced by an ISM setup consists of a 4D dataset which can be seen as a set of confocal-like images. Thus, fusing the dataset into a single super-resolved image requires a dedicated reconstruction algorithm. Conventional methods are multi-image deconvolution, which requires prior knowledge of the system point spread functions (PSF), or adaptive pixel reassignment (APR), which is effective only on a limited range of experimental conditions. In this work, we describe and validate a novel concept for ISM image reconstruction based on autocorrelation inversion. We leverage unique properties of the autocorrelation to discard low-frequency components and maximize the resolution of the reconstructed image, without any assumption on the image or any knowledge of the PSF. Our results push the quality of the ISM reconstruction beyond the level provided by APR and open new perspectives for multi-dimensional image processing.


title: Zero-Shot Code Representation Learning via Prompt Tuning

abstract: Learning code representations has been the core prerequisite of many software engineering tasks such as code clone detection and code generation. State-of-the-art program representation techniques mainly utilize pre-trained language models (PLMs) such as CodeBERT. A Transformer encoder is firstly pre-trained on a large-scale code corpus to acquire general knowledge about source code. The pre-trained model is then fine-tuned on specific tasks using an amount of labeled data. However, gathering training samples for the downstream tasks can be prohibitively expensive and impractical for domain-specific languages or project-specific tasks. Besides, pre-training and downstream tasks are usually heterogeneous, which makes it difficult to fully explore the knowledge learned during pre-training. In this paper, we propose Zecoler, a zero-shot approach for learning code representations. Zecoler is built upon a pre-trained programming language model. In order to elicit knowledge from the PLMs efficiently, Zecoler casts the downstream tasks to the same form of pre-training objectives by inserting train-able prompts into the original input. These prompts can guide PLMs on how to generate better results. Subsequently, we employ the prompt tuning technique to search for the optimal prompts for PLMs automatically. This enables the representation model to efficiently fit the downstream tasks through fine-tuning on the dataset in source language domain and then reuse the pre-trained knowledge for the target domain in a zero-shot style. We evaluate Zecoler in five code intelligence tasks including code clone detection, code search, method name prediction, code summarization, and code generation. The results show that our approach significantly outperforms baseline models under the zero-shot setting.


title: Large Language Models for Mobile GUI Text Input Generation: An Empirical Study

abstract: Mobile applications (apps) have become an essential part of our daily lives, making ensuring their quality an important activity. GUI testing, a quality assurance method, has frequently been used for mobile apps. When conducting GUI testing, it is important to generate effective text inputs for the text-input components. Some GUIs require these text inputs to move from one page to the next, which remains a challenge to achieving complete UI exploration. Recently, Large Language Models (LLMs) have shown excellent text-generation capabilities. Among the LLMs, OpenAI's GPT series has been widely discussed and used. However, it may not be possible to use these LLMs for GUI testing actual mobile apps, due to the security and privacy issues related to the production data. Therefore, it is necessary to explore the potential of different LLMs to guide text-input generation in mobile GUI testing. This paper reports on a large-scale empirical study that extensively investigates the effectiveness of nine state-of-the-art LLMs in Android text-input generation for UI pages. We collected 114 UI pages from 62 open-source Android apps and extracted contextual information from the UI pages to construct prompts for LLMs to generate text inputs. The experimental results show that some LLMs can generate relatively more effective and higher-quality text inputs, achieving a 50.58% to 66.67% page-pass-through rate, and even detecting some real bugs in open-source apps. Compared with the GPT-3.5 and GPT-4 LLMs, other LLMs reduce the page-pass-through rates by 17.97% to 84.79% and 21.93% to 85.53%, respectively. We also found that using more complete UI contextual information can increase the page-pass-through rates of LLMs for generating text inputs. In addition, we also describe six insights gained regarding the use of LLMs for Android testing: These insights will benefit the Android testing community.


title: Multimodal Cross-Document Event Coreference Resolution Using Linear Semantic Transfer and Mixed-Modality Ensembles

abstract: Event coreference resolution (ECR) is the task of determining whether distinct mentions of events within a multi-document corpus are actually linked to the same underlying occurrence. Images of the events can help facilitate resolution when language is ambiguous. Here, we propose a multimodal cross-document event coreference resolution method that integrates visual and textual cues with a simple linear map between vision and language models. As existing ECR benchmark datasets rarely provide images for all event mentions, we augment the popular ECB+ dataset with event-centric images scraped from the internet and generated using image diffusion models. We establish three methods that incorporate images and text for coreference: 1) a standard fused model with finetuning, 2) a novel linear mapping method without finetuning and 3) an ensembling approach based on splitting mention pairs by semantic and discourse-level difficulty. We evaluate on 2 datasets: the augmented ECB+, and AIDA Phase 1. Our ensemble systems using cross-modal linear mapping establish an upper limit (91.9 CoNLL F1) on ECB+ ECR performance given the preprocessing assumptions used, and establish a novel baseline on AIDA Phase 1. Our results demonstrate the utility of multimodal information in ECR for certain challenging coreference problems, and highlight a need for more multimodal resources in the coreference resolution space.


title: Deep Reinforcement Learning based Online Scheduling Policy for Deep Neural Network Multi-Tenant Multi-Accelerator Systems

abstract: Currently, there is a growing trend of outsourcing the execution of DNNs to cloud services. For service providers, managing multi-tenancy and ensuring high-quality service delivery, particularly in meeting stringent execution time constraints, assumes paramount importance, all while endeavoring to maintain cost-effectiveness. In this context, the utilization of heterogeneous multi-accelerator systems becomes increasingly relevant. This paper presents RELMAS, a low-overhead deep reinforcement learning algorithm designed for the online scheduling of DNNs in multi-tenant environments, taking into account the dataflow heterogeneity of accelerators and memory bandwidths contentions. By doing so, service providers can employ the most efficient scheduling policy for user requests, optimizing Service-Level-Agreement (SLA) satisfaction rates and enhancing hardware utilization. The application of RELMAS to a heterogeneous multi-accelerator system composed of various instances of Simba and Eyeriss sub-accelerators resulted in up to a 173% improvement in SLA satisfaction rate compared to state-of-the-art scheduling techniques across different workload scenarios, with less than a 1.5% energy overhead.


title: Constructing and Exploring Intermediate Domains in Mixed Domain Semi-supervised Medical Image Segmentation

abstract: Both limited annotation and domain shift are prevalent challenges in medical image segmentation. Traditional semi-supervised segmentation and unsupervised domain adaptation methods address one of these issues separately. However, the coexistence of limited annotation and domain shift is quite common, which motivates us to introduce a novel and challenging scenario: Mixed Domain Semi-supervised medical image Segmentation (MiDSS). In this scenario, we handle data from multiple medical centers, with limited annotations available for a single domain and a large amount of unlabeled data from multiple domains. We found that the key to solving the problem lies in how to generate reliable pseudo labels for the unlabeled data in the presence of domain shift with labeled data. To tackle this issue, we employ Unified Copy-Paste (UCP) between images to construct intermediate domains, facilitating the knowledge transfer from the domain of labeled data to the domains of unlabeled data. To fully utilize the information within the intermediate domain, we propose a symmetric Guidance training strategy (SymGD), which additionally offers direct guidance to unlabeled data by merging pseudo labels from intermediate samples. Subsequently, we introduce a Training Process aware Random Amplitude MixUp (TP-RAM) to progressively incorporate style-transition components into intermediate samples. Compared with existing state-of-the-art approaches, our method achieves a notable 13.57% improvement in Dice score on Prostate dataset, as demonstrated on three public datasets. Our code is available at https://github.com/MQinghe/MiDSS .


title: Order-lifted data inversion/retrieval method of neighbor cells to implement general high-order schemes in unstructured-mesh-based finite-volume solution framework

abstract: This study introduces an order-lifted inversion/retrieval method for implementing high-order schemes within the framework of an unstructured-mesh-based finite-volume method. This method defines a special representation called the data order-lifted inversion of neighbor cells (DOLINC) differential, which transforms the degrees of freedom of wide templates into differentials of various orders stored in local grid cells. Furthermore, to retrieve the original far-field information without bias during the reconstruction/interpolation of face values, the corresponding accurate inversion formulas are derived based on the defined DOLINC differentials. The order-lifted inversion method can be applied to multi-dimensional polyhedral-mesh solvers by considering the influence of grid non-uniformity on high-order schemes. It seamlessly accommodates multi-process parallel computing for high-order methods without requiring special consideration for the boundary interface. This method not only enhances the numerical accuracy of second-order finite-volume methods, but also demonstrates a significant computational-speed advantage over similar methods. A series of benchmark cases, including the linear advection, Burgers, and Euler equations, are comprehensively validated to assess the practical performance of the method. The results indicate that the unstructured-mesh high-order schemes implemented based on this method achieve theoretical accuracy in practical computations and substantially reduce computational costs compared with methods that increase grid resolution.


title: Local control on quaternionic Heisenberg group of dimension $7$

abstract: We describe the quaternionic Heisenberg group in the dimension $7$ as a matrix group. We study the local control of a compatible left-invariant control system. We describe the impact of symmetries of the corresponding sub-Riemannian structure on the optimality of geodesics.


title: Weak abelian direct summands and irreducibility of Galois representations

abstract: Let $\rho_\ell$ be a semisimple $\ell$-adic representation of a number field $K$ that is unramified almost everywhere. We introduce a new notion called weak abelian direct summands of $\rho_\ell$ and completely characterize them, for example, if the algebraic monodromy of $\rho_\ell$ is connected. If $\rho_\ell$ is in addition $E$-rational for some number field $E$, we prove that the weak abelian direct summands are locally algebraic (and thus de Rham). We also show that the weak abelian parts of a connected semisimple Serre compatible system form again such a system. Using our results on weak abelian direct summands, when $K$ is totally real and $\rho_\ell$ is the three-dimensional $\ell$-adic representation attached to a regular algebraic cuspidal automorphic, not necessarily polarizable representation $\pi$ of $\mathrm{GL}_3(\mathbb{A}_K)$ together with an isomorphism $\mathbb{C}\simeq \overline{\mathbb{Q}}_\ell$, we prove that $\rho_\ell$ is irreducible. We deduce in this case also some $\ell$-adic Hodge theoretic properties of $\rho_\ell$ if $\ell$ belongs to a Dirichlet density one set of primes.


title: Consistency analysis of refined instrumental variable methods for continuous-time system identification in closed-loop

abstract: Refined instrumental variable methods have been broadly used for identification of continuous-time systems in both open and closed-loop settings. However, the theoretical properties of these methods are still yet to be fully understood when operating in closed-loop. In this paper, we address the consistency of the simplified refined instrumental variable method for continuous-time systems (SRIVC) and its closed-loop variant CLSRIVC when they are applied on data that is generated from a feedback loop. In particular, we consider feedback loops consisting of continuous-time controllers, as well as the discrete-time control case. This paper proves that the SRIVC and CLSRIVC estimators are not generically consistent when there is a continuous-time controller in the loop, and that generic consistency can be achieved when the controller is implemented in discrete-time. Numerical simulations are presented to support the theoretical results.


title: Emergent Griffiths-phase-like behavior in the ball-milled nanocrystalline Dy4RhAl and its implication

abstract: We report the results of dc susceptibility and heat capacity measurements on the (ball-milled) nanocrystalline rare-earth (R) ternary compound, crystallizing in Gd4RhIn type, cubic Dy4RhAl compound. The bulk form of this compound has been known to undergo antiferromagnetic ordering at (TN=) 18 K with concomitant cluster spin glass anomalies. The present studies on the nano-form obtained by ball milling reveal that this antiferromagnetic ordering is suppressed with the reduction of particle size with no feature attributable to a well defined long-range magnetic ordering down to 1.8 K, but showing an inhomogeneous magnetism below 10 K. The point being stressed is that the results show the dominance of a feature around 30 K in the magnetic susceptibility data (well above TN of the bulk form) mimicking Griffiths phase. We infer that surface magnetism dominates before long range magnetic ordering occurs in this material.


title: Multi-mode Gaussian State Analysis with one Bounded Photon Counter

abstract: Gaussian states are ubiquitous in quantum optics and information processing, and it is essential to have effective tools for their characterization. One such tool is a photon-number-resolving detector, and the simplest configuration involves counting the total number of photons in the state to be characterized. This motivates the following question: What properties of a multi-mode Gaussian state are determined by the signal from one detector that measures total number photons up to some bound? We find that if the Gaussian state occupies $S$ modes and the probabilities of $n$ photons for all $n\leq 8S$ are known, then we can determine the spectrum of the Gaussian covariance matrix and the magnitude of the displacements in each eigenspace of the covariance matrix. Nothing more can be learned, even if all photon-number probabilities are known. When the state is pure, the covariance matrix spectrum determines the squeezing parameters of the state.


title: AMU-Tuning: Effective Logit Bias for CLIP-based Few-shot Learning

abstract: Recently, pre-trained vision-language models (e.g., CLIP) have shown great potential in few-shot learning and attracted a lot of research interest. Although efforts have been made to improve few-shot ability of CLIP, key factors on the effectiveness of existing methods have not been well studied, limiting further exploration of CLIP's potential in few-shot learning. In this paper, we first introduce a unified formulation to analyze CLIP-based few-shot learning methods from a perspective of logit bias, which encourages us to learn an effective logit bias for further improving performance of CLIP-based few-shot learning methods. To this end, we disassemble three key components involved in computation of logit bias (i.e., logit features, logit predictor, and logit fusion) and empirically analyze the effect on performance of few-shot classification. Based on analysis of key components, this paper proposes a novel AMU-Tuning method to learn effective logit bias for CLIP-based few-shot classification. Specifically, our AMU-Tuning predicts logit bias by exploiting the appropriate $\underline{\textbf{A}}$uxiliary features, which are fed into an efficient feature-initialized linear classifier with $\underline{\textbf{M}}$ulti-branch training. Finally, an $\underline{\textbf{U}}$ncertainty-based fusion is developed to incorporate logit bias into CLIP for few-shot classification. The experiments are conducted on several widely used benchmarks, and the results show AMU-Tuning clearly outperforms its counterparts while achieving state-of-the-art performance of CLIP-based few-shot learning without bells and whistles.


title: Beam Management in Low Earth Orbit Satellite Networks with Random Traffic Arrival and Time-varying Topology

abstract: Low earth orbit (LEO) satellite communication networks have been considered as promising solutions to providing high data rate and seamless coverage, where satellite beam management plays a key role. However, due to the limitation of beam resource, dynamic network topology, beam spectrum reuse, time-varying traffic arrival and service continuity requirement, it is challenging to effectively allocate time-frequency resource of satellite beams to multiple cells. In this paper, aiming at reducing time-averaged beam revisit time and mitigate inter-satellite handover, a beam management problem is formulated for dynamic LEO satellite communication networks, under inter-cell interference and network stability constraints. Particularly, inter-cell interference constraints are further simplified into off-axis angle based constraints, which provide tractable rules for spectrum sharing between two beam cells. To deal with the long-term performance optimization, the primal problem is transformed into a series of single epoch problems by adopting Lyapunov optimization framework. Since the transformed problem is NP-hard, it is further divided into three subproblems, including serving beam allocation, beam service time allocation and serving satellite allocation. With the help of conflict graphs built with off-axis angle based constraints, serving beam allocation and beam service time allocation algorithms are developed to reduce beam revisit time and cell packet queue length. Then, we further develop a satellite-cell service relationship optimization algorithm to better adapt to dynamic network topology. Compared with baselines, numerical results show that our proposal can reduce average beam revisit time by 20.8% and keep strong network stability with similar inter-satellite handover frequency.


title: Timing Advance Estimation in Low Earth Orbit Satellite Networks

abstract: Low earth orbit (LEO) satellite communication based on 3GPP standard is seen as a promising solution to rolling out communication services in areas without terrestrial base stations. However, due to the fast movement of satellites and large beam footprint size, the existing 5G timing advance (TA) estimation mechanism cannot be directly applied when global navigation satellite system is unavailable. In this article, an enhanced TA estimation approach is proposed for LEO satellite communication networks. Specifically, a user-side time-frequency pre-compensation method is introduced at first, which leverages frequency offset measurement on synchronization signal blocks broadcasted by satellites in initial cell search phase. For the random access phase, the upper bound of inter-preamble interference incurred by partial-period cross-correlation operations is derived for a preamble format advised by 3GPP, and it is shown that the interference level is closely related to the square of the number of such operations. Inspired by this result, a cyclic prefix free preamble format is further designed, which features extended guard time, differential power allocation and flexible preamble structure. Numerical results show that our proposal can reduce the missed detection rate of preamble within a beam. Particularly, the missed detection rates of preamble under 32, 48, and 64 users are lower than 1% when SNR = -6 dB, which is a significant improvement compared to baselines. In addition, our proposal can limit the TA estimation error of the detected users to the time length of 25 time-domain sampling points when the subcarrier spacing is 30 kHz and operation frequency is 27 GHz.


title: Queues with resetting: a perspective

abstract: Performance modeling is a key issue in queuing theory and operation research. It is well-known that the length of a queue that awaits service or the time spent by a job in a queue depends not only on the service rate, but also crucially on the fluctuations in service time. The larger the fluctuations, the longer the delay becomes and hence, this is a major hindrance for the queue to operate efficiently. Various strategies have been adapted to prevent this drawback. In this perspective, we investigate the effects of one such novel strategy namely resetting or restart, an emerging concept in statistical physics and stochastic complex process, that was recently introduced to mitigate fluctuations-induced delays in queues. In particular, we show that a service resetting mechanism accompanied with an overhead time can remarkably shorten the average queue lengths and waiting times. We examine various resetting strategies and further shed light on the intricate role of the overhead times to the queuing performance. Our analysis opens up future avenues in operation research where resetting-based strategies can be universally promising.

categories: cond-mat.stat-mech cs.PF cs.SY eess.SY math.OC math.PR


title: Fabry-Perot superconducting diode

abstract: Superconducting diode effects (SDEs) occur in systems with asymmetric critical supercurrents $|I^c_+|\neq |I^c_-|$ yielding dissipationless flow in one direction $(e.g., +)$, while dissipative transport in the opposite direction $(-)$. Here we investigate the SDE in a phase-biased $\phi$ Josephson junction with a double-barrier resonant-tunneling InAs nanowire nested between proximitized InAs/Al leads with finite momentum $\hbar q$ Cooper pairing. Within the Bogoliubov-de Gennes (BdG) approach, we obtain the exact BCS ground state energy $\mathcal{E}_G(q,\phi)$ and $I^{c}_{+} \neq |I^{c}_{-}|$ from the current-phase relation $I_G(q,\phi) \sim \partial_{\phi}\mathcal{E}_G(q,\phi)$. The SDE arises from the accrued Andreev phase shifts $\delta \phi_{L,R}(q,\phi)$ leading to asymmetric BdG spectra for $q\neq 0$. Remarkably, the diode efficiency $\gamma=(I^{c}_{+} - |I^{c}_{-}|)/(I^{c}_{+} + |I^{c}_{-}|)$ shows multiple Fabry-Perot resonances $\gamma \simeq 26\%$ at the double-barrier Andreev bound states as the well depth $V_g$ is varied. Our $\gamma$ also features sign reversals for increasing $q$ and high sensitiveness to fermion-parity transitions. The latter enables $I^{c}_{+} (\phi_+)\rightleftarrows I^{c}_{-}(\phi_-)$ switchings over narrow phase windows, i.e., $\phi_+, \phi_- \in \Delta \phi\ll\pi$, possibly relevant for future superconducting electronics.


title: Facility Assignment with Fair Cost Sharing: Equilibrium and Mechanism Design

abstract: In the one-dimensional facility assignment problem, m facilities and n agents are positioned along the real line. Each agent will be assigned to a single facility to receive service. Each facility incurs a building cost, which is shared equally among the agents utilizing it. Additionally, each agent independently bears a connection cost to access a facility. Thus, an agent's cost is the sum of the connection cost and her portion of the building cost. The social cost is the total cost of all agents. Notably, the optimal assignment that minimizes the social cost can be found in polynomial time. In this paper, we study the problem from two game-theoretical settings regarding the strategy space of agents and the rule the assignment. In both settings, agents act strategically to minimize their individual costs. In our first setting, the strategy space of agents is the set of facilities, granting agents the freedom to select any facility. Consequently, the self-formed assignment can exhibit instability, as agents may deviate to other facilities. We focus on the computation of an equilibrium assignment, where no agent has an incentive to unilaterally change her choice. We show that we can compute a pure Nash equilibrium in polynomial time. In our second setting, agents report their positions to a mechanism for assignment to facilities. The strategy space of agents becomes the set of all positions. Our interest lies in strategyproof mechanisms. It is essential to note that the preference induced by the agents' cost function is more complex as it depends on how other agents are assigned. We establish a strong lower bound against all strategyproof and anonymous mechanisms: none can achieve a bounded social cost approximation ratio. Nonetheless, we identify a class of non-trivial strategyproof mechanisms for any n and m that is unanimous and anonymous.


title: Understanding Multimodal Deep Neural Networks: A Concept Selection View

abstract: The multimodal deep neural networks, represented by CLIP, have generated rich downstream applications owing to their excellent performance, thus making understanding the decision-making process of CLIP an essential research topic. Due to the complex structure and the massive pre-training data, it is often regarded as a black-box model that is too difficult to understand and interpret. Concept-based models map the black-box visual representations extracted by deep neural networks onto a set of human-understandable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making process. However, these methods involve the datasets labeled with fine-grained attributes by expert knowledge, which incur high costs and introduce excessive human prior knowledge and bias. In this paper, we observe the long-tail distribution of concepts, based on which we propose a two-stage Concept Selection Model (CSM) to mine core concepts without introducing any human priors. The concept greedy rough selection algorithm is applied to extract head concepts, and then the concept mask fine selection method performs the extraction of core concepts. Experiments show that our approach achieves comparable performance to end-to-end black-box models, and human evaluation demonstrates that the concepts discovered by our method are interpretable and comprehensible for humans.


title: Seeing Text in the Dark: Algorithm and Benchmark

abstract: Localizing text in low-light environments is challenging due to visual degradations. Although a straightforward solution involves a two-stage pipeline with low-light image enhancement (LLE) as the initial step followed by detector, LLE is primarily designed for human vision instead of machine and can accumulate errors. In this work, we propose an efficient and effective single-stage approach for localizing text in dark that circumvents the need for LLE. We introduce a constrained learning module as an auxiliary mechanism during the training stage of the text detector. This module is designed to guide the text detector in preserving textual spatial features amidst feature map resizing, thus minimizing the loss of spatial information in texts under low-light visual degradations. Specifically, we incorporate spatial reconstruction and spatial semantic constraints within this module to ensure the text detector acquires essential positional and contextual range knowledge. Our approach enhances the original text detector's ability to identify text's local topological features using a dynamic snake feature pyramid network and adopts a bottom-up contour shaping strategy with a novel rectangular accumulation technique for accurate delineation of streamlined text features. In addition, we present a comprehensive low-light dataset for arbitrary-shaped text, encompassing diverse scenes and languages. Notably, our method achieves state-of-the-art results on this low-light dataset and exhibits comparable performance on standard normal light datasets. The code and dataset will be released.


title: LoopGaussian: Creating 3D Cinemagraph with Multi-view Images via Eulerian Motion Field

abstract: Cinemagraph is a unique form of visual media that combines elements of still photography and subtle motion to create a captivating experience. However, the majority of videos generated by recent works lack depth information and are confined to the constraints of 2D image space. In this paper, inspired by significant progress in the field of novel view synthesis (NVS) achieved by 3D Gaussian Splatting (3D-GS), we propose LoopGaussian to elevate cinemagraph from 2D image space to 3D space using 3D Gaussian modeling. To achieve this, we first employ the 3D-GS method to reconstruct 3D Gaussian point clouds from multi-view images of static scenes,incorporating shape regularization terms to prevent blurring or artifacts caused by object deformation. We then adopt an autoencoder tailored for 3D Gaussian to project it into feature space. To maintain the local continuity of the scene, we devise SuperGaussian for clustering based on the acquired features. By calculating the similarity between clusters and employing a two-stage estimation method, we derive an Eulerian motion field to describe velocities across the entire scene. The 3D Gaussian points then move within the estimated Eulerian motion field. Through bidirectional animation techniques, we ultimately generate a 3D Cinemagraph that exhibits natural and seamlessly loopable dynamics. Experiment results validate the effectiveness of our approach, demonstrating high-quality and visually appealing scene generation. The project is available at https://pokerlishao.github.io/LoopGaussian/.


title: Beam Management in Low Earth Orbit Satellite Communication With Handover Frequency Control and Satellite-Terrestrial Spectrum Sharing

abstract: To achieve ubiquitous wireless connectivity, low earth orbit (LEO) satellite networks have drawn much attention. However, effective beam management is challenging due to time-varying cell load, high dynamic network topology, and complex interference situations. In this paper, under inter-satellite handover frequency and satellite-terrestrial/inter-beam interference constraints, we formulate a practical beam management problem, aiming to maximize the long-term service satisfaction of cells. Particularly, Lyapunov framework is leveraged to equivalently transform the primal problem into multiple single epoch optimization problems, where virtual queue stability constraints replace inter-satellite handover frequency constraints. Since each single epoch problem is NP-hard, we further decompose it into three subproblems, including inter-satellite handover decision, beam hopping design and satellite-terrestrial spectrum sharing. First, a proactive inter-satellite handover mechanism is developed to balance handover frequency and satellite loads. Subsequently, a beam hopping design algorithm is presented based on conflict graphs to achieve interference mitigation among beams, and then a flexible satellite-terrestrial spectrum sharing algorithm is designed to satisfy the demands of beam cells and improve spectral efficiency. Simulation results show that our proposal significantly improves service satisfaction compared with baselines, where the average data queue length of beam cells is reduced by over 50% with affordable handover frequency.


title: MCPNet: An Interpretable Classifier via Multi-Level Concept Prototypes

abstract: Recent advancements in post-hoc and inherently interpretable methods have markedly enhanced the explanations of black box classifier models. These methods operate either through post-analysis or by integrating concept learning during model training. Although being effective in bridging the semantic gap between a model's latent space and human interpretation, these explanation methods only partially reveal the model's decision-making process. The outcome is typically limited to high-level semantics derived from the last feature map. We argue that the explanations lacking insights into the decision processes at low and mid-level features are neither fully faithful nor useful. Addressing this gap, we introduce the Multi-Level Concept Prototypes Classifier (MCPNet), an inherently interpretable model. MCPNet autonomously learns meaningful concept prototypes across multiple feature map levels using Centered Kernel Alignment (CKA) loss and an energy-based weighted PCA mechanism, and it does so without reliance on predefined concept labels. Further, we propose a novel classifier paradigm that learns and aligns multi-level concept prototype distributions for classification purposes via Class-aware Concept Distribution (CCD) loss. Our experiments reveal that our proposed MCPNet while being adaptable to various model architectures, offers comprehensive multi-level explanations while maintaining classification accuracy. Additionally, its concept distribution-based classification approach shows improved generalization capabilities in few-shot classification scenarios.


title: Concentration properties of fractional posterior in 1-bit matrix completion

abstract: The problem of estimating a matrix based on a set of its observed entries is commonly referred to as the matrix completion problem. In this work, we specifically address the scenario of binary observations, often termed as 1-bit matrix completion. While numerous studies have explored Bayesian and frequentist methods for real-value matrix completion, there has been a lack of theoretical exploration regarding Bayesian approaches in 1-bit matrix completion. We tackle this gap by considering a general, non-uniform sampling scheme and providing theoretical assurances on the efficacy of the fractional posterior. Our contributions include obtaining concentration results for the fractional posterior and demonstrating its effectiveness in recovering the underlying parameter matrix. We accomplish this using two distinct types of prior distributions: low-rank factorization priors and a spectral scaled Student prior, with the latter requiring fewer assumptions. Importantly, our results exhibit an adaptive nature by not mandating prior knowledge of the rank of the parameter matrix. Our findings are comparable to those found in the frequentist literature, yet demand fewer restrictive assumptions.


title: Fast Gradient Computation for Gromov-Wasserstein Distance

abstract: The Gromov-Wasserstein distance is a notable extension of optimal transport. In contrast to the classic Wasserstein distance, it solves a quadratic assignment problem that minimizes the pair-wise distance distortion under the transportation of distributions and thus could apply to distributions in different spaces. These properties make Gromov-Wasserstein widely applicable to many fields, such as computer graphics and machine learning. However, the computation of the Gromov-Wasserstein distance and transport plan is expensive. The well-known Entropic Gromov-Wasserstein approach has a cubic complexity since the matrix multiplication operations need to be repeated in computing the gradient of Gromov-Wasserstein loss. This becomes a key bottleneck of the method. Currently, existing methods accelerate the computation focus on sampling and approximation, which leads to low accuracy or incomplete transport plan. In this work, we propose a novel method to accelerate accurate gradient computation by dynamic programming techniques, reducing the complexity from cubic to quadratic. In this way, the original computational bottleneck is broken and the new entropic solution can be obtained with total quadratic time, which is almost optimal complexity. Furthermore, it can be extended to some variants easily. Extensive experiments validate the efficiency and effectiveness of our method.


title: Mass spectrum of fully charmed $[cc][\bar c\bar c]$ tetraquarks

abstract: There are three $S$ and seven $P$ fully charmed $[cc][\bar c\bar c]$ tetraquarks, the mass spectrum from $1S$ to $2P$ excitations is calculated in a non-relativistic quark potential model. In the calculation, the interactions among four internal quarks/antiquark are approximated as a dominant color interaction between a diquark and an antidiquark, and a residual interaction responsible for the diquark/antidiquark cluster effect. The color interaction between the diquark and the antidiquark is characterized by the conventional Cornell potential, while the residual interaction is modeled as the Yukawa-type scalar $\sigma$ and vector $\omega$ boson exchange potentials. In the numerical results, though the scalar $\sigma$ and vector $\omega$ boson exchange interactions reduce the masses of $S-$wave $[cc][\bar c\bar c]$ tetraquarks $40-50$ MeV, they contribute to the masses of other $[cc][\bar c\bar c]$ tetraquarks small. The mass splittings of $[cc][\bar c\bar c]$ tetraquarks between different multiplets and within the same multiplet are smaller than those in charmonium, and the splittings are affected by the scalar $\sigma$ or vector $\omega$ boson exchange interactions small. Our calculations suggest that the observed $X(6600)$, $X(6900)$ and $X(7300)$ should be different radial excitations of $[cc][\bar c\bar c]$. The measurements of the $J^{PC}$ quantum numbers and the mass splittings will be helpful to identify and understand of the $[cc][\bar c\bar c]$ candidates.


title: Improved Approximations for Flexible Network Design

abstract: Flexible network design deals with building a network that guarantees some connectivity requirements between its vertices, even when some of its elements (like vertices or edges) fail. In particular, the set of edges (resp. vertices) of a given graph are here partitioned into safe and unsafe. The goal is to identify a minimum size subgraph that is 2-edge-connected (resp. 2-vertex-connected), and stay so whenever any of the unsafe elements gets removed. In this paper, we provide improved approximation algorithms for flexible network design problems, considering both edge-connectivity and vertex-connectivity, as well as connectivity values higher than 2. For the vertex-connectivity variant, in particular, our algorithm is the first with approximation factor strictly better than 2.


title: PraFFL: A Preference-Aware Scheme in Fair Federated Learning

abstract: Fairness in federated learning has emerged as a critical concern, aiming to develop an unbiased model for any special group (e.g., male or female) of sensitive features. However, there is a trade-off between model performance and fairness, i.e., improving fairness will decrease model performance. Existing approaches have characterized such a trade-off by introducing hyperparameters to quantify client's preferences for fairness and model performance. Nevertheless, these methods are limited to scenarios where each client has only a single pre-defined preference. In practical systems, each client may simultaneously have multiple preferences for the model performance and fairness. The key challenge is to design a method that allows the model to adapt to diverse preferences of each client in real time. To this end, we propose a Preference-aware scheme in Fair Federated Learning paradigm (called PraFFL). PraFFL can adaptively adjust the model based on each client's preferences to meet their needs. We theoretically prove that PraFFL can provide the optimal model for client's arbitrary preferences. Experimental results show that our proposed PraFFL outperforms five existing fair federated learning algorithms in terms of the model's capability in adapting to clients' different preferences.


title: OOVs in the Spotlight: How to Inflect them?

abstract: We focus on morphological inflection in out-of-vocabulary (OOV) conditions, an under-researched subtask in which state-of-the-art systems usually are less effective. We developed three systems: a retrograde model and two sequence-to-sequence (seq2seq) models based on LSTM and Transformer. For testing in OOV conditions, we automatically extracted a large dataset of nouns in the morphologically rich Czech language, with lemma-disjoint data splits, and we further manually annotated a real-world OOV dataset of neologisms. In the standard OOV conditions, Transformer achieves the best results, with increasing performance in ensemble with LSTM, the retrograde model and SIGMORPHON baselines. On the real-world OOV dataset of neologisms, the retrograde model outperforms all neural models. Finally, our seq2seq models achieve state-of-the-art results in 9 out of 16 languages from SIGMORPHON 2022 shared task data in the OOV evaluation (feature overlap) in the large data condition. We release the Czech OOV Inflection Dataset for rigorous evaluation in OOV conditions. Further, we release the inflection system with the seq2seq models as a ready-to-use Python library.


title: Uncovering the first-infall history of the LMC through its dynamical impact in the Milky Way halo

abstract: The gravitational interactions between the LMC and the Milky Way can give rise to dynamical perturbations in the MW halo, leading to a biased distribution of stellar density and other kinematic signals. These disequilibrium phenomena exhibit variations under different parameter combinations of the MW-LMC model. In this work, we run 50 high-resolution N-body simulations spanning different masses and halo shapes of the Milky Way and LMC and investigate how the LMC-induced perturbations evolve with these model parameters. We measure the magnitude of kinematic perturbations from the mean velocities of simulated halo stars and identify a discontinuity between the first-infall and second-passage scenarios of the LMC's orbital history. We demonstrate that, due to the short dynamical times of the Galactic inner halo, the reduced perturbation magnitude in the second-passage scenario is mainly a result of the LMC's second infall into the MW, which starts at a much lower velocity relative to the inner halo compared to the first-infall scenario. Using a subset of $\sim 1200$ RR Lyrae stars located in the outer halo ($50 \leq R_{\mathrm{GC}} < 100$ kpc), which are selected from a larger sample of 135,873 RR Lyrae stars with precise distance estimates from Gaia, we find the mean latitudinal velocity ($v_{b}$) in the heliocentric frame to be $\langle v_{b} \rangle = 30.8 \pm 4.0$ km/s. The observation contradicts the second-passage scenario and supports the first-infall scenario with a massive LMC ($\sim 2.1 \times 10^{11} \mathrm{M}_{\odot}$) at infall, an oblate MW halo with a virial mass $M_{200} < 1.4 \times 10^{12} \mathrm{M}_{\odot}$ and a flattening parameter $q > 0.7$.


title: Degrees of Freedom for Radiating Systems

abstract: Electromagnetic degrees of freedom are instrumental in antenna design, wireless communications, imaging, and scattering. Larger number of degrees of freedom enhances control in antenna design, influencing radiation patterns and directivity, while in communication systems, it links to spatial channels for increased data rates and reliability, and resolution in imaging. The correlation between computed degrees of freedom and physical quantities is not fully understood, prompting a comparison between classical estimates, Weyl's law, modal expansions, and optimization techniques. In this paper, it is shown that NDoF for arbitrary shaped radiating structures approaches the shadow area measured in squared wavelengths.


title: RoNID: New Intent Discovery with Generated-Reliable Labels and Cluster-friendly Representations

abstract: New Intent Discovery (NID) strives to identify known and reasonably deduce novel intent groups in the open-world scenario. But current methods face issues with inaccurate pseudo-labels and poor representation learning, creating a negative feedback loop that degrades overall model performance, including accuracy and the adjusted rand index. To address the aforementioned challenges, we propose a Robust New Intent Discovery (RoNID) framework optimized by an EM-style method, which focuses on constructing reliable pseudo-labels and obtaining cluster-friendly discriminative representations. RoNID comprises two main modules: reliable pseudo-label generation module and cluster-friendly representation learning module. Specifically, the pseudo-label generation module assigns reliable synthetic labels by solving an optimal transport problem in the E-step, which effectively provides high-quality supervised signals for the input of the cluster-friendly representation learning module. To learn cluster-friendly representation with strong intra-cluster compactness and large inter-cluster separation, the representation learning module combines intra-cluster and inter-cluster contrastive learning in the M-step to feed more discriminative features into the generation module. RoNID can be performed iteratively to ultimately yield a robust model with reliable pseudo-labels and cluster-friendly representations. Experimental results on multiple benchmarks demonstrate our method brings substantial improvements over previous state-of-the-art methods by a large margin of +1~+4 points.


title: Incremental Residual Concept Bottleneck Models

abstract: Concept Bottleneck Models (CBMs) map the black-box visual representations extracted by deep neural networks onto a set of interpretable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making process. Multimodal pre-trained models can match visual representations with textual concept embeddings, allowing for obtaining the interpretable concept bottleneck without the expertise concept annotations. Recent research has focused on the concept bank establishment and the high-quality concept selection. However, it is challenging to construct a comprehensive concept bank through humans or large language models, which severely limits the performance of CBMs. In this work, we propose the Incremental Residual Concept Bottleneck Model (Res-CBM) to address the challenge of concept completeness. Specifically, the residual concept bottleneck model employs a set of optimizable vectors to complete missing concepts, then the incremental concept discovery module converts the complemented vectors with unclear meanings into potential concepts in the candidate concept bank. Our approach can be applied to any user-defined concept bank, as a post-hoc processing method to enhance the performance of any CBMs. Furthermore, to measure the descriptive efficiency of CBMs, the Concept Utilization Efficiency (CUE) metric is proposed. Experiments show that the Res-CBM outperforms the current state-of-the-art methods in terms of both accuracy and efficiency and achieves comparable performance to black-box models across multiple datasets.


title: BG-YOLO: A Bidirectional-Guided Method for Underwater Object Detection

abstract: Degraded underwater images decrease the accuracy of underwater object detection. However, existing methods for underwater image enhancement mainly focus on improving the indicators in visual aspects, which may not benefit the tasks of underwater image detection, and may lead to serious degradation in performance. To alleviate this problem, we proposed a bidirectional-guided method for underwater object detection, referred to as BG-YOLO. In the proposed method, network is organized by constructing an enhancement branch and a detection branch in a parallel way. The enhancement branch consists of a cascade of an image enhancement subnet and an object detection subnet. And the detection branch only consists of a detection subnet. A feature guided module connects the shallow convolution layer of the two branches. When training the enhancement branch, the object detection subnet in the enhancement branch guides the image enhancement subnet to be optimized towards the direction that is most conducive to the detection task. The shallow feature map of the trained enhancement branch will be output to the feature guided module, constraining the optimization of detection branch through consistency loss and prompting detection branch to learn more detailed information of the objects. And hence the detection performance will be refined. During the detection tasks, only detection branch will be reserved so that no additional cost of computation will be introduced. Extensive experiments demonstrate that the proposed method shows significant improvement in performance of the detector in severely degraded underwater scenes while maintaining a remarkable detection speed.


title: Stability and Generalization in Free Adversarial Training

abstract: While adversarial training methods have resulted in significant improvements in the deep neural nets' robustness against norm-bounded adversarial perturbations, their generalization performance from training samples to test data has been shown to be considerably worse than standard empirical risk minimization methods. Several recent studies seek to connect the generalization behavior of adversarially trained classifiers to various gradient-based min-max optimization algorithms used for their training. In this work, we study the generalization performance of adversarial training methods using the algorithmic stability framework. Specifically, our goal is to compare the generalization performance of the vanilla adversarial training scheme fully optimizing the perturbations at every iteration vs. the free adversarial training simultaneously optimizing the norm-bounded perturbations and classifier parameters. Our proven generalization bounds indicate that the free adversarial training method could enjoy a lower generalization gap between training and test samples due to the simultaneous nature of its min-max optimization algorithm. We perform several numerical experiments to evaluate the generalization performance of vanilla, fast, and free adversarial training methods. Our empirical findings also show the improved generalization performance of the free adversarial training method and further demonstrate that the better generalization result could translate to greater robustness against black-box attack schemes. The code is available at https://github.com/Xiwei-Cheng/Stability_FreeAT.


title: Fast Fishing: Approximating BAIT for Efficient and Scalable Deep Active Image Classification

abstract: Deep active learning (AL) seeks to minimize the annotation costs for training deep neural networks. BAIT, a recently proposed AL strategy based on the Fisher Information, has demonstrated impressive performance across various datasets. However, BAIT's high computational and memory requirements hinder its applicability on large-scale classification tasks, resulting in current research neglecting BAIT in their evaluation. This paper introduces two methods to enhance BAIT's computational efficiency and scalability. Notably, we significantly reduce its time complexity by approximating the Fisher Information. In particular, we adapt the original formulation by i) taking the expectation over the most probable classes, and ii) constructing a binary classification task, leading to an alternative likelihood for gradient computations. Consequently, this allows the efficient use of BAIT on large-scale datasets, including ImageNet. Our unified and comprehensive evaluation across a variety of datasets demonstrates that our approximations achieve strong performance with considerably reduced time complexity. Furthermore, we provide an extensive open-source toolbox that implements recent state-of-the-art AL strategies, available at https://github.com/dhuseljic/dal-toolbox.


title: Correlation between the charge radii difference in mirror partner nuclei and the symmetry energy slope

abstract: A correlation between the charge radii difference of mirror partner nuclei $\Delta{R_{\mathrm{ch}}}$ and the slope parameter $L$ of symmetry energy has been built to ascertain the equation of state of isospin asymmetric nuclear matter. In this work, the influences of pairing correlations and isoscalar compression modulus on the \Delta{R_{\mathrm{ch}}}$ are systematically investigated based on the Skyrme energy density functional theory. The calculated results suggest that the linear correlation between $\Delta{R_{\mathrm{ch}}}$ and $L$ is decreased by the surface pairing correlations. The slope parameter deduced from the difference of charge radii of mirror-pair nuclei $^{32}$Ar-$^{32}$Si, $^{36}$Ca-$^{36}$S, $^{38}$Ca-$^{38}$Ar, and $^{54}$Ni-$^{54}$Fe falls into the range of $L=42.57$-$50.64$ MeV, that is, the rather soft equation of state of asymmetric nuclear matter. Besides, the range of the slope parameter can also be influenced by the effective forces classified by various isoscalar incompressibility coefficients.


title: Nonvanishing derived limits without scales

abstract: The derived functors $\lim^n$ of the inverse limit are widely studied for their topological applications, among which are some repercussions on the additivity of strong homology. Set theory has proven useful in dealing with these functors, for instance in the case of the inverse system $\mathbf{A}$ of abelian groups indexed by ${}^\omega \omega$. So far, consistency results for nonvanishing derived limits of $\mathbf{A}$ have always assumed the existence of a scale (i.e. a linear cofinal subset of $({}^\omega \omega, \leq^\ast )$, or equivalently that $\mathfrak{b} = \mathfrak{d} $). Here we do away with that assumption and prove that nonvanishing derived limits, and hence the non-additivity of strong homology, are consistent with any value of $\aleph_1 \leq \mathfrak{b} \leq \mathfrak{d} < \aleph_\omega$, thus giving a partial answer to a question of Bannister.


title: Long run consequence of p-hacking

abstract: We study the theoretical consequence of p-hacking on the accumulation of knowledge under the framework of mis-specified Bayesian learning. A sequence of researchers, in turn, choose projects that generate noisy information in a field. In choosing projects, researchers need to carefully balance as projects generates big information are less likely to succeed. In doing the project, a researcher p-hacks at intensity $\varepsilon$ so that the success probability of a chosen project increases (unduly) by a constant $\varepsilon$. In interpreting previous results, researcher behaves as if there is no p-hacking because the intensity $\varepsilon$ is unknown and presumably small. We show that over-incentivizing information provision leads to the failure of learning as long as $\varepsilon\neq 0$. If the incentives of information provision is properly provided, learning is correct almost surely as long as $\varepsilon$ is small.


title: Intuition-aware Mixture-of-Rank-1-Experts for Parameter Efficient Finetuning

abstract: Large Language Models (LLMs) have demonstrated significant potential in performing multiple tasks in multimedia applications, ranging from content generation to interactive entertainment, and artistic creation. However, the diversity of downstream tasks in multitask scenarios presents substantial adaptation challenges for LLMs. While traditional methods often succumb to knowledge confusion on their monolithic dense models, Mixture-of-Experts (MoE) has been emerged as a promising solution with its sparse architecture for effective task decoupling. Inspired by the principles of human cognitive neuroscience, we design a novel framework \texttt{Intuition-MoR1E} that leverages the inherent semantic clustering of instances to mimic the human brain to deal with multitask, offering implicit guidance to router for optimized feature allocation. Moreover, we introduce cutting-edge Rank-1 Experts formulation designed to manage a spectrum of intuitions, demonstrating enhanced parameter efficiency and effectiveness in multitask LLM finetuning. Extensive experiments demonstrate that Intuition-MoR1E achieves superior efficiency and 2.15\% overall accuracy improvement across 14 public datasets against other state-of-the-art baselines.


title: Airship Formations for Animal Motion Capture and Behavior Analysis

abstract: Using UAVs for wildlife observation and motion capture offers manifold advantages for studying animals in the wild, especially grazing herds in open terrain. The aerial perspective allows observation at a scale and depth that is not possible on the ground, offering new insights into group behavior. However, the very nature of wildlife field-studies puts traditional fixed wing and multi-copter systems to their limits: limited flight time, noise and safety aspects affect their efficacy, where lighter than air systems can remain on station for many hours. Nevertheless, airships are challenging from a ground handling perspective as well as from a control point of view, being voluminous and highly affected by wind. In this work, we showcase a system designed to use airship formations to track, follow, and visually record wild horses from multiple angles, including airship design, simulation, control, on board computer vision, autonomous operation and practical aspects of field experiments.


title: On the critical path to implant backdoors and the effectiveness of potential mitigation techniques: Early learnings from XZ

abstract: An emerging supply-chain attack due to a backdoor in XZ Utils has been identified. The backdoor allows an attacker to run commands remotely on vulnerable servers utilizing SSH without prior authentication. We have started to collect available information with regards to this attack to discuss current mitigation strategies for such kinds of supply-chain attacks. This paper introduces the critical attack path of the XZ backdoor and provides an overview about potential mitigation techniques related to relevant stages of the attack path.


title: Ferroelectrovalley in Two-Dimensional Multiferroic Lattices

abstract: Engineering valley index is essential and highly sought for valley physics, but currently it is exclusively based on the paradigm of the challenging ferrovalley with spin-orientation reversal under magnetic field. Here, an alternative strategy, i.e., the so-called ferroelectrovalley, is proposed to tackle the insurmountable spin-orientation reversal, which reveres valley index with the feasible ferroelectricity. Using symmetry arguments and tight-binding model, the C_2 rotation is unveiled to be able to take the place of time reversal for operating valley index in two-dimensional multiferroic kagome lattices, which enables the ferroelectricity-engineered valley index, thereby generating the concept of ferroelectrovalley. Based on first-principles calculations, this concept is further demonstrated in the breathing kagome lattice of single-layer Ti3Br8, wherein ferroelectricity couples the breathing process. These findings open a new direction for valleytronics and two-dimensional materials research.


title: High order homoclinic tangencies of corank 2

abstract: We prove that in the space of $C^r$ maps $(r=2,\ldots,\infty,\omega)$ of a smooth manifold of dimension at least 4 there exist open regions where maps with infinitely many corank-2 homoclinic tangencies of all orders are dense. The result is applied to show the existence of maps with universal two-dimensional dynamics, i.e. maps whose iterations approximate the dynamics of every map of a two-dimensional disk with an arbitrarily good accuracy. We show that maps with universal two-dimensional dynamics are $C^r$-generic in the regions under consideration.


title: A Fourier-enhanced multi-modal 3D small object optical mark recognition and positioning method for percutaneous abdominal puncture surgical navigation

abstract: Navigation for thoracoabdominal puncture surgery is used to locate the needle entry point on the patient's body surface. The traditional reflective ball navigation method is difficult to position the needle entry point on the soft, irregular, smooth chest and abdomen. Due to the lack of clear characteristic points on the body surface using structured light technology, it is difficult to identify and locate arbitrary needle insertion points. Based on the high stability and high accuracy requirements of surgical navigation, this paper proposed a novel method, a muti-modal 3D small object medical marker detection method, which identifies the center of a small single ring as the needle insertion point. Moreover, this novel method leverages Fourier transform enhancement technology to augment the dataset, enrich image details, and enhance the network's capability. The method extracts the Region of Interest (ROI) of the feature image from both enhanced and original images, followed by generating a mask map. Subsequently, the point cloud of the ROI from the depth map is obtained through the registration of ROI point cloud contour fitting. In addition, this method employs Tukey loss for optimal precision. The experimental results show this novel method proposed in this paper not only achieves high-precision and high-stability positioning, but also enables the positioning of any needle insertion point.


title: Business models for the simulation hypothesis

abstract: The simulation hypothesis suggests that we live in a computer simulation. That notion has attracted significant scholarly and popular interest. This article explores the simulation hypothesis from a business perspective. Due to the lack of a name for a universe consistent with the simulation hypothesis, we propose the term simuverse. We argue that if we live in a simulation, there must be a business justification. Therefore, we ask: If we live in a simuverse, what is its business model? We identify and explore business model scenarios, such as simuverse as a project, service, or platform. We also explore business model pathways and risk management issues. The article contributes to the simulation hypothesis literature and is the first to provide a business model perspective on the simulation hypothesis. The article discusses theoretical and practical implications and identifies opportunities for future research related to sustainability, digital transformation, and Artificial Intelligence (AI).


title: A water structure indicator suitable for generic contexts: two-liquid behavior at hydration and nanoconfinement conditions and a molecular approach to hydrophobicity and wetting

abstract: In a recent work we have briefly introduced a new structural index for water that, unlike previous indicators, was devised specifically for generic contexts beyond bulk conditions, making it suitable for hydration and nanoconfinement settings. In this work we shall study this metric in detail, demonstrating its ability to reveal the existence of a fine-tuned interplay between local structure and energetics in liquid water. This molecular principle enables the establishment of an extended hydrogen bond network, while simultaneously allowing for the existence of network defects by compensating for uncoordinated sites. By studying different water models and different temperatures encompassing both the normal liquid and the supercooled regime, this molecular mechanism will be shown to underlie the two-state behavior of bulk water. Additionally, by studying functionalized self-assembled monolayers and diverse graphene-like surfaces, we shall show that this principle is also operative at hydration and nanoconfinement conditions, thus generalizing the validity of the two-liquids scenario of water to these contexts. This approach will allow us to define conditions for wettability, providing an accurate measure of hydrophobicity and a reliable predictor of filling and drying transitions. Hence, it might open the possibility of elucidating the active role of water in broad fields of biophysics and materials science. As a preliminary step, we shall study the hydration structure and hydrophilicity of graphene-like systems (parallel graphene sheets and carbon nanotubes) as a function of the confinement dimensionality. FOR A PROGRAMMING CODE TO IMPLEMENT V4s, PLEASE GO TO: https://github.com/nicolas-loubet/V4S


title: A Machine Learning Approach for Optimizing Hybrid Quantum Noise Clusters for Gaussian Quantum Channel Capacity

abstract: This work contributes to the advancement of quantum communication by visualizing hybrid quantum noise in higher dimensions and optimizing the capacity of the quantum channel by using machine learning (ML). Employing the expectation maximization (EM) algorithm, the quantum channel parameters are iteratively adjusted to estimate the channel capacity, facilitating the categorization of quantum noise data in higher dimensions into a finite number of clusters. In contrast to previous investigations that represented the model in lower dimensions, our work describes the quantum noise as a Gaussian Mixture Model (GMM) with mixing weights derived from a Poisson distribution. The objective was to model the quantum noise using a finite mixture of Gaussian components while preserving the mixing coefficients from the Poisson distribution. Approximating the infinite Gaussian mixture with a finite number of components makes it feasible to visualize clusters of quantum noise data without modifying the original probability density function. By implementing the EM algorithm, the research fine-tuned the channel parameters, identified optimal clusters, improved channel capacity estimation, and offered insights into the characteristics of quantum noise within an ML framework.


title: Interferometer measurements in interstellar communications: methods and observations

abstract: Extraterrestrial communication signals are hypothesized to be present in an extensive search space. Using principles of communication theory and system design, methods are studied and implemented to reduce the signal search space, while considering intentional transmitter detectability. The design and observational work reported in this paper adds material to previous related reports. (ref. arXiv:2105.03727, arXiv:2106.10168, arXiv:2202.12791, arXiv:2203.10065). In the current work, a two-element radio interferometer telescope and receiver algorithms are utilized to perform differential angle-of-arrival and multi-bandwidth measurements of delta-t delta-f polarized pulse pairs. The system enhances extraterrestrial signal detectability, while reducing signal false positives caused by noise and radio frequency interference. Statistical analysis utilizes a Right Ascension filter spanning celestial coordinate ranges that include the previously determined anomalous celestial direction: 5.25 +- 0.15 hr Right Ascension, -7.6 degrees +- 1 degree Declination. Observations were conducted during a duration of 61 days, comprising 244 hours of interferometer measurements.


title: Beyond Known Clusters: Probe New Prototypes for Efficient Generalized Class Discovery

abstract: Generalized Class Discovery (GCD) aims to dynamically assign labels to unlabelled data partially based on knowledge learned from labelled data, where the unlabelled data may come from known or novel classes. The prevailing approach generally involves clustering across all data and learning conceptions by prototypical contrastive learning. However, existing methods largely hinge on the performance of clustering algorithms and are thus subject to their inherent limitations. Firstly, the estimated cluster number is often smaller than the ground truth, making the existing methods suffer from the lack of prototypes for comprehensive conception learning. To address this issue, we propose an adaptive probing mechanism that introduces learnable potential prototypes to expand cluster prototypes (centers). As there is no ground truth for the potential prototype, we develop a self-supervised prototype learning framework to optimize the potential prototype in an end-to-end fashion. Secondly, clustering is computationally intensive, and the conventional strategy of clustering both labelled and unlabelled instances exacerbates this issue. To counteract this inefficiency, we opt to cluster only the unlabelled instances and subsequently expand the cluster prototypes with our introduced potential prototypes to fast explore novel classes. Despite the simplicity of our proposed method, extensive empirical analysis on a wide range of datasets confirms that our method consistently delivers state-of-the-art results. Specifically, our method surpasses the nearest competitor by a significant margin of 9.7% within the Stanford Cars dataset and 12x clustering efficiency within the Herbarium 19 dataset. We will make the code and checkpoints publicly available at https://github.com/xjtuYW/PNP.git.


title: On the Symmetric Tensors Completion Problem

abstract: The aim of this elaborate is presenting the classical symmetric tensors completion problem to an audience of graduate students. As main studying tool, we will introduce the theory of hypergraph rigidity which naturally mirrors the problem itself. This has already appeared in literature: in 2023, Cruicksand, Mohammadi, Nixon, and Tanigawa introduced organically the theory of hypergraph rigidity, as a generalization of the usual Euclidean rigidity, and showed how it can be used to mirror several different theoretical problems, including tensor completion.


title: Labeled Morphological Segmentation with Semi-Markov Models

abstract: We present labeled morphological segmentation, an alternative view of morphological processing that unifies several tasks. From an annotation standpoint, we additionally introduce a new hierarchy of morphotactic tagsets. Finally, we develop \modelname, a discriminative morphological segmentation system that, contrary to previous work, explicitly models morphotactics. We show that \textsc{chipmunk} yields improved performance on three tasks for all six languages: (i) morphological segmentation, (ii) stemming and (iii) morphological tag classification. On morphological segmentation, our method shows absolute improvements of 2--6 points $F_1$ over the baseline.


title: Dual-comb mode-locked Yb:CALGO laser based on cavity-shared configuration with separated end mirrors

abstract: Dual-comb spectroscopy typically requires the utilization of two independent and phase-locked femtosecond lasers, resulting in a complex and expensive system that hinders its industrial applications. Single-cavity dual-comb lasers are considered as one of the primary solution to simplify the system. However, controlling the crucial parameter of difference in repetition rates remains challenging. In this study, we present a dual-comb mode-locked Yb:CALGO laser based on a cavity-shared configuration with separated end mirrors. We employ two pairs of end mirrors and two thin-film polarizers angled at 45 degrees to the cavity axis, leading to separating the cross-polarized laser modes. We achieve simultaneous operation of two combs at approximately 1040 nm with pulse durations of around 400 fs and an average power exceeding 1 W. The repetition rates are approximately 59 MHz and their difference can be easily tuned from zero up to the MHz range. By effectively canceling out common mode noises, we observe minimal fluctuation in the repetition rate difference with a standard deviation of about 1.9 Hz over ten minutes, while experiencing fluctuations in repetition rates as large as 90 Hz. We demonstrate the capabilities of this system by utilizing the free-running dual-comb setup for asynchronous optical sampling on a saturable absorber and measuring etalon transmission spectrum. This system allows for simple and independent control of the repetition rates and their difference during operation, facilitating the selection of optimal repetition rate difference and implementation of phase-locking loops. This advancement paves the way for the development of simple yet high-performance dual-comb laser sources.


title: Status of Electromagnetic Accelerating Universe

abstract: To describe the dark side of the Universe, we adopt a novel approach where dark energy is explained as an electrically charged majority of dark matter. Dark energy, as such, does not exist. The Friedmann equation at the present time coincides with that in a conventional approach, although the cosmological "constant" in the Electromagnetic Accelerating Universe (EAU) Model shares a time dependence with the matter component. Its equation of state is $\omega \equiv P/\rho \equiv -1$ within observational accuracy.


title: MaSkel: A Model for Human Whole-body X-rays Generation from Human Masking Images

abstract: The human whole-body X-rays could offer a valuable reference for various applications, including medical diagnostics, digital animation modeling, and ergonomic design. The traditional method of obtaining X-ray information requires the use of CT (Computed Tomography) scan machines, which emit potentially harmful radiation. Thus it faces a significant limitation for realistic applications because it lacks adaptability and safety. In our work, We proposed a new method to directly generate the 2D human whole-body X-rays from the human masking images. The predicted images will be similar to the real ones with the same image style and anatomic structure. We employed a data-driven strategy. By leveraging advanced generative techniques, our model MaSkel(Masking image to Skeleton X-rays) could generate a high-quality X-ray image from a human masking image without the need for invasive and harmful radiation exposure, which not only provides a new path to generate highly anatomic and customized data but also reduces health risks. To our knowledge, our model MaSkel is the first work for predicting whole-body X-rays. In this paper, we did two parts of the work. The first one is to solve the data limitation problem, the diffusion-based techniques are utilized to make a data augmentation, which provides two synthetic datasets for preliminary pretraining. Then we designed a two-stage training strategy to train MaSkel. At last, we make qualitative and quantitative evaluations of the generated X-rays. In addition, we invite some professional doctors to assess our predicted data. These evaluations demonstrate the MaSkel's superior ability to generate anatomic X-rays from human masking images. The related code and links of the dataset are available at https://github.com/2022yingjie/MaSkel.


title: Smart Help: Strategic Opponent Modeling for Proactive and Adaptive Robot Assistance in Households

abstract: Despite the significant demand for assistive technology among vulnerable groups (e.g., the elderly, children, and the disabled) in daily tasks, research into advanced AI-driven assistive solutions that genuinely accommodate their diverse needs remains sparse. Traditional human-machine interaction tasks often require machines to simply help without nuanced consideration of human abilities and feelings, such as their opportunity for practice and learning, sense of self-improvement, and self-esteem. Addressing this gap, we define a pivotal and novel challenge Smart Help, which aims to provide proactive yet adaptive support to human agents with diverse disabilities and dynamic goals in various tasks and environments. To establish this challenge, we leverage AI2-THOR to build a new interactive 3D realistic household environment for the Smart Help task. We introduce an innovative opponent modeling module that provides a nuanced understanding of the main agent's capabilities and goals, in order to optimize the assisting agent's helping policy. Rigorous experiments validate the efficacy of our model components and show the superiority of our holistic approach against established baselines. Our findings illustrate the potential of AI-imbued assistive robots in improving the well-being of vulnerable groups.


title: WikiSplit++: Easy Data Refinement for Split and Rephrase

abstract: The task of Split and Rephrase, which splits a complex sentence into multiple simple sentences with the same meaning, improves readability and enhances the performance of downstream tasks in natural language processing (NLP). However, while Split and Rephrase can be improved using a text-to-text generation approach that applies encoder-decoder models fine-tuned with a large-scale dataset, it still suffers from hallucinations and under-splitting. To address these issues, this paper presents a simple and strong data refinement approach. Here, we create WikiSplit++ by removing instances in WikiSplit where complex sentences do not entail at least one of the simpler sentences and reversing the order of reference simple sentences. Experimental results show that training with WikiSplit++ leads to better performance than training with WikiSplit, even with fewer training instances. In particular, our approach yields significant gains in the number of splits and the entailment ratio, a proxy for measuring hallucinations.


title: THQA: A Perceptual Quality Assessment Database for Talking Heads

abstract: In the realm of media technology, digital humans have gained prominence due to rapid advancements in computer technology. However, the manual modeling and control required for the majority of digital humans pose significant obstacles to efficient development. The speech-driven methods offer a novel avenue for manipulating the mouth shape and expressions of digital humans. Despite the proliferation of driving methods, the quality of many generated talking head (TH) videos remains a concern, impacting user visual experiences. To tackle this issue, this paper introduces the Talking Head Quality Assessment (THQA) database, featuring 800 TH videos generated through 8 diverse speech-driven methods. Extensive experiments affirm the THQA database's richness in character and speech features. Subsequent subjective quality assessment experiments analyze correlations between scoring results and speech-driven methods, ages, and genders. In addition, experimental results show that mainstream image and video quality assessment methods have limitations for the THQA database, underscoring the imperative for further research to enhance TH video quality assessment. The THQA database is publicly accessible at https://github.com/zyj-2000/THQA.


title: Countably compact extensions and cardinal characteristics of the continuum

abstract: In this paper we show that the existence of certain first-countable compact-like extensions is equivalent to the equality between corresponding cardinal characteristics of the continuum. For instance, $\mathfrak b=\mathfrak s=\mathfrak c$ if and only if every regular first-countable space of weight $< \mathfrak c$ can be densely embedded into a regular first-countable countably compact space.


title: Proof-of-Learning with Incentive Security

abstract: Most concurrent blockchain systems rely heavily on the Proof-of-Work (PoW) or Proof-of-Stake (PoS) mechanisms for decentralized consensus and security assurance. However, the substantial energy expenditure stemming from computationally intensive yet meaningless tasks has raised considerable concerns surrounding traditional PoW approaches, The PoS mechanism, while free of energy consumption, is subject to security and economic issues. Addressing these issues, the paradigm of Proof-of-Useful-Work (PoUW) seeks to employ challenges of practical significance as PoW, thereby imbuing energy consumption with tangible value. While previous efforts in Proof of Learning (PoL) explored the utilization of deep learning model training SGD tasks as PoUW challenges, recent research has revealed its vulnerabilities to adversarial attacks and the theoretical hardness in crafting a byzantine-secure PoL mechanism. In this paper, we introduce the concept of incentive-security that incentivizes rational provers to behave honestly for their best interest, bypassing the existing hardness to design a PoL mechanism with computational efficiency, a provable incentive-security guarantee and controllable difficulty. Particularly, our work is secure against two attacks to the recent work of Jia et al. [2021], and also improves the computational overhead from $\Theta(1)$ to $O(\frac{\log E}{E})$. Furthermore, while most recent research assumes trusted problem providers and verifiers, our design also guarantees frontend incentive-security even when problem providers are untrusted, and verifier incentive-security that bypasses the Verifier's Dilemma. By incorporating ML training into blockchain consensus mechanisms with provable guarantees, our research not only proposes an eco-friendly solution to blockchain systems, but also provides a proposal for a completely decentralized computing power market in the new AI age.


title: QCD sum rules for positive and negative parity heavy baryons at next-to-leading order in $\alpha_s$-expansion

abstract: QCD sum rules for positive and negative parity heavy baryons in the heavy quark limit are formulated. We apply the method to $\Lambda$ and $\Sigma$ channels. We include the next-to-leading order corrections in $\alpha_s$-expansion to dimension 0 and 3 terms in the operator product expansion. The corrections lead to the considerable reduction of the predicted masses and significantly improves the stability with respect to the Borel parameter, especially for negative parity states. It is also found that in the heavy quark limit chiral odd condensates do not contribute to the negative parity states.


title: A Framework for Safe Probabilistic Invariance Verification of Stochastic Dynamical Systems

abstract: Ensuring safety through set invariance has proven to be a valuable method in various robotics and control applications. This paper introduces a comprehensive framework for the safe probabilistic invariance verification of both discrete- and continuous-time stochastic dynamical systems over an infinite time horizon. The objective is to ascertain the lower and upper bounds of the liveness probability for a given safe set and set of initial states. This probability signifies the likelihood of the system remaining within the safe set indefinitely, starting from the set of initial states. To address this problem, we propose optimizations for verifying safe probabilistic invariance in discrete-time and continuous-time stochastic dynamical systems. These optimizations adapt classical stochastic barrier certificates, which are based on Doob's non-negative supermartingale inequality, and the equations described in [29],[31], which can precisely define the probability of reaching a target set while avoiding unsafe states. Finally, we demonstrate the effectiveness of these optimizations through several examples using semi-definite programming tools.


title: Combinatorial Printing of Functionally Graded Solid-State Electrolyte for High-Voltage Lithium Metal Batteries

abstract: Heterogeneous multilayered solid-state electrolyte (HMSSE) has been widely explored for their broadened working voltage range and compatibility with electrodes. However, due to the limitations of traditional manufacturing methods such as casting, the interface between electrolyte layers in HMSSE can decrease the ionic conductivity severely. Here, a novel combinatory aerosol jet printing (CAJP) is introduced to fabricate functionally graded solid-state electrolyte (FGSSE) without sharp interface. Owing to the unique ability of CAJP (in-situ mixing and instantaneous tuning of the mixing ratio), FGSSE with smooth microscale compositional gradation is achieved. Electrochemical tests show that FGSSE has excellent oxidative stability exceeding 5.5 V and improved conductivity (>7 times of an analogous HMSSE). By decoupling the total resistance, we show that the resistance from the electrolyte/electrolyte interface of HMSSE is 5.7 times of the total resistance of FGSSE. The Li/FGSSE/NCM622 cell can be stably run for more than 200 cycles along with improved rate performance.


title: Statistics for Iwasawa invariants of elliptic curves, $\rm{III}$

abstract: Given a prime $p\geq 5$, a conjecture of Greenberg predicts that the $\mu$-invariant of the $p$-primary Selmer group should vanish for most elliptic curves with good ordinary reduction at $p$. In support of this conjecture, I show that the $5$-primary Iwasawa $\mu$- and $\lambda$-invariants simultaneously vanish for an explicit positive density of elliptic curves $E_{/\mathbb{Q}}$. The elliptic curves in question have good ordinary reduction at $5$, and are ordered by their height. The results are proven by leveraging work of Bhargava and Shankar on the distribution of $5$-Selmer groups of elliptic curves defined over $\mathbb{Q}$.


title: MMA-DFER: MultiModal Adaptation of unimodal models for Dynamic Facial Expression Recognition in-the-wild

abstract: Dynamic Facial Expression Recognition (DFER) has received significant interest in the recent years dictated by its pivotal role in enabling empathic and human-compatible technologies. Achieving robustness towards in-the-wild data in DFER is particularly important for real-world applications. One of the directions aimed at improving such models is multimodal emotion recognition based on audio and video data. Multimodal learning in DFER increases the model capabilities by leveraging richer, complementary data representations. Within the field of multimodal DFER, recent methods have focused on exploiting advances of self-supervised learning (SSL) for pre-training of strong multimodal encoders. Another line of research has focused on adapting pre-trained static models for DFER. In this work, we propose a different perspective on the problem and investigate the advancement of multimodal DFER performance by adapting SSL-pre-trained disjoint unimodal encoders. We identify main challenges associated with this task, namely, intra-modality adaptation, cross-modal alignment, and temporal adaptation, and propose solutions to each of them. As a result, we demonstrate improvement over current state-of-the-art on two popular DFER benchmarks, namely DFEW and MFAW.


title: PracticalDG: Perturbation Distillation on Vision-Language Models for Hybrid Domain Generalization

abstract: Domain Generalization (DG) aims to resolve distribution shifts between source and target domains, and current DG methods are default to the setting that data from source and target domains share identical categories. Nevertheless, there exists unseen classes from target domains in practical scenarios. To address this issue, Open Set Domain Generalization (OSDG) has emerged and several methods have been exclusively proposed. However, most existing methods adopt complex architectures with slight improvement compared with DG methods. Recently, vision-language models (VLMs) have been introduced in DG following the fine-tuning paradigm, but consume huge training overhead with large vision models. Therefore, in this paper, we innovate to transfer knowledge from VLMs to lightweight vision models and improve the robustness by introducing Perturbation Distillation (PD) from three perspectives, including Score, Class and Instance (SCI), named SCI-PD. Moreover, previous methods are oriented by the benchmarks with identical and fixed splits, ignoring the divergence between source domains. These methods are revealed to suffer from sharp performance decay with our proposed new benchmark Hybrid Domain Generalization (HDG) and a novel metric $H^{2}$-CV, which construct various splits to comprehensively assess the robustness of algorithms. Extensive experiments demonstrate that our method outperforms state-of-the-art algorithms on multiple datasets, especially improving the robustness when confronting data scarcity.