title: MISFIT-V: Misaligned Image Synthesis and Fusion using Information from Thermal and Visual

abstract: Detecting humans from airborne visual and thermal imagery is a fundamental challenge for Wilderness Search-and-Rescue (WiSAR) teams, who must perform this function accurately in the face of immense pressure. The ability to fuse these two sensor modalities can potentially reduce the cognitive load on human operators and/or improve the effectiveness of computer vision object detection models. However, the fusion task is particularly challenging in the context of WiSAR due to hardware limitations and extreme environmental factors. This work presents Misaligned Image Synthesis and Fusion using Information from Thermal and Visual (MISFIT-V), a novel two-pronged unsupervised deep learning approach that utilizes a Generative Adversarial Network (GAN) and a cross-attention mechanism to capture the most relevant features from each modality. Experimental results show MISFIT-V offers enhanced robustness against misalignment and poor lighting/thermal environmental conditions compared to existing visual-thermal image fusion methods.


title: Machine Learning-Aided First-Principles Calculations of Redox Potentials

abstract: Redox potentials of electron transfer reactions are of fundamental importance for the performance and description of electrochemical devices. Despite decades of research, accurate computational predictions for the redox potential of even simple metals remain very challenging. Here we use a combination of first principles calculations and machine learning to predict the redox potentials of three redox couples, $\mathrm{Fe}^{2+}$/$\mathrm{Fe}^{3+}$, $\mathrm{Cu}^{+}$/$\mathrm{Cu}^{2+}$ and $\mathrm{Ag}^{+}$/$\mathrm{Ag}^{2+}$. Using a hybrid functional with a fraction of 25\% exact exchange (PBE0) the predicted values are 0.92, 0.26 and 1.99 V in good agreement with the best experimental estimates (0.77, 0.15, 1.98 V). We explain in detail, how we combine machine learning, thermodynamic integration from machine learning to semi-local functionals, as well as a combination of thermodynamic perturbation theory and $\Delta$-machine learning to determine the redox potentials for computationally expensive hybrid functionals. The combination of these approaches allows one to obtain statistically accurate results.


title: AI-Copilot for Business Optimisation: A Framework and A Case Study in Production Scheduling

abstract: Business optimisation refers to the process of finding and implementing efficient and cost-effective means of operation to bring a competitive advantage for businesses. Synthesizing problem formulations is an integral part of business optimisation, which relies on human expertise to construct problem formulations using optimisation languages. Interestingly, with advancements in Large Language Models (LLMs), the human expertise needed in problem formulation can be minimized. However, developing an LLM for problem formulation is challenging, due to training data, token limitations, and lack of appropriate performance metrics. For the requirement of training data, recent attention has been directed towards fine-tuning pre-trained LLMs for downstream tasks rather than training an LLM from scratch for a specific task. In this paper, we adopt an LLM fine-tuning approach and propose an AI-Copilot for business optimisation problem formulation. For token limitations, we introduce modularization and prompt engineering techniques to synthesize complex problem formulations as modules that fit into the token limits of LLMs. Additionally, we design performance evaluation metrics that are better suited for assessing the accuracy and quality of problem formulations. The experiment results demonstrate that with this approach we can synthesize complex and large problem formulations for a typical business optimisation problem in production scheduling.


title: Waiting for Dr. Godot: how much and who responds to predicted health care wait times?

abstract: Asymmetric information in healthcare implies that patients could have difficulty trading off non-health and health related information. I document effects on patient demand when predicted wait time is disclosed to patients in an emergency department (ED) system. I use a regression discontinuity where EDs with similar predicted wait times display different online wait times to patients. I use impulse response functions estimated by local projections to demonstrate effects of the higher wait time. I find that an additional thirty minutes of wait time results in 15% fewer waiting patients at urgent cares and 2% fewer waiting patients at EDs within 3 hours of display. I find that the type of patient that stops using emergency care is triaged as having lower acuity and would have used an urgent care. However, I find that at very high wait times there are declines in all acuity patients including sick patients.


title: Poster: Self-Supervised Quantization-Aware Knowledge Distillation

abstract: Quantization-aware training (QAT) starts with a pre-trained full-precision model and performs quantization during retraining. However, existing QAT works require supervision from the labels and they suffer from accuracy loss due to reduced precision. To address these limitations, this paper proposes a novel Self-Supervised Quantization-Aware Knowledge Distillation framework (SQAKD). SQAKD first unifies the forward and backward dynamics of various quantization functions and then reframes QAT as a co-optimization problem that simultaneously minimizes the KL-Loss and the discretization error, in a self-supervised manner. The evaluation shows that SQAKD significantly improves the performance of various state-of-the-art QAT works. SQAKD establishes stronger baselines and does not require extensive labeled training data, potentially making state-of-the-art QAT research more accessible.


title: Creation of Bound Half-Fermion Pairs by Solitons

abstract: In the presence of topologically nontrivial bosonic field configurations, the fermion number operator may take on fractional eigenvalues, because of the existence of zero-energy fermion modes. The simplest examples of this occur in 1+1 dimensions, with zero modes attached to kink-type solitons. In the presence of a kink-antikink pair, the two associated zero modes bifurcate into positive and negative energy levels with energies $\pm ge^{-g\Delta}$, in terms of the Yukawa coupling $g\ll 1$ and the distance $\Delta$ between the kink and antikink centers. When the kink and antikink are moving, it seems that there could be Landau-Zener-like transitions between these two fermionic modes, which would be interpretable as the creation or annihilation of fermion-antifermion pairs; however, with only two solitons in relative motion, this does not occur. If a third solitary wave is introduced farther away to perturb the kink-antikink system, a movement of the faraway kink can induce transitions between the discrete fermion modes bound to the solitons. These state changes can be interpreted globally as creation or destruction of a novel type of pair: a half-fermion and a half-antifermion. The production of the half-integral pairs will dominate over other particle production channels as long as the solitary waves remain well separated, so that there is a manifold of discrete fermion states whose energies are either zero or exponentially close to zero.


title: Hindi to English: Transformer-Based Neural Machine Translation

abstract: Machine Translation (MT) is one of the most prominent tasks in Natural Language Processing (NLP) which involves the automatic conversion of texts from one natural language to another while preserving its meaning and fluency. Although the research in machine translation has been going on since multiple decades, the newer approach of integrating deep learning techniques in natural language processing has led to significant improvements in the translation quality. In this paper, we have developed a Neural Machine Translation (NMT) system by training the Transformer model to translate texts from Indian Language Hindi to English. Hindi being a low resource language has made it difficult for neural networks to understand the language thereby leading to a slow growth in the development of neural machine translators. Thus, to address this gap, we implemented back-translation to augment the training data and for creating the vocabulary, we experimented with both word and subword level tokenization using Byte Pair Encoding (BPE) thereby ending up training the Transformer in 10 different configurations. This led us to achieve a state-of-the-art BLEU score of 24.53 on the test set of IIT Bombay English-Hindi Corpus in one of the configurations.


title: Causal Reasoning: Charting a Revolutionary Course for Next-Generation AI-Native Wireless Networks

abstract: Despite the basic premise that next-generation wireless networks (e.g., 6G) will be artificial intelligence (AI)-native, to date, most existing efforts remain either qualitative or incremental extensions to existing "AI for wireless" paradigms. Indeed, creating AI-native wireless networks faces significant technical challenges due to the limitations of data-driven, training-intensive AI. These limitations include the black-box nature of the AI models, their curve-fitting nature, which can limit their ability to reason and adapt, their reliance on large amounts of training data, and the energy inefficiency of large neural networks. In response to these limitations, this article presents a comprehensive, forward-looking vision that addresses these shortcomings by introducing a novel framework for building AI-native wireless networks; grounded in the emerging field of causal reasoning. Causal reasoning, founded on causal discovery, causal representation learning, and causal inference, can help build explainable, reasoning-aware, and sustainable wireless networks. Towards fulfilling this vision, we first highlight several wireless networking challenges that can be addressed by causal discovery and representation, including ultra-reliable beamforming for terahertz (THz) systems, near-accurate physical twin modeling for digital twins, training data augmentation, and semantic communication. We showcase how incorporating causal discovery can assist in achieving dynamic adaptability, resilience, and cognition in addressing these challenges. Furthermore, we outline potential frameworks that leverage causal inference to achieve the overarching objectives of future-generation networks, including intent management, dynamic adaptability, human-level cognition, reasoning, and the critical element of time sensitivity.


title: Pick Planning Strategies for Large-Scale Package Manipulation

abstract: Automating warehouse operations can reduce logistics overhead costs, ultimately driving down the final price for consumers, increasing the speed of delivery, and enhancing the resiliency to market fluctuations. This extended abstract showcases a large-scale package manipulation from unstructured piles in Amazon Robotics' Robot Induction (Robin) fleet, which is used for picking and singulating up to 6 million packages per day and so far has manipulated over 2 billion packages. It describes the various heuristic methods developed over time and their successor, which utilizes a pick success predictor trained on real production data. To the best of the authors' knowledge, this work is the first large-scale deployment of learned pick quality estimation methods in a real production system.


title: Faster Approximate All Pairs Shortest Paths

abstract: The all pairs shortest path problem (APSP) is one of the foundational problems in computer science. For weighted dense graphs on $n$ vertices, no truly sub-cubic algorithms exist to compute APSP exactly even for undirected graphs. This is popularly known as the APSP conjecture and has played a prominent role in developing the field of fine-grained complexity. The seminal result of Seidel uses fast matrix multiplication (FMM) to compute APSP on unweighted undirected graphs exactly in $\tilde{O}(n^{\omega})$ time, where $\omega=2.372$. Even for unweighted undirected graphs, it is not possible to obtain a $(2-\epsilon)$-approximation of APSP in $o(n^\omega)$ time. In this paper, we provide a multitude of new results for multiplicative and additive approximations of APSP in undirected graphs for both unweighted and weighted cases. We provide new algorithms for multiplicative 2-approximation of unweighted graphs: a deterministic one that runs in $\tilde{O}(n^{2.072})$ time and a randomized one that runs in $\tilde{O}(n^{2.032})$ on expectation improving upon the best known bound of $\tilde{O}(n^{2.25})$ by Roditty (STOC, 2023). For $2$-approximating paths of length $\geq k$, $k \geq 4$, we provide the first improvement after Dor, Halperin, Zwick (2000) for dense graphs even just using combinatorial methods, and then improve it further using FMM. We next consider additive approximations, and provide improved bounds for all additive $\beta$-approximations, $\beta \geq 4$. For weighted graphs, we show that by allowing small additive errors along with an $(1+\epsilon)$-multiplicative approximation, it is possible to improve upon Zwick's $\tilde{O}(n^\omega)$ algorithm. Our results point out the crucial role that FMM can play even on approximating APSP on unweighted undirected graphs, and reveal new bottlenecks towards achieving a quadratic running time to approximate APSP.


title: Real3D-AD: A Dataset of Point Cloud Anomaly Detection

abstract: High-precision point cloud anomaly detection is the gold standard for identifying the defects of advancing machining and precision manufacturing. Despite some methodological advances in this area, the scarcity of datasets and the lack of a systematic benchmark hinder its development. We introduce Real3D-AD, a challenging high-precision point cloud anomaly detection dataset, addressing the limitations in the field. With 1,254 high-resolution 3D items from forty thousand to millions of points for each item, Real3D-AD is the largest dataset for high-precision 3D industrial anomaly detection to date. Real3D-AD surpasses existing 3D anomaly detection datasets available regarding point cloud resolution (0.0010mm-0.0015mm), 360 degree coverage and perfect prototype. Additionally, we present a comprehensive benchmark for Real3D-AD, revealing the absence of baseline methods for high-precision point cloud anomaly detection. To address this, we propose Reg3D-AD, a registration-based 3D anomaly detection method incorporating a novel feature memory bank that preserves local and global representations. Extensive experiments on the Real3D-AD dataset highlight the effectiveness of Reg3D-AD. For reproducibility and accessibility, we provide the Real3D-AD dataset, benchmark source code, and Reg3D-AD on our website:https://github.com/M-3LAB/Real3D-AD.


title: Importance of negative sampling in weak label learning

abstract: Weak-label learning is a challenging task that requires learning from data "bags" containing positive and negative instances, but only the bag labels are known. The pool of negative instances is usually larger than positive instances, thus making selecting the most informative negative instance critical for performance. Such a selection strategy for negative instances from each bag is an open problem that has not been well studied for weak-label learning. In this paper, we study several sampling strategies that can measure the usefulness of negative instances for weak-label learning and select them accordingly. We test our method on CIFAR-10 and AudioSet datasets and show that it improves the weak-label classification performance and reduces the computational cost compared to random sampling methods. Our work reveals that negative instances are not all equally irrelevant, and selecting them wisely can benefit weak-label learning.


title: A physically motivated framework to compare pair fractions of isolated low and high mass galaxies across cosmic time

abstract: Low mass galaxy pair fractions are understudied, and it is unclear whether low mass pair fractions evolve in the same way as more massive systems over cosmic time. In the era of JWST, Roman, and Rubin, selecting galaxy pairs in a self-consistent way will be critical to connect observed pair fractions to cosmological merger rates across all mass scales and redshifts. Utilizing the Illustris TNG100 simulation, we create a sample of physically associated low mass ($\rm 10^8<M_*<5\times10^9\,M_\odot$) and high mass ($\rm 5\times10^9<M_*<10^{11}\,M_\odot$) pairs between $z=0$ and $4.2$. The low mass pair fraction increases from $z=0$ to $2.5$, while the high mass pair fraction peaks at $z=0$ and is constant or slightly decreasing at $z>1$. At $z=0$, the low mass major (1:4 mass ratio) pair fraction is 4$\times$ lower than high mass pairs, consistent with findings for cosmological merger rates. We show that separation limits that vary with the mass and redshift of the system, such as scaling by the virial radius of the host halo ($r_{\mathrm{sep}}< 1 R_{\rm vir}$), are critical for recovering pair fraction differences between low mass and high mass systems. Alternatively, static physical separation limits applied equivalently to all galaxy pairs do not recover the differences between low and high mass pair fractions, even up to separations of $300$ kpc. Finally, we place isolated mass-analogs of Local Group galaxy pairs, i.e., Milky Way (MW)--M31, MW--LMC, LMC--SMC, in a cosmological context, showing that isolated analogs of LMC--SMC-mass pairs and low-separation ($<50$ kpc) MW--LMC-mass pairs are $2-3\times$ more common at $z\gtrsim2-3$.


title: Heterogeneous Feature Representation for Digital Twin-Oriented Complex Networked Systems

abstract: Building models of Complex Networked Systems (CNS) that can accurately represent reality forms an important research area. To be able to reflect real world systems, the modelling needs to consider not only the intensity of interactions between the entities but also features of all the elements of the system. This study aims to improve the expressive power of node features in Digital Twin-Oriented Complex Networked Systems (DT-CNSs) with heterogeneous feature representation principles. This involves representing features with crisp feature values and fuzzy sets, each describing the objective and the subjective inductions of the nodes' features and feature differences. Our empirical analysis builds DT-CNSs to recreate realistic physical contact networks in different countries from real node feature distributions based on various representation principles and an optimised feature preference. We also investigate their respective disaster resilience to an epidemic outbreak starting from the most popular node. The results suggest that the increasing flexibility of feature representation with fuzzy sets improves the expressive power and enables more accurate modelling. In addition, the heterogeneous features influence the network structure and the speed of the epidemic outbreak, requiring various mitigation policies targeted at different people.


title: Unify word-level and span-level tasks: NJUNLP's Participation for the WMT2023 Quality Estimation Shared Task

abstract: We introduce the submissions of the NJUNLP team to the WMT 2023 Quality Estimation (QE) shared task. Our team submitted predictions for the English-German language pair on all two sub-tasks: (i) sentence- and word-level quality prediction; and (ii) fine-grained error span detection. This year, we further explore pseudo data methods for QE based on NJUQE framework (https://github.com/NJUNLP/njuqe). We generate pseudo MQM data using parallel data from the WMT translation task. We pre-train the XLMR large model on pseudo QE data, then fine-tune it on real QE data. At both stages, we jointly learn sentence-level scores and word-level tags. Empirically, we conduct experiments to find the key hyper-parameters that improve the performance. Technically, we propose a simple method that covert the word-level outputs to fine-grained error span results. Overall, our models achieved the best results in English-German for both word-level and fine-grained error span detection sub-tasks by a considerable margin.


title: ParticleNet and its application on CEPC Jet Flavor Tagging

abstract: Identification of quark flavor is essential for collider experiments in high-energy physics, relying on the flavor tagging algorithm. In this study, using a full simulation of the Circular Electron Positron Collider (CEPC), we investigated the flavor tagging performance of two different algorithms: ParticleNet, originally developed at CMS, and LCFIPlus, the current flavor tagging algorithm employed at CEPC. Compared to LCFIPlus, ParticleNet significantly enhances flavor tagging performance, resulting in a significant improvement in benchmark measurement accuracy, i.e., a 36% improvement for $\nu\bar{\nu}H\to c\bar{c}$ measurement and a 75% improvement for $|V_{cb}|$ measurement via W boson decay when CEPC operates as a Higgs factory at the center-of-mass energy of 240 GeV and integrated luminosity of 5.6 $ab^{-1}$. We compared the performance of ParticleNet and LCFIPlus at different vertex detector configurations, observing that the inner radius is the most sensitive parameter, followed by material budget and spatial resolution.


title: Semiquantum private comparison via cavity QED

abstract: In this paper, we design the first semiquantum private comparison (SQPC) protocol which is realized via cavity quantum electrodynamics (QED) by making use of the evolution law of atom. With the help of a semi-honest third party (TP), the proposed protocol can compare the equality of private inputs from two semiquantum parties who only have limited quantum capabilities. The proposed protocol uses product states as initial quantum resource and employs none of unitary operations, quantum entanglement swapping operation or delay lines. Security proof turns out that it can defeat both the external attack and the internal attack.


title: User Simulation with Large Language Models for Evaluating Task-Oriented Dialogue

abstract: One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of TOD, we propose a novel user simulator built using recently developed large pretrained language models (LLMs). In order to increase the linguistic diversity of our system relative to the related previous work, we do not fine-tune the LLMs used by our system on existing TOD datasets; rather we use in-context learning to prompt the LLMs to generate robust and linguistically diverse output with the goal of simulating the behavior of human interlocutors. Unlike previous work, which sought to maximize goal success rate (GSR) as the primary metric of simulator performance, our goal is a system which achieves a GSR similar to that observed in human interactions with TOD systems. Using this approach, our current simulator is effectively able to interact with several TOD systems, especially on single-intent conversational goals, while generating lexically and syntactically diverse output relative to previous simulators that rely upon fine-tuned models. Finally, we collect a Human2Bot dataset of humans interacting with the same TOD systems with which we experimented in order to better quantify these achievements.


title: Strong unidirectional Rashba state induced by extended vacancy line defects in a $1T'$-WTe$_{2}$ monolayer

abstract: The correlation between spin-orbit coupling and low crystal symmetry in the $1T'$ phase of the tungsten ditellurides (WTe$_{2}$) monolayer (ML) plays a significant role in its electronic and topological properties. However, the centrosymmetric nature of the crystal maintains Kramer's spin degeneracy in its electronic states, which limits its functionality in spintronics. In this paper, through a systematic study using first-principles calculations, we show that significant spin splitting can be induced in the $1T'$-WTe$_{2}$ ML by introducing one dimensional (1D) vacancy line defect (VLD). We examine six configurations of the 1D VLD, which consist of three VLDs extended in the armchair direction including a Te$_{1}$ armchair-VLD ($ACV_{\texttt{Te}_{1}}$), Te$_{2}$ armchair-VLD ($ACV_{\texttt{Te}_{2}}$), and W armchair-VLD ($ACV_{\texttt{W}}$); and three VLDs elongated along the zigzag direction comprising a Te$_{1}$ zigzag-VLD ($ZZV_{\texttt{Te}_{1}}$), Te$_{2}$ zigzag-VLD ($ZZV_{\texttt{Te}_{2}}$), and W zigzag-VLD ($ZZV_{\texttt{W}}$), where Te$_{1}$ and Te$_{2}$ are two nonequivalent Te atoms located at the lower and higher sites in the top layer, respectively. We find that both the $ACV_{\texttt{Te}_{1}}$ and $ACV_{\texttt{W}}$ systems have the lowest formation energy. Concerning these two most stable VLD systems, we identify large spin splitting in the defect states near the Fermi level driven by a strong coupling of the in-plane $p-d$ orbitals, displaying highly unidirectional Rashba states with perfectly collinear spin configurations in the momentum space. This unique spin configuration gives rise to a specific spin mode that protects the spin from decoherence and leads to an exceptionally long spin lifetime...........


title: M$^3$CS: Multi-Target Masked Point Modeling with Learnable Codebook and Siamese Decoders

abstract: Masked point modeling has become a promising scheme of self-supervised pre-training for point clouds. Existing methods reconstruct either the original points or related features as the objective of pre-training. However, considering the diversity of downstream tasks, it is necessary for the model to have both low- and high-level representation modeling capabilities to capture geometric details and semantic contexts during pre-training. To this end, M$^3$CS is proposed to enable the model with the above abilities. Specifically, with masked point cloud as input, M$^3$CS introduces two decoders to predict masked representations and the original points simultaneously. While an extra decoder doubles parameters for the decoding process and may lead to overfitting, we propose siamese decoders to keep the amount of learnable parameters unchanged. Further, we propose an online codebook projecting continuous tokens into discrete ones before reconstructing masked points. In such way, we can enforce the decoder to take effect through the combinations of tokens rather than remembering each token. Comprehensive experiments show that M$^3$CS achieves superior performance at both classification and segmentation tasks, outperforming existing methods.


title: Accurately recover global quasiperiodic systems by finite points

abstract: Quasiperiodic systems, related to irrational numbers, are space-filling structures without decay nor translation invariance. How to accurately recover these systems, especially for non-smooth cases, presents a big challenge in numerical computation. In this paper, we propose a new algorithm, finite points recovery (FPR) method, which is available for both smooth and non-smooth cases, to address this challenge. The FPR method first establishes a homomorphism between the lower-dimensional definition domain of the quasiperiodic function and the higher-dimensional torus, then recovers the global quasiperiodic system by employing interpolation technique with finite points in the definition domain without dimensional lifting. Furthermore, we develop accurate and efficient strategies of selecting finite points according to the arithmetic properties of irrational numbers. The corresponding mathematical theory, convergence analysis, and computational complexity analysis on choosing finite points are presented. Numerical experiments demonstrate the effectiveness and superiority of FPR approach in recovering both smooth quasiperiodic functions and piecewise constant Fibonacci quasicrystals. While existing spectral methods encounter difficulties in accurately recovering non-smooth quasiperiodic functions.


title: Spatial-Temporal Knowledge-Embedded Transformer for Video Scene Graph Generation

abstract: Video scene graph generation (VidSGG) aims to identify objects in visual scenes and infer their relationships for a given video. It requires not only a comprehensive understanding of each object scattered on the whole scene but also a deep dive into their temporal motions and interactions. Inherently, object pairs and their relationships enjoy spatial co-occurrence correlations within each image and temporal consistency/transition correlations across different images, which can serve as prior knowledge to facilitate VidSGG model learning and inference. In this work, we propose a spatial-temporal knowledge-embedded transformer (STKET) that incorporates the prior spatial-temporal knowledge into the multi-head cross-attention mechanism to learn more representative relationship representations. Specifically, we first learn spatial co-occurrence and temporal transition correlations in a statistical manner. Then, we design spatial and temporal knowledge-embedded layers that introduce the multi-head cross-attention mechanism to fully explore the interaction between visual representation and the knowledge to generate spatial- and temporal-embedded representations, respectively. Finally, we aggregate these representations for each subject-object pair to predict the final semantic labels and their relationships. Extensive experiments show that STKET outperforms current competing algorithms by a large margin, e.g., improving the mR@50 by 8.1%, 4.7%, and 2.1% on different settings over current algorithms.


title: How to Differentiate between Near Field and Far Field: Revisiting the Rayleigh Distance

abstract: Future wireless communication systems are likely to adopt extremely large aperture arrays and millimeter-wave/sub-THz frequency bands to achieve higher throughput, lower latency, and higher energy efficiency. Conventional wireless systems predominantly operate in the far field (FF) of the radiation source of signals. As the array size increases and the carrier wavelength shrinks, however, the near field (NF) becomes non-negligible. Since the NF and FF differ in many aspects, it is essential to distinguish their corresponding regions. In this article, we first provide a comprehensive overview of the existing NF-FF boundaries, then introduce a novel NF-FF demarcation method based on effective degrees of freedom (EDoF) of the channel. Since EDoF is intimately related to spectral efficiency, the EDoF-based border is able to characterize key channel performance more accurately, as compared with the classic Rayleigh distance. Furthermore, we analyze the main features of the EDoF-based NF-FF boundary and provide insights into wireless system design.


title: On optimality of Mallows model averaging

abstract: In the past decades, model averaging (MA) has attracted much attention as it has emerged as an alternative tool to the model selection (MS) statistical approach. Hansen [Econometrica 75 (2007) 1175--1189] introduced a Mallows model averaging (MMA) method with model weights selected by minimizing a Mallows' $C_p$ criterion. The main theoretical justification for MMA is an asymptotic optimality (AOP), which states that the risk/loss of the resulting MA estimator is asymptotically equivalent to that of the best but infeasible averaged model. MMA's AOP is proved in the literature by either constraining weights in a special discrete weight set or limiting the number of candidate models. In this work, it is first shown that under these restrictions, however, the optimal risk of MA becomes an unreachable target, and MMA may converge more slowly than MS. In this background, a foundational issue that has not been addressed is: When a suitably large set of candidate models is considered, and the model weights are not harmfully constrained, can the MMA estimator perform asymptotically as well as the optimal convex combination of the candidate models? We answer this question in both nested and non-nested settings. In the nested setting, we provide finite sample inequalities for the risk of MMA and show that without unnatural restrictions on the candidate models, MMA's AOP holds in a general continuous weight set under certain mild conditions. In the non-nested setting, a sufficient condition and a negative result are established for the achievability of the optimal MA risk. Implications on minimax adaptivity are given as well. The results from simulations back up our theoretical findings.


title: NeRF-Enhanced Outpainting for Faithful Field-of-View Extrapolation

abstract: In various applications, such as robotic navigation and remote visual assistance, expanding the field of view (FOV) of the camera proves beneficial for enhancing environmental perception. Unlike image outpainting techniques aimed solely at generating aesthetically pleasing visuals, these applications demand an extended view that faithfully represents the scene. To achieve this, we formulate a new problem of faithful FOV extrapolation that utilizes a set of pre-captured images as prior knowledge of the scene. To address this problem, we present a simple yet effective solution called NeRF-Enhanced Outpainting (NEO) that uses extended-FOV images generated through NeRF to train a scene-specific image outpainting model. To assess the performance of NEO, we conduct comprehensive evaluations on three photorealistic datasets and one real-world dataset. Extensive experiments on the benchmark datasets showcase the robustness and potential of our method in addressing this challenge. We believe our work lays a strong foundation for future exploration within the research community.


title: A link invariant from higher-dimensional Heegaard Floer homology

abstract: We define a higher-dimensional analogue of symplectic Khovanov homology. Consider the standard Lefschetz fibration $p\colon W\to D\subset\mathbb{C}$ of a $2n$-dimensional Milnor fiber of the $A_{2\kappa-1}$ singularity. We represent a link by a $\kappa$-strand braid, which is expressed as an element $h$ of the symplectic mapping class group $\mathrm{Symp}(W,\partial W)$. We then apply the higher-dimensional Heegaard Floer homology machinery to the pair $(\boldsymbol{a},h(\boldsymbol{a}))$, where $\boldsymbol{a}$ is a collection of $\kappa$ unstable manifolds of $W$ which are Lagrangian spheres. We prove its invariance under arc slides and Markov stabilizations, which shows that it is a link invariant. This work constitutes part of the author's PhD thesis.


title: UniHead: Unifying Multi-Perception for Detection Heads

abstract: The detection head constitutes a pivotal component within object detectors, tasked with executing both classification and localization functions. Regrettably, the commonly used parallel head often lacks omni perceptual capabilities, such as deformation perception, global perception and cross-task perception. Despite numerous methods attempting to enhance these abilities from a single aspect, achieving a comprehensive and unified solution remains a significant challenge. In response to this challenge, we develop an innovative detection head, termed UniHead, to unify three perceptual abilities simultaneously. More precisely, our approach (1) introduces deformation perception, enabling the model to adaptively sample object features; (2) proposes a Dual-axial Aggregation Transformer (DAT) to adeptly model long-range dependencies, thereby achieving global perception; and (3) devises a Cross-task Interaction Transformer (CIT) that facilitates interaction between the classification and localization branches, thus aligning the two tasks. As a plug-and-play method, the proposed UniHead can be conveniently integrated with existing detectors. Extensive experiments on the COCO dataset demonstrate that our UniHead can bring significant improvements to many detectors. For instance, the UniHead can obtain +2.7 AP gains in RetinaNet, +2.9 AP gains in FreeAnchor, and +2.1 AP gains in GFL. The code is available at https://github.com/zht8506/UniHead.


title: ChEDDAR: Student-ChatGPT Dialogue in EFL Writing Education

abstract: The integration of generative AI in education is expanding, yet empirical analyses of large-scale, real-world interactions between students and AI systems still remain limited. In this study, we present ChEDDAR, ChatGPT & EFL Learner's Dialogue Dataset As Revising an essay, which is collected from a semester-long longitudinal experiment involving 212 college students enrolled in English as Foreign Langauge (EFL) writing courses. The students were asked to revise their essays through dialogues with ChatGPT. ChEDDAR includes a conversation log, utterance-level essay edit history, self-rated satisfaction, and students' intent, in addition to session-level pre-and-post surveys documenting their objectives and overall experiences. We analyze students' usage patterns and perceptions regarding generative AI with respect to their intent and satisfaction. As a foundational step, we establish baseline results for two pivotal tasks in task-oriented dialogue systems within educational contexts: intent detection and satisfaction estimation. We finally suggest further research to refine the integration of generative AI into education settings, outlining potential scenarios utilizing ChEDDAR. ChEDDAR is publicly available at https://github.com/zeunie/ChEDDAR.


title: Chunking Tasks for Present-Biased Agents

abstract: Everyone puts things off sometimes. How can we combat this tendency to procrastinate? A well-known technique used by instructors is to break up a large project into more manageable chunks. But how should this be done best? Here we study the process of chunking using the graph-theoretic model of present bias introduced by Kleinberg and Oren (2014). We first analyze how to optimally chunk single edges within a task graph, given a limited number of chunks. We show that for edges on the shortest path, the optimal chunking makes initial chunks easy and later chunks progressively harder. For edges not on the shortest path, optimal chunking is significantly more complex, but we provide an efficient algorithm that chunks the edge optimally. We then use our optimal edge-chunking algorithm to optimally chunk task graphs. We show that with a linear number of chunks on each edge, the biased agent's cost can be exponentially lowered, to within a constant factor of the true cheapest path. Finally, we extend our model to the case where a task designer must chunk a graph for multiple types of agents simultaneously. The problem grows significantly more complex with even two types of agents, but we provide optimal graph chunking algorithms for two types. Our work highlights the efficacy of chunking as a means to combat present bias.


title: RBFormer: Improve Adversarial Robustness of Transformer by Robust Bias

abstract: Recently, there has been a surge of interest and attention in Transformer-based structures, such as Vision Transformer (ViT) and Vision Multilayer Perceptron (VMLP). Compared with the previous convolution-based structures, the Transformer-based structure under investigation showcases a comparable or superior performance under its distinctive attention-based input token mixer strategy. Introducing adversarial examples as a robustness consideration has had a profound and detrimental impact on the performance of well-established convolution-based structures. This inherent vulnerability to adversarial attacks has also been demonstrated in Transformer-based structures. In this paper, our emphasis lies on investigating the intrinsic robustness of the structure rather than introducing novel defense measures against adversarial attacks. To address the susceptibility to robustness issues, we employ a rational structure design approach to mitigate such vulnerabilities. Specifically, we enhance the adversarial robustness of the structure by increasing the proportion of high-frequency structural robust biases. As a result, we introduce a novel structure called Robust Bias Transformer-based Structure (RBFormer) that shows robust superiority compared to several existing baseline structures. Through a series of extensive experiments, RBFormer outperforms the original structures by a significant margin, achieving an impressive improvement of +16.12% and +5.04% across different evaluation criteria on CIFAR-10 and ImageNet-1k, respectively.


title: Can I Trust the Explanations? Investigating Explainable Machine Learning Methods for Monotonic Models

abstract: In recent years, explainable machine learning methods have been very successful. Despite their success, most explainable machine learning methods are applied to black-box models without any domain knowledge. By incorporating domain knowledge, science-informed machine learning models have demonstrated better generalization and interpretation. But do we obtain consistent scientific explanations if we apply explainable machine learning methods to science-informed machine learning models? This question is addressed in the context of monotonic models that exhibit three different types of monotonicity. To demonstrate monotonicity, we propose three axioms. Accordingly, this study shows that when only individual monotonicity is involved, the baseline Shapley value provides good explanations; however, when strong pairwise monotonicity is involved, the Integrated gradients method provides reasonable explanations on average.


title: Multi-modal Domain Adaptation for REG via Relation Transfer

abstract: Domain adaptation, which aims to transfer knowledge between domains, has been well studied in many areas such as image classification and object detection. However, for multi-modal tasks, conventional approaches rely on large-scale pre-training. But due to the difficulty of acquiring multi-modal data, large-scale pre-training is often impractical. Therefore, domain adaptation, which can efficiently utilize the knowledge from different datasets (domains), is crucial for multi-modal tasks. In this paper, we focus on the Referring Expression Grounding (REG) task, which is to localize an image region described by a natural language expression. Specifically, we propose a novel approach to effectively transfer multi-modal knowledge through a specially relation-tailored approach for the REG problem. Our approach tackles the multi-modal domain adaptation problem by simultaneously enriching inter-domain relations and transferring relations between domains. Experiments show that our proposed approach significantly improves the transferability of multi-modal domains and enhances adaptation performance in the REG problem.


title: Rethinking Amodal Video Segmentation from Learning Supervised Signals with Object-centric Representation

abstract: Video amodal segmentation is a particularly challenging task in computer vision, which requires to deduce the full shape of an object from the visible parts of it. Recently, some studies have achieved promising performance by using motion flow to integrate information across frames under a self-supervised setting. However, motion flow has a clear limitation by the two factors of moving cameras and object deformation. This paper presents a rethinking to previous works. We particularly leverage the supervised signals with object-centric representation in \textit{real-world scenarios}. The underlying idea is the supervision signal of the specific object and the features from different views can mutually benefit the deduction of the full mask in any specific frame. We thus propose an Efficient object-centric Representation amodal Segmentation (EoRaS). Specially, beyond solely relying on supervision signals, we design a translation module to project image features into the Bird's-Eye View (BEV), which introduces 3D information to improve current feature quality. Furthermore, we propose a multi-view fusion layer based temporal module which is equipped with a set of object slots and interacts with features from different views by attention mechanism to fulfill sufficient object representation completion. As a result, the full mask of the object can be decoded from image features updated by object slots. Extensive experiments on both real-world and synthetic benchmarks demonstrate the superiority of our proposed method, achieving state-of-the-art performance. Our code will be released at \url{https://github.com/kfan21/EoRaS}.


title: A Survey of Document-Level Information Extraction

abstract: Document-level information extraction (IE) is a crucial task in natural language processing (NLP). This paper conducts a systematic review of recent document-level IE literature. In addition, we conduct a thorough error analysis with current state-of-the-art algorithms and identify their limitations as well as the remaining challenges for the task of document-level IE. According to our findings, labeling noises, entity coreference resolution, and lack of reasoning, severely affect the performance of document-level IE. The objective of this survey paper is to provide more insights and help NLP researchers to further enhance document-level IE performance.


title: Runs in Sequences of Random Ordered Variables

abstract: We determine the distributions of lengths of runs in sequences of random elements from a total or partial order. In particular, we derive formulas for the expected value, variance, and probability generating function (PGF) of such lengths in the case of total orders (focusing on distributions with atoms). To do this, we define novel generating functions associated with a measure on an order. These generating functions behave nicely when splitting and combining measures on orders allowing us to solve the case of total orders.


title: Nonparametric estimation of conditional densities by generalized random forests

abstract: Considering a continuous random variable $Y$ together with a continuous random vector $X$, I propose a nonparametric estimator $\hat{f}(\cdot|x)$ for the conditional density of $Y$ given $X=x$. This estimator takes the form of an exponential series whose coefficients $\hat{\theta}_{x}=(\hat{\theta}_{x,1}, \dots,\hat{\theta}_{x,J})$ are the solution of a system of nonlinear equations that depends on an estimator of the conditional expectation $E[\phi (Y)|X=x]$, where $\phi$ is a $J$-dimensional vector of basis functions. The distinguishing feature of the proposed estimator is that $E[\phi(Y)|X=x]$ is estimated by generalized random forest (Athey, Tibshirani, and Wager, Annals of Statistics, 2019), targeting the heterogeneity of $\hat{\theta}_{x}$ across $x$. I show that $\hat{f}(\cdot|x)$ is uniformly consistent and asymptotically normal, allowing $J \rightarrow \infty$. I also provide a standard error formula to construct asymptotically valid confidence intervals. Results from Monte Carlo experiments and an empirical illustration are provided.


title: On the Estrada index of unicyclic and bicyclic signed graphs

abstract: Let $\Gamma=(G, \sigma)$ be a signed graph of order $n$ with eigenvalues $\mu_1,\mu_2,\ldots,\mu_n.$ We define the Estrada index of a signed graph $\Gamma$ as $EE(\Gamma)=\sum_{i=1}^ne^{\mu_i}$. We characterize the signed unicyclic graphs with the maximum Estrada index. The signed graph $\Gamma$ is said to have the pairing property if $\mu$ is an eigenvalue whenever $-\mu$ is an eigenvalue of $\Gamma$ and both $\mu$ and $-\mu$ have the same multiplicities. If $\Gamma_{p}^-(n, m)$ denotes the set of all unbalanced graphs on $n$ vertices and $m$ edges with the pairing property, we determine the signed graphs having the maximum Estrada index in $\Gamma_{p}^-(n, m)$, when $m=n$ and $m=n+1$. Finally, we find the signed graphs among all unbalanced complete bipartite signed graphs having the maximum Estrada index.


title: Contrastive Speaker Embedding With Sequential Disentanglement

abstract: Contrastive speaker embedding assumes that the contrast between the positive and negative pairs of speech segments is attributed to speaker identity only. However, this assumption is incorrect because speech signals contain not only speaker identity but also linguistic content. In this paper, we propose a contrastive learning framework with sequential disentanglement to remove linguistic content by incorporating a disentangled sequential variational autoencoder (DSVAE) into the conventional SimCLR framework. The DSVAE aims to disentangle speaker factors from content factors in an embedding space so that only the speaker factors are used for constructing a contrastive loss objective. Because content factors have been removed from the contrastive learning, the resulting speaker embeddings will be content-invariant. Experimental results on VoxCeleb1-test show that the proposed method consistently outperforms SimCLR. This suggests that applying sequential disentanglement is beneficial to learning speaker-discriminative embeddings.


title: Zen: Near-Optimal Sparse Tensor Synchronization for Distributed DNN Training

abstract: Distributed training is the de facto standard to scale up the training of Deep Neural Networks (DNNs) with multiple GPUs. The performance bottleneck of distributed training lies in communications for gradient synchronization. Recently, practitioners have observed sparsity in gradient tensors, suggesting the potential to reduce the traffic volume in communication and improve end-to-end training efficiency. Yet, the optimal communication scheme to fully leverage sparsity is still missing. This paper aims to address this gap. We first analyze the characteristics of sparse tensors in popular DNN models to understand the fundamentals of sparsity. We then systematically explore the design space of communication schemes for sparse tensors and find the optimal one. % We then find the optimal scheme based on the characteristics by systematically exploring the design space. We also develop a gradient synchronization system called Zen that approximately realizes it for sparse tensors. We demonstrate that Zen can achieve up to 5.09x speedup in communication time and up to 2.48x speedup in training throughput compared to the state-of-the-art methods.


title: Adaptive Multiscale Coupling Methods of Molecular Mechanics based on a Unified Framework of a Posteriori Error Estimates

abstract: Multiscale coupling methods are significant methodologies for the modeling and simulation of materials with defects, intending to achieve the (quasi-)optimal balance of accuracy and efficiency. The a posteriori analysis and corresponding adaptive algorithms play a crucial role in the efficient implementation of multiscale coupling methods. This paper proposes a unified framework for residual-based a posteriori error estimates that can be applied to general consistent multiscale coupling methods. In particular, we prove that the error estimator based on the residual force can provide the upper bound of the true approximation error. As prototypical examples, we present a variety of adaptive computations based on this reliable error estimator for the blended atomistic-to-continuum (a/c) coupling methods, including the energy-based blended quasi-continuum (BQCE), the force-based blended quasi-continuum (BQCF) and the recently developed blended ghost force correction (BGFC) methods. We develop a coarse-grained technique for the efficient evaluation of the error estimator. A robust adaptive algorithm is therefore proposed and validated with different types of crystalline defects, some of which are not considered in previous related literature on the adaptive a/c coupling methods. The results demonstrate that the adaptive algorithm leads to the same optimal convergence rate of the error as the a priori error estimate, but with considerable computational efficiency. This study provides valuable insights into the design and implementation of adaptive multiscale methods, and represents a significant contribution to the literature on a/c coupling methods.


title: Defending Pre-trained Language Models as Few-shot Learners against Backdoor Attacks

abstract: Pre-trained language models (PLMs) have demonstrated remarkable performance as few-shot learners. However, their security risks under such settings are largely unexplored. In this work, we conduct a pilot study showing that PLMs as few-shot learners are highly vulnerable to backdoor attacks while existing defenses are inadequate due to the unique challenges of few-shot scenarios. To address such challenges, we advocate MDP, a novel lightweight, pluggable, and effective defense for PLMs as few-shot learners. Specifically, MDP leverages the gap between the masking-sensitivity of poisoned and clean samples: with reference to the limited few-shot data as distributional anchors, it compares the representations of given samples under varying masking and identifies poisoned samples as ones with significant variations. We show analytically that MDP creates an interesting dilemma for the attacker to choose between attack effectiveness and detection evasiveness. The empirical evaluation using benchmark datasets and representative attacks validates the efficacy of MDP.


title: RTrack: Accelerating Convergence for Visual Object Tracking via Pseudo-Boxes Exploration

abstract: Single object tracking (SOT) heavily relies on the representation of the target object as a bounding box. However, due to the potential deformation and rotation experienced by the tracked targets, the genuine bounding box fails to capture the appearance information explicitly and introduces cluttered background. This paper proposes RTrack, a novel object representation baseline tracker that utilizes a set of sample points to get a pseudo bounding box. RTrack automatically arranges these points to define the spatial extents and highlight local areas. Building upon the baseline, we conducted an in-depth exploration of the training potential and introduced a one-to-many leading assignment strategy. It is worth noting that our approach achieves competitive performance to the state-of-the-art trackers on the GOT-10k dataset while reducing training time to just 10% of the previous state-of-the-art (SOTA) trackers' training costs. The substantial reduction in training costs brings single-object tracking (SOT) closer to the object detection (OD) task. Extensive experiments demonstrate that our proposed RTrack achieves SOTA results with faster convergence.


title: Order-preserving Consistency Regularization for Domain Adaptation and Generalization

abstract: Deep learning models fail on cross-domain challenges if the model is oversensitive to domain-specific attributes, e.g., lightning, background, camera angle, etc. To alleviate this problem, data augmentation coupled with consistency regularization are commonly adopted to make the model less sensitive to domain-specific attributes. Consistency regularization enforces the model to output the same representation or prediction for two views of one image. These constraints, however, are either too strict or not order-preserving for the classification probabilities. In this work, we propose the Order-preserving Consistency Regularization (OCR) for cross-domain tasks. The order-preserving property for the prediction makes the model robust to task-irrelevant transformations. As a result, the model becomes less sensitive to the domain-specific attributes. The comprehensive experiments show that our method achieves clear advantages on five different cross-domain tasks.


title: WikiMT++ Dataset Card

abstract: WikiMT++ is an expanded and refined version of WikiMusicText (WikiMT), featuring 1010 curated lead sheets in ABC notation. To expand application scenarios of WikiMT, we add both objective (album, lyrics, video) and subjective emotion (12 emotion adjectives) and emo\_4q (Russell 4Q) attributes, enhancing its usability for music information retrieval, conditional music generation, automatic composition, and emotion classification, etc. Additionally, CLaMP is implemented to correct the attributes inherited from WikiMT to reduce errors introduced during original data collection and enhance the accuracy and completeness of our dataset.


title: Phonon chirality manipulation mechanism in TMD interlayer-sliding ferroelectrics

abstract: As an ideal platform, both the theoretical prediction and first experimental verification of chiral phonons are based on transition-metal dichalcogenide materials. The manipulation of phonon chirality in these materials will have a profound impact on the study of chiral phonons. In this work, we utilize the sliding ferroelectric mechanism to study the phonon chirality manipulation mechanism in transition-metal dichalcogenide materials. Based on first-principles calculations, we study the different effects of interlayer sliding on the phonon properties in bilayer and four-layer MoS$_2$ sliding ferroelectrics. We find that sliding can regulate phonon chirality and Berry curvature, which further affects the phonon angular momentum and magnetization under a temperature gradient and the phonon Hall effect under a magnetic field. Our work connects two emerging fields and opens up a new route to manipulate phonon chirality in transition-metal dichalcogenide materials through the sliding ferroelectric mechanism.


title: Low elements in dominant Shi regions

abstract: This note is a complement of a recent paper about low elements in affine Coxeter groups. We explain in terms of ad-nilpotent ideals of a Borel subalgebra why the minimal elements of dominant Shi regions are low. We also give a survey of the bijections involved in the study of dominant Shi regions in affine Weyl groups.


title: Theory of polygonal phases self-assembled from T-shaped liquid crystalline molecules

abstract: Extensive experimental studies have shown that numerous ordered phases can be formed via the self-assembly of T-shaped liquid crystalline molecules (TLCMs) composed of a rigid backbone, two flexible end chains and a flexible side chain. However, a comprehensive understanding of the stability and formation mechanisms of these intricately nanostructured phases remains incomplete. Here we fill this gap by carrying out a theoretical study of the phase behaviour of TLCMs. Specifically, we construct phase diagrams of TLCMs by computing the free energy of different ordered phases of the system. Our results reveal that the number of polygonal edges increases as the length of side chain or interaction strength increases, consistent with experimental observations. The theoretical study not only reproduces the experimentally observed phases and phase transition sequences, but also systematically analyzes the stability mechanism of the polygonal phases.


title: Loewner PDE in infinite dimensions

abstract: In this paper, we prove the existence and uniqueness of the solution $f(z,t)$ of the Loewner PDE with normalization $Df(0,t)=e^{tA}$, where $A\in L(X,X)$ is such that $k_+(A)<2m(A)$, on the unit ball of a separable reflexive complex Banach space $X$. We also give improvements of the results obtained recently by Hamada and Kohr, but we omit their proofs for the sake of brevity. In particular, we obtain the biholomorphicity of the univalent Schwarz mappings $v(z,s,t)$ with normalization $Dv(0,s,t)=e^{-(t-s)A}$ for $t\geq s\geq 0$, where $m(A)>0$, which satisfy the semigroup property on the unit ball of a complex Banach space $X$. We further obtain the biholomorphicity of $A$-normalized univalent subordination chains under some normality condition on the unit ball of a reflexive complex Banach space $X$. We prove the existence of the biholomorphic solutions $f(z,t)$ of the Loewner PDE with normalization $Df(0,t)=e^{tA}$ on the unit ball of a separable reflexive complex Banach space $X$. The results obtained in this paper give some positive answers to the open problems and conjectures proposed by the authors in 2013.


title: Randomize to Generalize: Domain Randomization for Runway FOD Detection

abstract: Tiny Object Detection is challenging due to small size, low resolution, occlusion, background clutter, lighting conditions and small object-to-image ratio. Further, object detection methodologies often make underlying assumption that both training and testing data remain congruent. However, this presumption often leads to decline in performance when model is applied to out-of-domain(unseen) data. Techniques like synthetic image generation are employed to improve model performance by leveraging variations in input data. Such an approach typically presumes access to 3D-rendered datasets. In contrast, we propose a novel two-stage methodology Synthetic Randomized Image Augmentation (SRIA), carefully devised to enhance generalization capabilities of models encountering 2D datasets, particularly with lower resolution which is more practical in real-world scenarios. The first stage employs a weakly supervised technique to generate pixel-level segmentation masks. Subsequently, the second stage generates a batch-wise synthesis of artificial images, carefully designed with an array of diverse augmentations. The efficacy of proposed technique is illustrated on challenging foreign object debris (FOD) detection. We compare our results with several SOTA models including CenterNet, SSD, YOLOv3, YOLOv4, YOLOv5, and Outer Vit on a publicly available FOD-A dataset. We also construct an out-of-distribution test set encompassing 800 annotated images featuring a corpus of ten common categories. Notably, by harnessing merely 1.81% of objects from source training data and amalgamating with 29 runway background images, we generate 2227 synthetic images. Subsequent model retraining via transfer learning, utilizing enriched dataset generated by domain randomization, demonstrates significant improvement in detection accuracy. We report that detection accuracy improved from an initial 41% to 92% for OOD test set.


title: A Declarative Specification for Authoring Metrics Dashboards

abstract: Despite their ubiquity, authoring dashboards for metrics reporting in modern data analysis tools remains a manual, time-consuming process. Rather than focusing on interesting combinations of their data, users have to spend time creating each chart in a dashboard one by one. This makes dashboard creation slow and tedious. We conducted a review of production metrics dashboards and found that many dashboards contain a common structure: breaking down one or more metrics by different dimensions. In response, we developed a high-level specification for describing dashboards as sections of metrics repeated across the same dimensions and a graphical interface, Quick Dashboard, for authoring dashboards based on this specification. We present several usage examples that demonstrate the flexibility of this specification to create various kinds of dashboards and support a data-first approach to dashboard authoring.


title: Robust Navigation with Cross-Modal Fusion and Knowledge Transfer

abstract: Recently, learning-based approaches show promising results in navigation tasks. However, the poor generalization capability and the simulation-reality gap prevent a wide range of applications. We consider the problem of improving the generalization of mobile robots and achieving sim-to-real transfer for navigation skills. To that end, we propose a cross-modal fusion method and a knowledge transfer framework for better generalization. This is realized by a teacher-student distillation architecture. The teacher learns a discriminative representation and the near-perfect policy in an ideal environment. By imitating the behavior and representation of the teacher, the student is able to align the features from noisy multi-modal input and reduce the influence of variations on navigation policy. We evaluate our method in simulated and real-world environments. Experiments show that our method outperforms the baselines by a large margin and achieves robust navigation performance with varying working conditions.


title: Engineering the electronic, magnetic, and optical properties of GaP monolayer by substitutional doping: a first-principles study

abstract: In this paper we present a thorough first-principles based density functional theory study of the structural stability, electronic, magnetic, and optical properties of pristine and doped gallium phosphide (GaP) monolayers. The pristine GaP monolayer is found to have a periodically buckled structure, with an indirect band gap of 2.15 eV. The doping by X (B, Al, In, C, Si, Ge, Sn, Zn, Cd) at the Ga site, and Y (N, As, Sb, O, S, Se, Te, Zn, Cd) at the P site is considered, and an indirect to direct transition is observed after doping by In at the Ga site. For several cases, significant changes in the band gap are seen after doping, while system becomes metallic when O is substituted at the P site. The spin-polarized band structures are calculated for the monolayers with doping-induced magnetism, and we find that for some cases a direct band gap appears for one of the spin orientations. For such cases, we investigate the intriguing possibility of spin-dependent optical properties. Furthermore for several cases, the band gap is very small for one of the spin orientations, suggesting the possibility of engineering half metallicity by doping. For the layers with direct band gaps, the calculated optical absorption spectra are found to span a wide energy range in the visible and ultraviolet regions. The calculated formation energies of both the pristine and doped structures are quite small, indicating that the laboratory realization of such structures is quite feasible. On the whole, our results suggest that the doped GaP monolayer is a material with potentially a wide range of applications in nanoelectronics, spintronics, optoelectronics, solar cells, etc.


title: Derandomization of quantum algorithm for triangle finding

abstract: Derandomization is the process of taking a randomized algorithm and turning it into a deterministic algorithm, which has attracted great attention in classical computing. In quantum computing, it is challenging and intriguing to derandomize quantum algorithms, due to the inherent randomness of quantum mechanics. The significance of derandomizing quantum algorithms lies not only in theoretically proving that the success probability can essentially be 1 without sacrificing quantum speedups, but also in experimentally improving the success rate when the algorithm is implemented on a real quantum computer. In this paper, we focus on derandomizing quanmtum algorithms for the triangle sum problem (including the famous triangle finding problem as a special case), which asks to find a triangle in an edge-weighted graph with $n$ vertices, such that its edges sum up to a given weight.We show that when the graph is promised to contain at most one target triangle, there exists a deterministic quantum algorithm that either finds the triangle if it exists or outputs ``no triangle'' if none exists. It makes $O(n^{9/7})$ queries to the edge weight matrix oracle, and thus has the same complexity with the state-of-art bounded-error quantum algorithm. To achieve this derandomization, we make full use several techniques:nested quantum walks with quantum data structure, deterministic quantum search with adjustable parameters, and dimensional reduction of quantum walk search on Johnson graph.


title: Being Aware of Localization Accuracy By Generating Predicted-IoU-Guided Quality Scores

abstract: Localization Quality Estimation (LQE) helps to improve detection performance as it benefits post processing through jointly considering classification score and localization accuracy. In this perspective, for further leveraging the close relationship between localization accuracy and IoU (Intersection-Over-Union), and for depressing those inconsistent predictions, we designed an elegant LQE branch to acquire localization quality score guided by predicted IoU. Distinctly, for alleviating the inconsistency of classification score and localization quality during training and inference, under which some predictions with low classification scores but high LQE scores will impair the performance, instead of separately and independently setting, we embedded LQE branch into classification branch, producing a joint classification-localization-quality representation. Then a novel one stage detector termed CLQ is proposed. Extensive experiments show that CLQ achieves state-of-the-arts' performance at an accuracy of 47.8 AP and a speed of 11.5 fps with ResNeXt-101 as backbone on COCO test-dev. Finally, we extend CLQ to ATSS, producing a reliable 1.2 AP gain, showing our model's strong adaptability and scalability. Codes are released at https://github.com/PanffeeReal/CLQ.


title: BART-SIMP: a novel framework for flexible spatial covariate modeling and prediction using Bayesian additive regression trees

abstract: Prediction is a classic challenge in spatial statistics and the inclusion of spatial covariates can greatly improve predictive performance when incorporated into a model with latent spatial effects. It is desirable to develop flexible regression models that allow for nonlinearities and interactions in the covariate structure. Machine learning models have been suggested in the spatial context, allowing for spatial dependence in the residuals, but fail to provide reliable uncertainty estimates. In this paper, we investigate a novel combination of a Gaussian process spatial model and a Bayesian Additive Regression Tree (BART) model. The computational burden of the approach is reduced by combining Markov chain Monte Carlo (MCMC) with the Integrated Nested Laplace Approximation (INLA) technique. We study the performance of the method via simulations and use the model to predict anthropometric responses, collected via household cluster samples in Kenya.


title: Secure Inter-domain Routing and Forwarding via Verifiable Forwarding Commitments

abstract: The Internet inter-domain routing system is vulnerable. On the control plane, the de facto Border Gateway Protocol (BGP) does not have built-in mechanisms to authenticate routing announcements, so an adversary can announce virtually arbitrary paths to hijack network traffic; on the data plane, it is difficult to ensure that actual forwarding path complies with the control plane decisions. The community has proposed significant research to secure the routing system. Yet, existing secure BGP protocols (e.g., BGPsec) are not incrementally deployable, and existing path authorization protocols are not compatible with the current Internet routing infrastructure. In this paper, we propose FC-BGP, the first secure Internet inter-domain routing system that can simultaneously authenticate BGP announcements and validate data plane forwarding in an efficient and incrementally-deployable manner. FC-BGP is built upon a novel primitive, name Forwarding Commitment, to certify an AS's routing intent on its directly connected hops. We analyze the security benefits of FC-BGP in the Internet at different deployment rates. Further, we implement a prototype of FC-BGP and extensively evaluate it over a large-scale overlay network with 100 virtual machines deployed globally. The results demonstrate that FC-BGP saves roughly 55% of the overhead required to validate BGP announcements compared with BGPsec, and meanwhile FC-BGP introduces a small overhead for building a globally-consistent view on the desirable forwarding paths.


title: Natural Language Processing for Requirements Formalization: How to Derive New Approaches?

abstract: It is a long-standing desire of industry and research to automate the software development and testing process as much as possible. In this process, requirements engineering (RE) plays a fundamental role for all other steps that build on it. Model-based design and testing methods have been developed to handle the growing complexity and variability of software systems. However, major effort is still required to create specification models from a large set of functional requirements provided in natural language. Numerous approaches based on natural language processing (NLP) have been proposed in the literature to generate requirements models using mainly syntactic properties. Recent advances in NLP show that semantic quantities can also be identified and used to provide better assistance in the requirements formalization process. In this work, we present and discuss principal ideas and state-of-the-art methodologies from the field of NLP in order to guide the readers on how to create a set of rules and methods for the semi-automated formalization of requirements according to their specific use case and needs. We discuss two different approaches in detail and highlight the iterative development of rule sets. The requirements models are represented in a human- and machine-readable format in the form of pseudocode. The presented methods are demonstrated on two industrial use cases from the automotive and railway domains. It shows that using current pre-trained NLP models requires less effort to create a set of rules and can be easily adapted to specific use cases and domains. In addition, findings and shortcomings of this research area are highlighted and an outlook on possible future developments is given.


title: General model for segregation forces in flowing granular mixtures

abstract: Particle segregation in dense flowing size-disperse granular mixtures is driven by gravity and shear, but predicting the associated segregation force due to both effects has remained an unresolved challenge. Here, a model of the combined gravity- and kinematics-induced segregation force on a single intruder particle is integrated with a model of the concentration dependence of the gravity-induced segregation force. The result is a general model of the net particle segregation force in flowing size-bidisperse granular mixtures. Using discrete element method simulations for comparison, the model correctly predicts the segregation force for a variety of mixture concentrations and flow conditions in both idealized and natural shear flows.


title: GLOBER: Coherent Non-autoregressive Video Generation via GLOBal Guided Video DecodER

abstract: Video generation necessitates both global coherence and local realism. This work presents a novel non-autoregressive method GLOBER, which first generates global features to obtain comprehensive global guidance and then synthesizes video frames based on the global features to generate coherent videos. Specifically, we propose a video auto-encoder, where a video encoder encodes videos into global features, and a video decoder, built on a diffusion model, decodes the global features and synthesizes video frames in a non-autoregressive manner. To achieve maximum flexibility, our video decoder perceives temporal information through normalized frame indexes, which enables it to synthesize arbitrary sub video clips with predetermined starting and ending frame indexes. Moreover, a novel adversarial loss is introduced to improve the global coherence and local realism between the synthesized video frames. Finally, we employ a diffusion-based video generator to fit the global features outputted by the video encoder for video generation. Extensive experimental results demonstrate the effectiveness and efficiency of our proposed method, and new state-of-the-art results have been achieved on multiple benchmarks.


title: All-optical seeding of a light-induced phase transition with correlated disorder

abstract: Ultrafast manipulation of vibrational coherence is an emergent route to control the structure of solids. However, this strategy can only induce long-range correlations and cannot modify atomic structure locally, which is required in many technologically-relevant phase transitions. Here, we demonstrate that ultrafast lasers can generate incoherent structural fluctuations which are more efficient for material control than coherent vibrations, extending optical control to a wider range of materials. We observe that local, non-equilibrium lattice distortions generated by a weak laser pulse reduce the energy barrier to switch between insulating and metallic states in vanadium dioxide by 6%. Seeding inhomogeneous structural-fluctuations presents an alternative, more energy efficient, route for controlling materials that may be applicable to all solids, including those used in data and energy storage devices.


title: Discwise Active Learning for LiDAR Semantic Segmentation

abstract: While LiDAR data acquisition is easy, labeling for semantic segmentation remains highly time consuming and must therefore be done selectively. Active learning (AL) provides a solution that can iteratively and intelligently label a dataset while retaining high performance and a low budget. In this work we explore AL for LiDAR semantic segmentation. As a human expert is a component of the pipeline, a practical framework must consider common labeling techniques such as sequential labeling that drastically improve annotation times. We therefore propose a discwise approach (DiAL), where in each iteration, we query the region a single frame covers on global coordinates, labeling all frames simultaneously. We then tackle the two major challenges that emerge with discwise AL. Firstly we devise a new acquisition function that takes 3D point density changes into consideration which arise due to location changes or ego-vehicle motion. Next we solve a mixed-integer linear program that provides a general solution to the selection of multiple frames while taking into consideration the possibilities of disc intersections. Finally we propose a semi-supervised learning approach to utilize all frames within our dataset and improve performance.


title: Twisted calculus in several variables

abstract: Following the techniques and notions we defined in our previous article, we define the notion of twisted differential operator of finite radius. We show that this notion is independent of the choice of the endomorphisms. In the case of $q$-coordinates we obtain an equivalence between $\eta^\dagger$-convergent modules of finite type endowed with an integrable connection and the modules of finite type endowed with an action by $\underline{q}$-differential operators of the same radius.


title: Distributional Shift-Aware Off-Policy Interval Estimation: A Unified Error Quantification Framework

abstract: We study high-confidence off-policy evaluation in the context of infinite-horizon Markov decision processes, where the objective is to establish a confidence interval (CI) for the target policy value using only offline data pre-collected from unknown behavior policies. This task faces two primary challenges: providing a comprehensive and rigorous error quantification in CI estimation, and addressing the distributional shift that results from discrepancies between the distribution induced by the target policy and the offline data-generating process. Motivated by an innovative unified error analysis, we jointly quantify the two sources of estimation errors: the misspecification error on modeling marginalized importance weights and the statistical uncertainty due to sampling, within a single interval. This unified framework reveals a previously hidden tradeoff between the errors, which undermines the tightness of the CI. Relying on a carefully designed discriminator function, the proposed estimator achieves a dual purpose: breaking the curse of the tradeoff to attain the tightest possible CI, and adapting the CI to ensure robustness against distributional shifts. Our method is applicable to time-dependent data without assuming any weak dependence conditions via leveraging a local supermartingale/martingale structure. Theoretically, we show that our algorithm is sample-efficient, error-robust, and provably convergent even in non-linear function approximation settings. The numerical performance of the proposed method is examined in synthetic datasets and an OhioT1DM mobile health study.


title: Lower k-record values from unit-Gompertz distribution and associated inference

abstract: Mazucheli et al. (2019) introduced the unit-Gompertz (UG) distribution and studied some of its properties. More specifically, they considered the random variable X =exp(-Y), where Y has the Gompertz distribution. In this paper, we consider the lower k-record values from this distribution. We obtain exact explicit expressions as well as several recurrence relations for the single and product moments of lower k-record values and then we use these results to compute the means, variances and the covariances of the lower k-record values. We make use of these calculated moments to find the best linear unbiased estimators (BLUEs) of the location and scale parameters of the UG distribution. Applying the relation between the BLUE and the best linear invariant estimator (BLIE), we obtain the BLIEs of the location and scale parameters, as well. In addition, based on the observed k-records, we investigate how to obtain the best linear unbiased predictor (BLUP) and best linear invariant predictor (BLIP) for a future k-record value. Confidence intervals for the unknown parameters and prediction intervals for future k-records are also discussed. A simulation study is performed to assess the point and interval estimators and predictors proposed in the paper. The results show that the BLIE and BLIP outperform the BLUE and BLIP, in the sense of mean squared error criterion, respectively. Finally, a real data set pertaining to COVID-19 2-records is analyzed.


title: Nanoscale Patterning of Surface Nanobubbles

abstract: Surface nanobubbles forming on hydrophobic surfaces in water present an exciting opportunity as potential agents of top-down, bottom-up nanopatterning. The formation and characteristics of surface nanobubbles are strongly influenced by the physical and chemical properties of the substrate. In this study, focused ion beam (FIB) milling is used for the first time to spatially control the nucleation of surface nanobubbles with 75 nm precision. The spontaneous formation of nanobubbles on alternating lines of a self-assembled monolayer (octadecyl trichlorosilane) patterned by FIB is detected by atomic force microscopy. The effect of chemical vs. topographical surface heterogeneity on the formation of nanobubbles is investigated by comparing samples with OTS coating applied pre- vs. post-FIB patterning. The results confirm that nanoscale FIB-based patterning can effectively control surface nanobubble position by means of chemical heterogeneity. The effect of FIB milling on nanobubble morphology and properties, including contact angle and gas oversaturation, is also reported. Molecular dynamics simulations provide further insight into the effects of FIB amorphization on surface nanobubble formation. Combined, experimental and simulation investigations offer insights to guide future nanobubble-based patterning using FIB milling.


title: Automatic Reverse Engineering: Creating computer-aided design (CAD) models from multi-view images

abstract: Generation of computer-aided design (CAD) models from multi-view images may be useful in many practical applications. To date, this problem is usually solved with an intermediate point-cloud reconstruction and involves manual work to create the final CAD models. In this contribution, we present a novel network for an automated reverse engineering task. Our network architecture combines three distinct stages: A convolutional neural network as the encoder stage, a multi-view pooling stage and a transformer-based CAD sequence generator. The model is trained and evaluated on a large number of simulated input images and extensive optimization of model architectures and hyper-parameters is performed. A proof-of-concept is demonstrated by successfully reconstructing a number of valid CAD models from simulated test image data. Various accuracy metrics are calculated and compared to a state-of-the-art point-based network. Finally, a real world test is conducted supplying the network with actual photographs of two three-dimensional test objects. It is shown that some of the capabilities of our network can be transferred to this domain, even though the training exclusively incorporates purely synthetic training data. However to date, the feasible model complexity is still limited to basic shapes.


title: Convective Heat Transfer in Porous Materials

abstract: Thermal convection stands out as an exceptionally efficient thermal transport mechanism, distinctly separate from conduction and radiation. Yet, the inherently elusive nature of fluid motion poses challenges in accurately controlling convective heat flow. While recent innovations have harnessed thermal convection to achieve effective thermal conductivity, fusing thermal convection in liquids and thermal conduction in solids together to form hybrid thermal metamaterials is still challenging. In this review, we introduce the latest progress in convective heat transfer. Leveraging the right porous materials as a medium allows for a harmonious balance and synergy between convection and conduction, establishing stable heat and fluid flows. This paves the way for the innovative advancements in transformation thermotics. These findings demonstrate the remarkable tunability of convective heat transport in complex multicomponent thermal metamaterials.


title: A class of infinite-dimensional Gaussian processes defined through generalized fractional operators

abstract: The generalization of fractional Brownian motion in infinite-dimensional white and grey noise spaces has been recently carried over, following the Mandelbrot-Van Ness representation, through Riemann-Liouville type fractional operators. Our aim is to extend this construction by means of general fractional derivatives and integrals, which we define through Bernstein functions. According to the conditions satisfied by the latter, some properties of these processes (such as continuity, local times, variance asymptotics and persistence) are derived. On the other hand, they are proved to display short- or long-range dependence, if obtained by means of a derivative or an integral, respectively, regardless of the Bernstein function chosen. Moreover, this kind of construction allows us to define the corresponding noise and to derive an Ornstein-Uhlenbeck type process, as solution of an integral equation.


title: Strong resolving graph of the intersection graph in commutative rings

abstract: The intersection graph of ideals associated with a commutative unitary ring $R$ is the graph $G(R)$ whose vertices all non-trivial ideals of $R$ and there exists an edge between distinct vertices if and only if the intersection of them is non-zero. In this paper, the structure of the resolving graph of $G(R)$ is characterized and as an application, we evaluate the strong metric dimension of $G(R)$.


title: Collision Avoidance and Navigation for a Quadrotor Swarm Using End-to-end Deep Reinforcement Learning

abstract: End-to-end deep reinforcement learning (DRL) for quadrotor control promises many benefits -- easy deployment, task generalization and real-time execution capability. Prior end-to-end DRL-based methods have showcased the ability to deploy learned controllers onto single quadrotors or quadrotor teams maneuvering in simple, obstacle-free environments. However, the addition of obstacles increases the number of possible interactions exponentially, thereby increasing the difficulty of training RL policies. In this work, we propose an end-to-end DRL approach to control quadrotor swarms in environments with obstacles. We provide our agents a curriculum and a replay buffer of the clipped collision episodes to improve performance in obstacle-rich environments. We implement an attention mechanism to attend to the neighbor robots and obstacle interactions - the first successful demonstration of this mechanism on policies for swarm behavior deployed on severely compute-constrained hardware. Our work is the first work that demonstrates the possibility of learning neighbor-avoiding and obstacle-avoiding control policies trained with end-to-end DRL that transfers zero-shot to real quadrotors. Our approach scales to 32 robots with 80% obstacle density in simulation and 8 robots with 20% obstacle density in physical deployment. Video demonstrations are available on the project website at: https://sites.google.com/view/obst-avoid-swarm-rl.


title: Homoclinic and heteroclinic solutions for non-autonomous Minkowski-curvature equations

abstract: We deal with the non-autonomous parameter-dependent second-order differential equation \begin{equation*} \delta \left( \dfrac{v'}{\sqrt{1-(v')^{2}}} \right)' + q(t) f(v)= 0, \quad t\in\mathbb{R}, \end{equation*} driven by a Minkowski-curvature operator. Here, $\delta>0$, $q\in L^{\infty}(\mathbb{R})$, $f\colon\mathopen{[}0,1\mathclose{]}\to\mathbb{R}$ is a continuous function with $f(0)=f(1)=0=f(\alpha)$ for some $\alpha \in \mathopen{]}0,1\mathclose{[}$, $f(s)<0$ for all $s\in\mathopen{]}0,\alpha\mathclose{[}$ and $f(s)>0$ for all $s\in\mathopen{]}\alpha,1\mathclose{[}$. Based on a careful phase-plane analysis, under suitable assumptions on $q$ we prove the existence of strictly increasing heteroclinic solutions and of homoclinic solutions with a unique change of monotonicity. Then, we analyze the asymptotic behaviour of such solutions both for $\delta \to 0^{+}$ and for $\delta\to+\infty$. Some numerical examples illustrate the stated results.


title: Conjunctive Queries on Probabilistic Graphs: The Limits of Approximability

abstract: Query evaluation over probabilistic databases is a notoriously intractable problem -- not only in combined complexity, but for many natural queries in data complexity as well. This motivates the study of probabilistic query evaluation through the lens of approximation algorithms, and particularly of combined FPRASes, whose runtime is polynomial in both the query and instance size. In this paper, we focus on tuple-independent probabilistic databases over binary signatures, which can be equivalently viewed as probabilistic graphs. We study in which cases we can devise combined FPRASes for probabilistic query evaluation in this setting. We settle the complexity of this problem for a variety of query and instance classes, by proving both approximability and (conditional) inapproximability results. This allows us to deduce many corollaries of possible independent interest. For example, we show how the results of Arenas et al. on counting fixed-length strings accepted by an NFA imply the existence of an FPRAS for the two-terminal network reliability problem on directed acyclic graphs: this was an open problem until now. We also show that one cannot extend a recent result of van Bremen and Meel that gives a combined FPRAS for self-join-free conjunctive queries of bounded hypertree width on probabilistic databases: neither the bounded-hypertree-width condition nor the self-join-freeness hypothesis can be relaxed. Finally, we complement all our inapproximability results with unconditional lower bounds, showing that DNNF provenance circuits must have at least moderately exponential size in combined complexity.


title: On the residual Monge-Amp\`{e}re mass of plurisubharmonic functions with symmetry, II

abstract: The aim of this article is to study the residual Monge-Amp\`{e}re mass of a plurisubharmonic function with an isolated singularity, provided with the circular symmetry. With the aid of Sasakian geometry, we obtain an estimate on the residual mass of this function with respect to its Lelong number and maximal directional Lelong number. This result partially answers the zero mass conjecture raised by Guedj and Rashkovskii.


title: USL-Net: Uncertainty Self-Learning Network for Unsupervised Skin Lesion Segmentation

abstract: Unsupervised skin lesion segmentation offers several benefits, including conserving expert human resources, reducing discrepancies due to subjective human labeling, and adapting to novel environments. However, segmenting dermoscopic images without manual labeling guidance presents significant challenges due to dermoscopic image artifacts such as hair noise, blister noise, and subtle edge differences. To address these challenges, we introduce an innovative Uncertainty Self-Learning Network (USL-Net) designed for skin lesion segmentation. The USL-Net can effectively segment a range of lesions, eliminating the need for manual labeling guidance. Initially, features are extracted using contrastive learning, followed by the generation of Class Activation Maps (CAMs) as saliency maps using these features. The different CAM locations correspond to the importance of the lesion region based on their saliency. High-saliency regions in the map serve as pseudo-labels for lesion regions while low-saliency regions represent the background. However, intermediate regions can be hard to classify, often due to their proximity to lesion edges or interference from hair or blisters. Rather than risk potential pseudo-labeling errors or learning confusion by forcefully classifying these regions, we consider them as uncertainty regions, exempting them from pseudo-labeling and allowing the network to self-learn. Further, we employ connectivity detection and centrality detection to refine foreground pseudo-labels and reduce noise-induced errors. The application of cycle refining enhances performance further. Our method underwent thorough experimental validation on the ISIC-2017, ISIC-2018, and PH2 datasets, demonstrating that its performance is on par with weakly supervised and supervised methods, and exceeds that of other existing unsupervised methods.


title: Some results on shadowing and local entropy properties of dynamical systems

abstract: We consider some local entropy properties of dynamical systems under the assumption of shadowing. In the first part, we give necessary and sufficient conditions for shadowable points to be certain entropy points. In the second part, we give some necessary and sufficient conditions for (non) h-expansiveness under the assumption of shadowing and chain transitivity; and use the result to present a counter-example for a question raised by Artigue et al. [Proc. Amer. Math. Soc. 150 (2022), 3369-3378].


title: Reinforcement Learning for Robust Header Compression under Model Uncertainty

abstract: Robust header compression (ROHC), critically positioned between the network and the MAC layers, plays an important role in modern wireless communication systems for improving data efficiency. This work investigates bi-directional ROHC (BD-ROHC) integrated with a novel architecture of reinforcement learning (RL). We formulate a partially observable \emph{Markov} decision process (POMDP), in which agent is the compressor, and the environment consists of the decompressor, channel and header source. Our work adopts the well-known deep Q-network (DQN), which takes the history of actions and observations as inputs, and outputs the Q-values of corresponding actions. Compared with the ideal dynamic programming (DP) proposed in the existing works, our method is scalable to the state, action and observation spaces. In contrast, DP often suffers from formidable computational complexity when the number of states becomes large due to long decompressor feedback delay and complex channel models. In addition, our method does not require prior knowledge of the transition dynamics and accurate observation dependency of the model, which are often not available in many practical applications.


title: Beyond Fairness: Age-Harmless Parkinson's Detection via Voice

abstract: Parkinson's disease (PD), a neurodegenerative disorder, often manifests as speech and voice dysfunction. While utilizing voice data for PD detection has great potential in clinical applications, the widely used deep learning models currently have fairness issues regarding different ages of onset. These deep models perform well for the elderly group (age $>$ 55) but are less accurate for the young group (age $\leq$ 55). Through our investigation, the discrepancy between the elderly and the young arises due to 1) an imbalanced dataset and 2) the milder symptoms often seen in early-onset patients. However, traditional debiasing methods are impractical as they typically impair the prediction accuracy for the majority group while minimizing the discrepancy. To address this issue, we present a new debiasing method using GradCAM-based feature masking combined with ensemble models, ensuring that neither fairness nor accuracy is compromised. Specifically, the GradCAM-based feature masking selectively obscures age-related features in the input voice data while preserving essential information for PD detection. The ensemble models further improve the prediction accuracy for the minority (young group). Our approach effectively improves detection accuracy for early-onset patients without sacrificing performance for the elderly group. Additionally, we propose a two-step detection strategy for the young group, offering a practical risk assessment for potential early-onset PD patients.


title: Complete integrability and equilibrium thermodynamics of biaxial nematic systems with discrete orientational degrees of freedom

abstract: We study a discrete version of a biaxial nematic liquid crystal model with external fields via an approach based on the solution of differential identities for the partition function. In the thermodynamic limit, we derive the free energy of the model and the associated closed set of equations of state involving four order parameters, proving the integrability and exact solvability of the model. The equations of state are specified via a suitable representation of the orientational order parameters, which imply two-order parameter reductions in the absence of external fields. A detailed exact analysis of the equations of state reveal a rich phase diagram where isotropic versus uniaxial versus biaxial phase transitions are explicitly described, including the existence of triple and tricritical points. Results on the discrete models are qualitatively consistent with their continuum analog. This observation suggests that, in more general settings, discrete models may be used to capture and describe phenomena that also occur in the continuum for which exact equations of state in closed form are not available.