title: Calpric: Inclusive and Fine-grain Labeling of Privacy Policies with Crowdsourcing and Active Learning

abstract: A significant challenge to training accurate deep learning models on privacy policies is the cost and difficulty of obtaining a large and comprehensive set of training data. To address these challenges, we present Calpric , which combines automatic text selection and segmentation, active learning and the use of crowdsourced annotators to generate a large, balanced training set for privacy policies at low cost. Automated text selection and segmentation simplifies the labeling task, enabling untrained annotators from crowdsourcing platforms, like Amazon's Mechanical Turk, to be competitive with trained annotators, such as law students, and also reduces inter-annotator agreement, which decreases labeling cost. Having reliable labels for training enables the use of active learning, which uses fewer training samples to efficiently cover the input space, further reducing cost and improving class and data category balance in the data set. The combination of these techniques allows Calpric to produce models that are accurate over a wider range of data categories, and provide more detailed, fine-grain labels than previous work. Our crowdsourcing process enables Calpric to attain reliable labeled data at a cost of roughly $0.92-$1.71 per labeled text segment. Calpric 's training process also generates a labeled data set of 16K privacy policy text segments across 9 Data categories with balanced positive and negative samples.


title: Calibration of an SKA-Low Prototype Station Using Holographic Techniques

abstract: Performance of digitally beamformed phased arrays relies on accurate calibration of the array by obtaining gains of each antenna in the array. The stations of the Square Kilometer Array-Low (SKA-Low) are such digital arrays, where the station calibration is currently performed using conventional interferometric techniques. An alternative calibration technique similar to holography of dish based telescopes has been suggested in the past. In this paper, we develop a novel mathematical framework for holography employing tensors, which are multi-way data structures. Self-holography using a reference beam formed with the station under test itself and cross-holography using a different station to obtain the reference beam are unified under the same formalism. Besides, the relation between the two apparently distinct holographic approaches in the literature for phased arrays is shown, and we show that under certain conditions the two methods yield the same results. We test the various holographic techniques on an SKA-Low prototype station Aperture Array Verification System 2 (AAVS2) with the Sun as the calibrator. We perform self-holography of AAVS2 and cross-holography with simultaneous observations carried out with another station Engineering Development Array 2. We find the results from the holographic techniques to be consistent among themselves as well as with a more conventional calibration technique.


title: Transport and Connection to Heavy-ion Collisions via Heavy Flavor Probes

abstract: The heavy ion experiments in Relativistic Heavy Ion Collider (RHIC) and Large Hadron Collider (LHC) are going through upgrade in the next five years, shifting their focus more on the hard processes in the new runs. One of the main goals is to draw a finer image for the quark gluon plasma (QGP). The heavy flavor probes , which witness the whole history of heavy ion collision are particularly sensitive to test the properties of QGP formed in such collisions. The lattice results for heavy flavor probes provide transport and phenomenological models crucial inputs to describe the experimental observations like the strong suppression of the nuclear modification factor $R_{AA}$ and the non-zero azimuthal anisotropy at low $p_T$. In the last two years we have seen significant advances in the lattice QCD studies of heavy flavor probes, including the in-medium quarkonium properties, the complex static quark-antiquark potential and the heavy quark diffusion from lattice simulations at nonzero temperature. These achievements substantially deepen our understanding of the fate of quarkonium, the screening/unscreening of the complex potential and the temperature and quark mass dependence of the heavy quark diffusion in thermal medium. In these proceedings, we review recent results and briefly discuss possible directions in these studies.


title: Two-Stage Distributionally Robust Edge Node Placement Under Endogenous Demand Uncertainty

abstract: Edge computing (EC) promises to deliver low-latency and ubiquitous computation to numerous devices at the network edge. This paper aims to jointly optimize edge node (EN) placement and resource allocation for an EC platform, considering demand uncertainty. Diverging from existing approaches treating uncertainties as exogenous, we propose a novel two-stage decision-dependent distributionally robust optimization (DRO) framework to effectively capture the interdependence between EN placement decisions and uncertain demands. The first stage involves making EN placement decisions, while the second stage optimizes resource allocation after uncertainty revelation. We present an exact mixed-integer linear program reformulation for solving the underlying ``min-max-min" two-stage model. We further introduce a valid inequality method to enhance computational efficiency, especially for large-scale networks. Extensive numerical experiments demonstrate the benefits of considering endogenous uncertainties and the advantages of the proposed model and approach.


title: Exponential bases for parallelepipeds with frequencies lying in a prescribed lattice

abstract: The existence of a Fourier basis with frequencies in $\mathbb{R}^d$ for the space of square integrable functions supported on a given parallelepiped in $\mathbb{R}^d$, has been well understood since the 1950s. In a companion paper, we derived necessary and sufficient conditions for a parallelepiped in $\mathbb{R}^d$ to permit an orthogonal basis of exponentials with frequencies constrained to be a subset of a prescribed lattice in $\mathbb{R}^d$, a restriction relevant in many applications. In this paper, we investigate analogous conditions for parallelepipeds that permit a Riesz basis of exponentials with the same constraints on the frequencies. We provide a sufficient condition on the parallelepiped for the Riesz basis case which directly extends one of the necessary and sufficient conditions obtained in the orthogonal basis case. We also provide a sufficient condition which constrains the spectral norm of the matrix generating the parallelepiped, instead of constraining the structure of the matrix.


title: Cross-Modal Semi-Dense 6-DoF Tracking of an Event Camera in Challenging Conditions

abstract: Vision-based localization is a cost-effective and thus attractive solution for many intelligent mobile platforms. However, its accuracy and especially robustness still suffer from low illumination conditions, illumination changes, and aggressive motion. Event-based cameras are bio-inspired visual sensors that perform well in HDR conditions and have high temporal resolution, and thus provide an interesting alternative in such challenging scenarios. While purely event-based solutions currently do not yet produce satisfying mapping results, the present work demonstrates the feasibility of purely event-based tracking if an alternative sensor is permitted for mapping. The method relies on geometric 3D-2D registration of semi-dense maps and events, and achieves highly reliable and accurate cross-modal tracking results. Practically relevant scenarios are given by depth camera-supported tracking or map-based localization with a semi-dense map prior created by a regular image-based visual SLAM or structure-from-motion system. Conventional edge-based 3D-2D alignment is extended by a novel polarity-aware registration that makes use of signed time-surface maps (STSM) obtained from event streams. We furthermore introduce a novel culling strategy for occluded points. Both modifications increase the speed of the tracker and its robustness against occlusions or large view-point variations. The approach is validated on many real datasets covering the above-mentioned challenging conditions, and compared against similar solutions realised with regular cameras.


title: Quantum Simulations of Hadron Dynamics in the Schwinger Model using 112 Qubits

abstract: Hadron wavepackets are prepared and time evolved in the Schwinger model using 112 qubits of IBM's 133-qubit Heron quantum computer ibm_torino. The initialization of the hadron wavepacket is performed in two steps. First, the vacuum is prepared across the whole lattice using the recently developed SC-ADAPT-VQE algorithm and workflow. SC-ADAPT-VQE is then extended to the preparation of localized states, and used to establish a hadron wavepacket on top of the vacuum. This is done by adaptively constructing low-depth circuits that maximize the overlap with an adiabatically prepared hadron wavepacket. Due to the localized nature of the wavepacket, these circuits can be determined on a sequence of small lattices using classical computers, and then robustly scaled to prepare wavepackets on large lattices for simulations using quantum computers. Time evolution is implemented with a second-order Trotterization. To reduce both the required qubit connectivity and circuit depth, an approximate quasi-local interaction is introduced. This approximation is made possible by the emergence of confinement at long distances, and converges exponentially with increasing distance of the interactions. Using multiple error-mitigation strategies, up to 14 Trotter steps of time evolution are performed, employing 13,858 two-qubit gates (with a CNOT depth of 370). The propagation of hadrons is clearly identified, with results that compare favorably with Matrix Product State simulations. Prospects for a near-term quantum advantage in simulations of hadron scattering are discussed.


title: Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities

abstract: The rise of large foundation models, trained on extensive datasets, is revolutionizing the field of AI. Models such as SAM, DALL-E2, and GPT-4 showcase their adaptability by extracting intricate patterns and performing effectively across diverse tasks, thereby serving as potent building blocks for a wide range of AI applications. Autonomous driving, a vibrant front in AI applications, remains challenged by the lack of dedicated vision foundation models (VFMs). The scarcity of comprehensive training data, the need for multi-sensor integration, and the diverse task-specific architectures pose significant obstacles to the development of VFMs in this field. This paper delves into the critical challenge of forging VFMs tailored specifically for autonomous driving, while also outlining future directions. Through a systematic analysis of over 250 papers, we dissect essential techniques for VFM development, including data preparation, pre-training strategies, and downstream task adaptation. Moreover, we explore key advancements such as NeRF, diffusion models, 3D Gaussian Splatting, and world models, presenting a comprehensive roadmap for future research. To empower researchers, we have built and maintained https://github.com/zhanghm1995/Forge_VFM4AD, an open-access repository constantly updated with the latest advancements in forging VFMs for autonomous driving.


title: Enhancing Robustness of LLM-Synthetic Text Detectors for Academic Writing: A Comprehensive Analysis

abstract: The emergence of large language models (LLMs), such as Generative Pre-trained Transformer 4 (GPT-4) used by ChatGPT, has profoundly impacted the academic and broader community. While these models offer numerous advantages in terms of revolutionizing work and study methods, they have also garnered significant attention due to their potential negative consequences. One example is generating academic reports or papers with little to no human contribution. Consequently, researchers have focused on developing detectors to address the misuse of LLMs. However, most existing methods prioritize achieving higher accuracy on restricted datasets, neglecting the crucial aspect of generalizability. This limitation hinders their practical application in real-life scenarios where reliability is paramount. In this paper, we present a comprehensive analysis of the impact of prompts on the text generated by LLMs and highlight the potential lack of robustness in one of the current state-of-the-art GPT detectors. To mitigate these issues concerning the misuse of LLMs in academic writing, we propose a reference-based Siamese detector named Synthetic-Siamese which takes a pair of texts, one as the inquiry and the other as the reference. Our method effectively addresses the lack of robustness of previous detectors (OpenAI detector and DetectGPT) and significantly improves the baseline performances in realistic academic writing scenarios by approximately 67% to 95%.


title: Incremental Extractive Opinion Summarization Using Cover Trees

abstract: Extractive opinion summarization involves automatically producing a summary of text about an entity (e.g., a product's reviews) by extracting representative sentences that capture prevalent opinions in the review set. Typically, in online marketplaces user reviews accumulate over time, and opinion summaries need to be updated periodically to provide customers with up-to-date information. In this work, we study the task of extractive opinion summarization in an incremental setting, where the underlying review set evolves over time. Many of the state-of-the-art extractive opinion summarization approaches are centrality-based, such as CentroidRank (Radev et al., 2004; Chowdhury et al., 2022). CentroidRank performs extractive summarization by selecting a subset of review sentences closest to the centroid in the representation space as the summary. However, these methods are not capable of operating efficiently in an incremental setting, where reviews arrive one at a time. In this paper, we present an efficient algorithm for accurately computing the CentroidRank summaries in an incremental setting. Our approach, CoverSumm, relies on indexing review representations in a cover tree and maintaining a reservoir of candidate summary review sentences. CoverSumm's efficacy is supported by a theoretical and empirical analysis of running time. Empirically, on a diverse collection of data (both real and synthetically created to illustrate scaling considerations), we demonstrate that CoverSumm is up to 36x faster than baseline methods, and capable of adapting to nuanced changes in data distribution. We also conduct human evaluations of the generated summaries and find that CoverSumm is capable of producing informative summaries consistent with the underlying review set.


title: A Machine Learning made Catalog of FR-II Radio Galaxies from the FIRST Survey

abstract: We present an independent catalog (FRIIRGcat) of 45,241 Fanaroff-Riley Type II (FR-II) radio galaxies compiled from the Very Large Array Faint Images of the Radio Sky at Twenty-centimeters (FIRST) survey and employed the deep learning method. Among them, optical and/or infrared counterparts are identified for 41,425 FR-IIs. This catalog spans luminosities $2.63\times10^{22}\leq L_{\rm rad}\leq6.76\times10^{29}\,{\rm W}\,{\rm Hz}^{-1}$ and redshifts up to $z=5.01$. The spectroscopic classification indicates that there are 1431 low-excitation radio galaxies and 260 high-excitation radio galaxies. Among the spectroscopically identified sources, black hole masses are estimated for 4837 FR-IIs, which are in $10^{7.5}\lesssim M_{\rm BH}\lesssim 10^{9.5}$ $M_{\odot}$. Interestingly, this catalog reveals a couple of giant radio galaxies (GRGs), which are already in the existing GRG catalog, confirming the efficiency of this FR-II catalog. Furthermore, 284 new GRGs are unveiled in this new FR-II sample; they have the largest projected sizes ranging from 701 to 1209 kpc and are located at redshifts $0.31<z<2.42$. Finally, we explore the distribution of the jet position angle and it shows that the faint Images of the FIRST images are significantly affected by the systematic effect (the observing beams). The method presented in this work is expected to be applicable to the radio sky surveys that are currently being conducted because they have finely refined telescope arrays. On the other hand, we are expecting that further new methods will be dedicated to solving this problem.


title: EmoTalker: Emotionally Editable Talking Face Generation via Diffusion Model

abstract: In recent years, the field of talking faces generation has attracted considerable attention, with certain methods adept at generating virtual faces that convincingly imitate human expressions. However, existing methods face challenges related to limited generalization, particularly when dealing with challenging identities. Furthermore, methods for editing expressions are often confined to a singular emotion, failing to adapt to intricate emotions. To overcome these challenges, this paper proposes EmoTalker, an emotionally editable portraits animation approach based on the diffusion model. EmoTalker modifies the denoising process to ensure preservation of the original portrait's identity during inference. To enhance emotion comprehension from text input, Emotion Intensity Block is introduced to analyze fine-grained emotions and strengths derived from prompts. Additionally, a crafted dataset is harnessed to enhance emotion comprehension within prompts. Experiments show the effectiveness of EmoTalker in generating high-quality, emotionally customizable facial expressions.


title: Magneto-Thermoelectric Transport in Graphene Quantum Dot with Strong Correlations

abstract: Disorder at the etched edges of graphene quantum dots (GQD) enables random all-to-all interactions between localized charges in partially-filled Landau levels, providing a potential platform to realize the Sachdev-Ye-Kitaev (SYK) model. We use quantum Hall edge states in the graphene electrodes to measure electrical conductance and thermoelectric power across the GQD. We observe a rapid diminishing of electric conductance fluctuations and slowly decreasing thermoelectric power across the GQD with increasing temperature, consistent with recent theoretical predictions for the SYK regime.


title: Mass inversion at the Lifshitz transition in monolayer graphene by diffusive, high-density, on-chip, doping

abstract: Experimental setups for charge transport measurements are typically not compatible with the ultra-high vacuum conditions for chemical doping, limiting the charge carrier density that can be investigated by transport methods. Field-effect methods, including dielectric gating and ionic liquid gating, achieve too low a carrier density to induce electronic phase transitions. To bridge this gap, we developed an integrated flip-chip method to dope graphene by alkali vapour in the diffusive regime, suitable for charge transport measurements at ultra-high charge carrier density. We introduce a cesium droplet into a sealed cavity filled with inert gas to dope a monolayer graphene sample by the process of cesium atom diffusion, adsorption and ionization at the graphene surface, with doping beyond an electron density of $4.7\times10^{14}~\mathrm{cm}^{-2}$ monitored by operando Hall measurement. The sealed assembly is stable against oxidation, enabling measurement of charge transport versus temperature and magnetic field. Cyclotron mass inversion is observed via the Hall effect, indicative of the change of Fermi surface geometry associated with the Liftshitz transition at the hyperbolic $M$ point of monolayer graphene. The transparent quartz substrate also functions as an optical window, enabling non-resonant Raman scattering. Our findings show that chemical doping, hitherto restricted to ultra-high vacuum, can be applied in a diffusive regime at ambient pressure in an inert gas environment and thus enable charge transport studies in standard cryogenic environments


title: Multi-Input Multi-Output Target-Speaker Voice Activity Detection For Unified, Flexible, and Robust Audio-Visual Speaker Diarization

abstract: Audio-visual learning has demonstrated promising results in many classical speech tasks (e.g., speech separation, automatic speech recognition, wake-word spotting). We believe that introducing visual modality will also benefit speaker diarization. To date, Target-Speaker Voice Activity Detection (TS-VAD) plays an important role in highly accurate speaker diarization. However, previous TS-VAD models take audio features and utilize the speaker's acoustic footprint to distinguish his or her personal speech activities, which is easily affected by overlapped speech in multi-speaker scenarios. Although visual information naturally tolerates overlapped speech, it suffers from spatial occlusion, low resolution, etc. The potential modality-missing problem blocks TS-VAD towards an audio-visual approach. This paper proposes a novel Multi-Input Multi-Output Target-Speaker Voice Activity Detection (MIMO-TSVAD) framework for speaker diarization. The proposed method can take audio-visual input and leverage the speaker's acoustic footprint or lip track to flexibly conduct audio-based, video-based, and audio-visual speaker diarization in a unified sequence-to-sequence framework. Experimental results show that the MIMO-TSVAD framework demonstrates state-of-the-art performance on the VoxConverse, DIHARD-III, and MISP 2022 datasets under corresponding evaluation metrics, obtaining the Diarization Error Rates (DERs) of 4.18%, 10.10%, and 8.15%, respectively. In addition, it can perform robustly in heavy lip-missing scenarios.


title: SCoFT: Self-Contrastive Fine-Tuning for Equitable Image Generation

abstract: Accurate representation in media is known to improve the well-being of the people who consume it. Generative image models trained on large web-crawled datasets such as LAION are known to produce images with harmful stereotypes and misrepresentations of cultures. We improve inclusive representation in generated images by (1) engaging with communities to collect a culturally representative dataset that we call the Cross-Cultural Understanding Benchmark (CCUB) and (2) proposing a novel Self-Contrastive Fine-Tuning (SCoFT) method that leverages the model's known biases to self-improve. SCoFT is designed to prevent overfitting on small datasets, encode only high-level information from the data, and shift the generated distribution away from misrepresentations encoded in a pretrained model. Our user study conducted on 51 participants from 5 different countries based on their self-selected national cultural affiliation shows that fine-tuning on CCUB consistently generates images with higher cultural relevance and fewer stereotypes when compared to the Stable Diffusion baseline, which is further improved with our SCoFT technique.


title: Mobile robot localization with GNSS multipath detection using pseudorange residuals

abstract: This paper proposes a novel positioning technique suitable for use in mobile robots in urban environments in which large global navigation satellite system (GNSS) positioning errors occur because of multipath signals. During GNSS positioning, the GNSS satellites that are obstructed by buildings emit reflection and diffraction signals, which are called non-line-of-sight (NLOS) multipath signals. These multipath signals cause major positioning errors. The key concept considered in this paper is the estimation of a user's position using the likelihood of the position hypotheses computed from the GNSS pseudoranges, consisting only of LOS signals based on the analysis of the pseudorange residuals. To determine the NLOS GNSS signals from the pseudorange residuals at the user's position, it is necessary to accurately determine the position before the computation of the pseudorange residuals. This problem is solved using a particle filter. We propose a likelihood estimation method using the Mahalanobis distance between the hypotheses of the user's position computed from only the LOS pseudoranges and the particles. To confirm the effectiveness of the proposed technique, a positioning test was performed in a real-world urban environment. The results demonstrated that the proposed method is effective for accurately estimating the user's position in urban canyons.


title: A Programmable and Reconfigurable Photonic Simulator for Classical XY Models

abstract: In this work, we proposed and experimentally demonstrated a photonic simulator for XY models, which is a typical kind of classical spin models. By encoding the XY spins on the phase term of the input light field, the corresponding XY Hamiltonian could be performed on the output light intensities. The simulator is mainly based on a programmable and reconfigurable optical vector-matrix multiplication system, which can map arbitrary XY models within the dimensionality limit. Here, we demonstrated the Berezinskii-Kosterlitz-Thouless transition in a two-dimensional XY model, in which the expectation values of some observables are calculated and consistent with the theory. Besides, we performed the ground state search of two 25-spin XY models with different spin connections and coupling strengths. Our proposal paves a new way to investigate the XY spin system.


title: Robust Tiny Object Detection in Aerial Images amidst Label Noise

abstract: Precise detection of tiny objects in remote sensing imagery remains a significant challenge due to their limited visual information and frequent occurrence within scenes. This challenge is further exacerbated by the practical burden and inherent errors associated with manual annotation: annotating tiny objects is laborious and prone to errors (i.e., label noise). Training detectors for such objects using noisy labels often leads to suboptimal performance, with networks tending to overfit on noisy labels. In this study, we address the intricate issue of tiny object detection under noisy label supervision. We systematically investigate the impact of various types of noise on network training, revealing the vulnerability of object detectors to class shifts and inaccurate bounding boxes for tiny objects. To mitigate these challenges, we propose a DeNoising Tiny Object Detector (DN-TOD), which incorporates a Class-aware Label Correction (CLC) scheme to address class shifts and a Trend-guided Learning Strategy (TLS) to handle bounding box noise. CLC mitigates inaccurate class supervision by identifying and filtering out class-shifted positive samples, while TLS reduces noisy box-induced erroneous supervision through sample reweighting and bounding box regeneration. Additionally, Our method can be seamlessly integrated into both one-stage and two-stage object detection pipelines. Comprehensive experiments conducted on synthetic (i.e., noisy AI-TOD-v2.0 and DOTA-v2.0) and real-world (i.e., AI-TOD) noisy datasets demonstrate the robustness of DN-TOD under various types of label noise. Notably, when applied to the strong baseline RFLA, DN-TOD exhibits a noteworthy performance improvement of 4.9 points under 40% mixed noise. Datasets, codes, and models will be made publicly available.


title: Instrument-To-Instrument translation: Instrumental advances drive restoration of solar observation series via deep learning

abstract: The constant improvement of astronomical instrumentation provides the foundation for scientific discoveries. In general, these improvements have only implications forward in time, while previous observations do not benefit from this trend. Here we provide a general deep learning method that translates between image domains of different instruments (Instrument-To-Instrument translation; ITI). We demonstrate that the available data sets can directly profit from the most recent instrumental improvements, by applying our method to five different applications of ground- and space-based solar observations. We obtain 1) solar full-disk observations with unprecedented spatial resolution, 2) a homogeneous data series of 24 years of space-based observations of the solar EUV corona and magnetic field, 3) real-time mitigation of atmospheric degradations in ground-based observations, 4) a uniform series of ground-based H$\alpha$ observations starting from 1973, 5) magnetic field estimates from the solar far-side based on EUV imagery. The direct comparison to simultaneous high-quality observations shows that our method produces images that are perceptually similar and match the reference image distribution.


title: Toward Clinically Trustworthy Deep Learning: Applying Conformal Prediction to Intracranial Hemorrhage Detection

abstract: As deep learning (DL) continues to demonstrate its ability in radiological tasks, it is critical that we optimize clinical DL solutions to include safety. One of the principal concerns in the clinical adoption of DL tools is trust. This study aims to apply conformal prediction as a step toward trustworthiness for DL in radiology. This is a retrospective study of 491 non-contrast head CTs from the CQ500 dataset, in which three senior radiologists annotated slices containing intracranial hemorrhage (ICH). The dataset was split into definite and challenging subsets, where challenging images were defined to those in which there was disagreement among readers. A DL model was trained on 146 patients (10,815 slices) from the definite data (training dataset) to perform ICH localization and classification for five classes of ICH. To develop an uncertainty-aware DL model, 1,546 cases of the definite data (calibration dataset) was used for Mondrian conformal prediction (MCP). The uncertainty-aware DL model was tested on 8,401 definite and challenging cases to assess its ability to identify challenging cases. After the MCP procedure, the model achieved an F1 score of 0.920 for ICH classification on the test dataset. Additionally, it correctly identified 6,837 of the 6,856 total challenging cases as challenging (99.7% accuracy). It did not incorrectly label any definite cases as challenging. The uncertainty-aware ICH detector performs on par with state-of-the-art models. MCP's performance in detecting challenging cases demonstrates that it is useful in automated ICH detection and promising for trustworthiness in radiological DL.


title: Error correctable efficient quantum homomorphic encryption using Calderbank-Shor-Steane codes

abstract: To achieve fault-tolerant and secure cloud quantum computing, integrating quantum error correction codes and quantum homomorphic encryption schemes is essential. However, significant overhead challenges incurred in these schemes necessitate their efficiency. This study developed an efficient quantum homomorphic encryption based on quantum error correction codes. The proposed encryption scheme used a single encoding process to accomplish encryption and encoding. Using a longer quantum error-correcting code simultaneously improved the security and error correction capabilities. Based on the permutation key, the number of combinations exhibited an exponential growth of $n^n$ compared with the conventional order of $2^n$.


title: Fundamental Convergence Analysis of Sharpness-Aware Minimization

abstract: The paper investigates the fundamental convergence properties of Sharpness-Aware Minimization (SAM), a recently proposed gradient-based optimization method (Foret et al., 2021) that significantly improves the generalization of deep neural networks. The convergence properties including the stationarity of accumulation points, the convergence of the sequence of gradients to the origin, the sequence of function values to the optimal value, and the sequence of iterates to the optimal solution are established for the method. The universality of the provided convergence analysis based on inexact gradient descent frameworks (Khanh et al., 2023b) allows its extensions to the normalized versions of SAM such as VaSSO (Li & Giannakis, 2023), RSAM (Liu et al., 2022), and to the unnormalized versions of SAM such as USAM (Andriushchenko & Flammarion, 2022). Numerical experiments are conducted on classification tasks using deep learning models to confirm the practical aspects of our analysis.


title: Augmenting Ground-Level PM2.5 Prediction via Kriging-Based Pseudo-Label Generation

abstract: Fusing abundant satellite data with sparse ground measurements constitutes a major challenge in climate modeling. To address this, we propose a strategy to augment the training dataset by introducing unlabeled satellite images paired with pseudo-labels generated through a spatial interpolation technique known as ordinary kriging, thereby making full use of the available satellite data resources. We show that the proposed data augmentation strategy helps enhance the performance of the state-of-the-art convolutional neural network-random forest (CNN-RF) model by a reasonable amount, resulting in a noteworthy improvement in spatial correlation and a reduction in prediction error.


title: Extended Main Sequences in Star Clusters

abstract: Extended main sequences (eMSs) and extended main-sequence turnoffs (eMSTOs) are fascinating phenomena that are routinely observed in star clusters. These phenomena strongly challenge the current canonical "simple stellar population" picture of star clusters, which postulates that star clusters are coeval and chemically homogeneous and can thus be described by a single, unique isochrone. Detections of eMSs and eMSTOs provide valuable insights into stellar physics and the evolution of star clusters. This comprehensive review delves into the observational characteristics, underlying mechanisms, and astrophysical implications of the eMSs and eMSTOs observed in young (less than 600 million years) and intermediate-age (600 to 2000 million years) star clusters. Several scenarios or hypotheses have been proposed to explain these phenomena, including the presence of an age spread, binary interactions, variable stars, and differences in stellar rotation rates. This review discusses the advantages and limitations of current models. Among contemporary models and hypotheses, stellar rotation has been demonstrated as the most plausible mechanism to explain the occurrence of eMSs and eMSTOs. Research on stellar rotation and its connection to eMSs has opened up a myriad of fascinating avenues, such as investigations of the magnetic braking mechanism in stars, searches for tidally locked binary systems in star clusters, and investigations as to whether binary mergers can give rise to massive magnetars. These endeavors have yielded valuable insights and significantly enriched our understanding of stellar astrophysics.


title: An Infinite Double Bubble Theorem

abstract: The classical double bubble theorem characterizes the minimizing partitions of $\mathbb{R}^n$ into three chambers, two of which have prescribed finite volume. In this paper we prove a variant of the double bubble theorem in which two of the chambers have infinite volume. Such a configuration is an example of a (1,2)-cluster, or a partition of $\mathbb{R}^n$ into three chambers, two of which have infinite volume and only one of which has finite volume. A $(1,2)$-cluster is locally minimizing with respect to a family of weights $\{c_{jk}\}$ if for any $B_r(0)$, it minimizes the interfacial energy $\sum_{j<k} c_{jk} \mathscr{H}^n(\partial \mathscr{X}(j) \cap \partial\mathscr{X}(k) \cap B_r(0))$ among all variations with compact support in $B_r(0)$ which preserve the volume of $\mathscr{X}(1)$. For $(1,2)$ clusters, the analogue of the weighted double bubble is the weighted lens cluster, and we show that it is locally minimizing. Furthermore, under a symmetry assumption on $\{c_{jk}\}$ that includes the case of equal weights, the weighted lens cluster is the unique local minimizer in $\mathbb{R}^n$ for $n\leq 7$, with the same uniqueness holding in $\mathbb{R}^n$ for $n\geq 8$ under a natural growth assumption. We also obtain a closure theorem for locally minimizing $(N,2)$-clusters.


title: A new model of trust based on neural information processing

abstract: More than 30 years of research has firmly established the vital role of trust in human organizations and relationships, but the underlying mechanisms by which people build, lose, and rebuild trust remains incompletely understood. We propose a mechanistic model of trust that is grounded in the modern neuroscience of decision making. Since trust requires anticipating the future actions of others, any mechanistic model must be built upon up-to-date theories on how the brain learns, represents, and processes information about the future within its decision-making systems. Contemporary neuroscience has revealed that decision making arises from multiple parallel systems that perform distinct, complementary information processing. Each system represents information in different forms, and therefore learns via different mechanisms. When an act of trust is reciprocated or violated, this provides new information that can be used to anticipate future actions. The taxonomy of neural information representations that is the basis for the system boundaries between neural decision-making systems provides a taxonomy for categorizing different forms of trust and generating mechanistic predictions about how these forms of trust are learned and manifested in human behavior. Three key predictions arising from our model are (1) strategic risk-taking can reveal how to best proceed in a relationship, (2) human organizations and environments can be intentionally designed to encourage trust among their members, and (3) violations of trust need not always degrade trust, but can also provide opportunities to build trust.


title: Local measurement strategies for multipartite entanglement quantification

abstract: Despite multipartite entanglement being a global property of a quantum state, a number of recent works have made it clear that it can be quantified using only local measurements. This is appealing because local measurements are the easiest to implement on current quantum hardware. However, it remains an open question what protocol one should use in order to minimize the resources required to estimate multipartite entanglement from local measurements alone. In this work, we construct and compare several estimators of multipartite entanglement based solely on the data from local measurements. We first construct statistical estimators for a broad family of entanglement measures using local randomized measurement (LRM) data before providing a general criterion for the construction of such estimators in terms of projective 2-designs. Importantly, this allows us to de-randomize the multipartite estimation protocol based on LRMs. In particular, we show how local symmetric informationally complete POVMs enable multipartite entanglement quantification with only a single measurement setting. For all estimators, we provide both the classical post-processing cost and rigorous performance guarantees in the form of analytical upper bounds on the number of measurements needed to estimate the measures to any desired precision.


title: Achieve Fairness without Demographics for Dermatological Disease Diagnosis

abstract: In medical image diagnosis, fairness has become increasingly crucial. Without bias mitigation, deploying unfair AI would harm the interests of the underprivileged population and potentially tear society apart. Recent research addresses prediction biases in deep learning models concerning demographic groups (e.g., gender, age, and race) by utilizing demographic (sensitive attribute) information during training. However, many sensitive attributes naturally exist in dermatological disease images. If the trained model only targets fairness for a specific attribute, it remains unfair for other attributes. Moreover, training a model that can accommodate multiple sensitive attributes is impractical due to privacy concerns. To overcome this, we propose a method enabling fair predictions for sensitive attributes during the testing phase without using such information during training. Inspired by prior work highlighting the impact of feature entanglement on fairness, we enhance the model features by capturing the features related to the sensitive and target attributes and regularizing the feature entanglement between corresponding classes. This ensures that the model can only classify based on the features related to the target attribute without relying on features associated with sensitive attributes, thereby improving fairness and accuracy. Additionally, we use disease masks from the Segment Anything Model (SAM) to enhance the quality of the learned feature. Experimental results demonstrate that the proposed method can improve fairness in classification compared to state-of-the-art methods in two dermatological disease datasets.


title: TrajVis: a visual clinical decision support system to translate artificial intelligence trajectory models in the precision management of chronic kidney disease

abstract: Objective: Our objective is to develop and validate TrajVis, an interactive tool that assists clinicians in using artificial intelligence (AI) models to leverage patients' longitudinal electronic medical records (EMR) for personalized precision management of chronic disease progression. Methods: We first perform requirement analysis with clinicians and data scientists to determine the visual analytics tasks of the TrajVis system as well as its design and functionalities. A graph AI model for chronic kidney disease (CKD) trajectory inference named DEPOT is used for system development and demonstration. TrajVis is implemented as a full-stack web application with synthetic EMR data derived from the Atrium Health Wake Forest Baptist Translational Data Warehouse and the Indiana Network for Patient Care research database. A case study with a nephrologist and a user experience survey of clinicians and data scientists are conducted to evaluate the TrajVis system. Results: The TrajVis clinical information system is composed of four panels: the Patient View for demographic and clinical information, the Trajectory View to visualize the DEPOT-derived CKD trajectories in latent space, the Clinical Indicator View to elucidate longitudinal patterns of clinical features and interpret DEPOT predictions, and the Analysis View to demonstrate personal CKD progression trajectories. System evaluations suggest that TrajVis supports clinicians in summarizing clinical data, identifying individualized risk predictors, and visualizing patient disease progression trajectories, overcoming the barriers of AI implementation in healthcare. Conclusion: TrajVis bridges the gap between the fast-growing AI/ML modeling and the clinical use of such models for personalized and precision management of chronic diseases.


title: Representation Learning on Event Stream via an Elastic Net-incorporated Tensor Network

abstract: Event cameras are neuromorphic sensors that capture asynchronous and sparse event stream when per-pixel brightness changes. The state-of-the-art processing methods for event signals typically aggregate events into a frame or a grid. However, events are dense in time, these works are limited to local information of events due to the stacking. In this paper, we present a novel spatiotemporal representation learning method which can capture the global correlations of all events in the event stream simultaneously by tensor decomposition. In addition, with the events are sparse in space, we propose an Elastic Net-incorporated tensor network (ENTN) model to obtain more spatial and temporal details about event stream. Empirically, the results indicate that our method can represent the spatiotemporal correlation of events with high quality, and can achieve effective results in applications like filtering noise compared with the state-of-the-art methods.


title: Prediction challenge: First principles simulation of the ultrafast electron diffraction spectrum of cyclobutanone

abstract: Computer simulation has long been an essential partner of ultrafast experiments, allowing the assignment of microscopic mechanistic detail to low-dimensional spectroscopic data. However, the ability of theory to make a priori predictions of ultrafast experimental results is relatively untested. Herein, as a part of a community challenge, we attempt to predict the signal of an upcoming ultrafast photochemical experiment using state-of-the-art theory in the context of preexisting experimental data. Specifically, we employ ab initio Ehrenfest with collapse to a block (TAB) mixed quantum-classic simulations to describe the real-time evolution of the electrons and nuclei of cyclobutanone following excitation to the 3s Rydberg state. The gas-phase ultrafast electron diffraction (GUED) signal is simulated for direct comparison to an upcoming experiment at the Stanford Linear Accelerator Laboratory. Following initial ring-opening, dissociation via two distinct channels is observed: the C3 dissociation channel, producing cyclopropane and CO, and the C2 channel, producing CH$_2$CO and C$_2$H$_4$. Direct calculations of the GUED signal indicate how the ring-opened intermediate, the C2 products, and the C3 products can be discriminated in the GUED signal. We also report an a priori analysis of anticipated errors in our predictions: without knowledge of the experimental result, which features of the spectrum do we feel confident we have predicted correctly, and which might we have wrong?


title: Automated lag-selection for multi-step univariate time series forecast using Bayesian Optimization: Forecast station-wise monthly rainfall of nine divisional cities of Bangladesh

abstract: Rainfall is an essential hydrological component, and most of the economic activities of an agrarian country like Bangladesh depend on rainfall. An accurate rainfall forecast can help make necessary decisions and reduce the damages caused by heavy or low to no rainfall. The monthly average rainfall is a time series data, and recently, long short-term memory (LSTM) neural networks are being used heavily for time series forecasting problems. One major challenge of forecasting using LSTMs is to select the appropriate number of lag values. In this research, we considered the number of lag values selected as a hyperparameter of LSTM; it, with the other hyperparameters determining LSTMs structure, has been optimized using Bayesian optimization. We used our proposed method to forecast rainfall for nine different weather stations of Bangladesh. Finally, the performance of the proposed model has been compared with some other LSTM with different lag-selection methods and some several popular machine learning and statistical forecasting models.


title: On free boundary problems shaped by oscillatory singularities

abstract: We start the investigation of free boundary variational models featuring oscillatory singularities. The theory varies widely depending upon the nature of the singular power $\gamma(x)$ and how it oscillates. Under a mild continuity assumption on $\gamma(x)$, we prove the optimal regularity of minimizers. Such estimates vary point-by-point, leading to a continuum of free boundary geometries. We also conduct an extensive analysis of the free boundary shaped by the singularities. Utilizing a new monotonicity formula, we show that if the singular power $\gamma(x)$ varies in a $W^{1,n^{+}}$ fashion, then the free boundary is locally a $C^{1,\delta}$ surface, up to a negligible singular set of Hausdorff co-dimension at least $2$.


title: Higher-order topological phases in bilayer phononic crystals and topological bound states in the continuum

abstract: Recent studies on the interplay between band topology and layer degree of freedom provide an effective way to realize exotic topological phases. Here we systematically study the $C_6$- and $C_3$-symmetric higher-order topological phases in bilayer spinless tight-binding lattice models. For concreteness, we consider bilayer phononic crystals as the realizations of these models. We find that for mirror-symmetric-stacking bilayer lattices, the interlayer couplings control the emergence and disappearance of the topological bound states in the continuum where we consider the corner states as possible bound states in the bulk continuum. For the bilayer phononic crystals formed by two different lattices with identical symmetry, the band topology is determined by both the band topology of each layer as well as their mutual couplings. The bilayer phononic crystals experience a phase transition from nontrivial to trivial band topology when the interlayer couplings are gradually increased. Our work unveils the rich physics and topological phases emerging in bilayer lattice systems that can be used to engineer interesting phenomena and induce emergent topological phases.


title: Xaminer: An Internet Cross-Layer Resilience Analysis Tool

abstract: A resilient Internet infrastructure is critical in our highly interconnected society. However, the Internet faces several vulnerabilities, ranging from natural disasters to human activities, that can impact the physical layer and, in turn, the higher network layers, such as IP links. In this paper, we introduce Xaminer, the first Internet cross-layer resilience analysis tool, to evaluate the interplay between physical- and network-layer failures. Using a cross-layer Internet map and a failure event model, Xaminer generates a risk profile encompassing a cross-layer impact report, critical infrastructure identification at each layer, and the discovery of trends and patterns under different failure event settings. Xaminer's key strengths lie in its adaptability to diverse disaster scenarios, the ability to assess risks at various granularities, and the capability to generate joint risk profiles for multiple events. We demonstrate Xaminer's capabilities in cross-layer analysis across a spectrum of disaster event models and regions, showcasing its potential role in facilitating well-informed decision-making for resilience planning and deployments.


title: The Graded Algebras whose Neutral Components Satisfy a Polynomial Identity of Degree 2

abstract: Let $\mathbb{F}$ be a field and $\mathsf{G}$ a group. We study the following problem: how to describe the $\mathsf{G}$-graded associative $\mathbb{F}$-algebras whose neutral components satisfy some polynomial identity of degree $2$? We presented a description of these (graded) polynomial identities and their consequences. Later, for $\mathsf{G}$ finite abelian and $\mathbb{F}$ algebraically closed with $\mathsf{char}(\mathbb{F})=0$, we proved that, given a finitely generated $\mathsf{G}$-graded $\mathbb{F}$-algebra $\mathfrak{A}$, if $\mathfrak{A}_e$ satisfies a polynomial identity $g\in\mathbb{F}\langle X^{\mathsf{G}} \rangle$ of degree $2$, then $\mathfrak{A}$ either is nilpotent or has the commutative neutral component. Furthermore, we proved that, in characteristic zero, if $\mathsf{G}$ is finite cyclic and $\mathfrak{A}$ is finitely generated such that $\mathfrak{A}_e$ is central, then the Lie algebra $\mathfrak{A}^{(-)}$ is solvable. In addition, when the support of grading of $\mathfrak{A}$ has at most $3$ elements, then $\mathfrak{A}^{(-)}$ is a nilpotent Lie algebra.


title: Maximum principle for optimal control of interacting particle system: stochastic flow model

abstract: In this paper, we consider the stochastic optimal control problem for the interacting particle system. We obtain the stochastic maximum principle of the optimal control system by introducing a generalized backward stochastic differential equation with interaction. The existence and uniqueness of the solution of this type of equation is proved. We derive the necessary condition that the optimal control should satisfy. As an application, the linear quadratic case is investigated to illustrate the main results.


title: Influence of temperature, doping, and amorphization on the electronic structure and magnetic damping of iron

abstract: Hybrid magnonic quantum systems have drawn increased attention in recent years for coherent quantum information processing, but too large magnetic damping is a persistent concern when metallic magnets are used. Their intrinsic damping is largely determined by electron-magnon scattering induced by spin-orbit interactions. In the low scattering limit, damping is dominated by intra-band electronic transitions, which has been theoretically shown to be proportional to the electronic density of states at the Fermi level. In this work, we focus on body-centered-cubic iron as a paradigmatic ferromagnetic material. We comprehensively study its electronic structure using first-principles density functional theory simulations and account for finite lattice temperature, boron (B) doping, and structure amorphization. Our results indicate that temperature induced atomic disorder and amorphous atomic geometries only have a minor influence. Instead, boron doping noticeably decreases the density of states near the Fermi level with an optimal doping level of 6.25%. In addition, we show that this reduction varies significantly for different atomic geometries and report that the highest reduction correlates with a large magnetization of the material. This may suggest materials growth under external magnetic fields as a route to explore in experiment.


title: Transformer-based approach for Ethereum Price Prediction Using Crosscurrency correlation and Sentiment Analysis

abstract: The research delves into the capabilities of a transformer-based neural network for Ethereum cryptocurrency price forecasting. The experiment runs around the hypothesis that cryptocurrency prices are strongly correlated with other cryptocurrencies and the sentiments around the cryptocurrency. The model employs a transformer architecture for several setups from single-feature scenarios to complex configurations incorporating volume, sentiment, and correlated cryptocurrency prices. Despite a smaller dataset and less complex architecture, the transformer model surpasses ANN and MLP counterparts on some parameters. The conclusion presents a hypothesis on the illusion of causality in cryptocurrency price movements driven by sentiments.


title: Model structure from one hereditary complete cortorsion pair

abstract: In contrast with the Hovey correspondence of abelian model structures from two complete cotorsion pairs, Beligiannis and Reiten give a construction of model structures on abelian categories from only one complete cotorsion pair. The aim of this paper is to extend this result to weakly idempotent complete exact categories, by adding the condition of heredity of the complete cotorsion pair. In fact, even for abelian categories, this condition of heredity should be added. This construction really gives model structures which are not necessarily exact in the sense of Gillespie. The correspondence of Beligiannis and Reiten of weakly projective model structures also holds for weakly idempotent complete exact categories.


title: Adversarial Masking Contrastive Learning for vein recognition

abstract: Vein recognition has received increasing attention due to its high security and privacy. Recently, deep neural networks such as Convolutional neural networks (CNN) and Transformers have been introduced for vein recognition and achieved state-of-the-art performance. Despite the recent advances, however, existing solutions for finger-vein feature extraction are still not optimal due to scarce training image samples. To overcome this problem, in this paper, we propose an adversarial masking contrastive learning (AMCL) approach, that generates challenging samples to train a more robust contrastive learning model for the downstream palm-vein recognition task, by alternatively optimizing the encoder in the contrastive learning model and a set of latent variables. First, a huge number of masks are generated to train a robust generative adversarial network (GAN). The trained generator transforms a latent variable from the latent variable space into a mask space. Then, we combine the trained generator with a contrastive learning model to obtain our AMCL, where the generator produces challenging masking images to increase the contrastive loss and the contrastive learning model is trained based on the harder images to learn a more robust feature representation. After training, the trained encoder in the contrastive learning model is combined with a classification layer to build a classifier, which is further fine-tuned on labeled training data for vein recognition. The experimental results on three databases demonstrate that our approach outperforms existing contrastive learning approaches in terms of improving identification accuracy of vein classifiers and achieves state-of-the-art recognition results.


title: Approximations of the integral of a class of sinusoidal composite functions

abstract: Two approximations of the integral of a class of sinusoidal composite functions, for which an explicit form does not exist, are derived. Numerical experiments show that the proposed approximations yield an error that does not depend on the width of the integration interval. Using such approximations, definite integrals can be computed in almost real-time.


title: Predicting Next Useful Location With Context-Awareness: The State-Of-The-Art

abstract: Predicting the future location of mobile objects reinforces location-aware services with proactive intelligence and helps businesses and decision-makers with better planning and near real-time scheduling in different applications such as traffic congestion control, location-aware advertisements, and monitoring public health and well-being. The recent developments in the smartphone and location sensors technology and the prevalence of using location-based social networks alongside the improvements in artificial intelligence and machine learning techniques provide an excellent opportunity to exploit massive amounts of historical and real-time contextual information to recognise mobility patterns and achieve more accurate and intelligent predictions. This survey provides a comprehensive overview of the next useful location prediction problem with context-awareness. First, we explain the concepts of context and context-awareness and define the next location prediction problem. Then we analyse nearly thirty studies in this field concerning the prediction method, the challenges addressed, the datasets and metrics used for training and evaluating the model, and the types of context incorporated. Finally, we discuss the advantages and disadvantages of different approaches, focusing on the usefulness of the predicted location and identifying the open challenges and future work on this subject by introducing two potential use cases of next location prediction in the automotive industry.


title: Pixelating Relations and Functions Without Adding Substructures

abstract: We investigate models of relations over a bounded continuous segment of real numbers, along with the natural linear order over the reals being provided as a "hard-coded" relation. This paper presents a generalization of a lemma from [Ben-Eliezer, Fischer, Levi and Yoshida, ITCS 2021], showing that with a small amount of modification (measured in terms of the Lebesgue measure) we can replace such a model with a "pixelated" one that has a finite description, in a way that preserves all universally quantified statements over the relations, or in other words, without adding any new substructures.


title: UV-SAM: Adapting Segment Anything Model for Urban Village Identification

abstract: Urban villages, defined as informal residential areas in or around urban centers, are characterized by inadequate infrastructures and poor living conditions, closely related to the Sustainable Development Goals (SDGs) on poverty, adequate housing, and sustainable cities. Traditionally, governments heavily depend on field survey methods to monitor the urban villages, which however are time-consuming, labor-intensive, and possibly delayed. Thanks to widely available and timely updated satellite images, recent studies develop computer vision techniques to detect urban villages efficiently. However, existing studies either focus on simple urban village image classification or fail to provide accurate boundary information. To accurately identify urban village boundaries from satellite images, we harness the power of the vision foundation model and adapt the Segment Anything Model (SAM) to urban village segmentation, named UV-SAM. Specifically, UV-SAM first leverages a small-sized semantic segmentation model to produce mixed prompts for urban villages, including mask, bounding box, and image representations, which are then fed into SAM for fine-grained boundary identification. Extensive experimental results on two datasets in China demonstrate that UV-SAM outperforms existing baselines, and identification results over multiple years show that both the number and area of urban villages are decreasing over time, providing deeper insights into the development trends of urban villages and sheds light on the vision foundation models for sustainable cities. The dataset and codes of this study are available at https://github.com/tsinghua-fib-lab/UV-SAM.


title: Existence of Julia-Zee dyon and 't Hooft-Polyakov monopole with new field strength tensor

abstract: In this paper, we use a modified Abelian field strength tensor in Georgi-Glashow model and obtain a new Julia-Zee dyon equations which degenerated into the 't Hooft-Polyakov monopole equations when the profile function J=0. Combining a three-step iterative shooting argument and a fixed-point theorem approach, we establish the existence of the static solution of the Julia-Zee dyon equations and discuss its qualitative properties. In addition, we show that the total magnetic charge is a constant related to the gauge coupling constant and the total electric charge depend continuously on the profile functions.


title: Testing gravity with Extreme-Mass-Ratio Inspirals

abstract: Extreme-mass-ratio inspirals consist of binary systems of compact objects, with orders of magnitude differences in their masses, in the regime where the dynamics are driven by gravitational wave emission. The unique nature of extreme-mass-ratio inspirals facilitates the exploration of diverse and stimulating tests related to various aspects of black holes and General Relativity. These tests encompass investigations into the spacetime geometry, the dissipation of the binary system energy and angular momentum, and the impact of the intrinsic non-linear effects of the gravitational interaction. This review accounts for the manifold opportunities for testing General Relativity, ranging from examinations of black hole properties to cosmological and multimessenger tests.


title: Spatial-Semantic Collaborative Cropping for User Generated Content

abstract: A large amount of User Generated Content (UGC) is uploaded to the Internet daily and displayed to people world-widely through the client side (e.g., mobile and PC). This requires the cropping algorithms to produce the aesthetic thumbnail within a specific aspect ratio on different devices. However, existing image cropping works mainly focus on landmark or landscape images, which fail to model the relations among the multi-objects with the complex background in UGC. Besides, previous methods merely consider the aesthetics of the cropped images while ignoring the content integrity, which is crucial for UGC cropping. In this paper, we propose a Spatial-Semantic Collaborative cropping network (S2CNet) for arbitrary user generated content accompanied by a new cropping benchmark. Specifically, we first mine the visual genes of the potential objects. Then, the suggested adaptive attention graph recasts this task as a procedure of information association over visual nodes. The underlying spatial and semantic relations are ultimately centralized to the crop candidate through differentiable message passing, which helps our network efficiently to preserve both the aesthetics and the content integrity. Extensive experiments on the proposed UGCrop5K and other public datasets demonstrate the superiority of our approach over state-of-the-art counterparts. Our project is available at https://github.com/suyukun666/S2CNet.


title: Probing quantum floating phases in Rydberg atom arrays

abstract: The floating phase, a critical incommensurate phase, has been theoretically predicted as a potential intermediate phase between crystalline ordered and disordered phases. In this study, we investigate the different quantum phases that arise in ladder arrays comprising up to 92 neutral-atom qubits and experimentally observe the emergence of the quantum floating phase. We analyze the site-resolved Rydberg state densities and the distribution of state occurrences. The site-resolved measurement reveals the formation of domain walls within the commensurate ordered phase, which subsequently proliferate and give rise to the floating phase with incommensurate quasi-long-range order. By analyzing the Fourier spectra of the Rydberg density-density correlations, we observe clear signatures of the incommensurate wave order of the floating phase. Furthermore, as the experimental system sizes increase, we show that the wave vectors approach a continuum of values incommensurate with the lattice. Our work motivates future studies to further explore the nature of commensurate-incommensurate phase transitions and their non-equilibrium physics.

categories: quant-ph cond-mat.quant-gas hep-lat physics.atom-ph


title: Enhancing Document-level Translation of Large Language Model via Translation Mixed-instructions

abstract: Existing large language models (LLMs) for machine translation are typically fine-tuned on sentence-level translation instructions and achieve satisfactory performance at the sentence level. However, when applied to document-level translation, these models face a significant challenge, particularly when dealing with documents containing over 512 tokens. This challenge arises from the issue of sentence-level coverage, where subsequent sentences in the document remain untranslated. As a result, the document-level translation capability of LLMs fine-tuned on sentence-level translation instructions is significantly limited. We conjecture that the primary cause of LLMs' weak document-level translation performance is the absence of document-to-document mapping ability. To address the issue, we propose an approach that combines sentence-level and document-level translation instructions of varying lengths to fine-tune LLMs. Our proposed translation mixed-instructions enable LLMs (Llama-2~7B and 13B) to maintain consistent translation performance from the sentence level to documents containing as many as 2048 tokens. Extensive experimental results show that the proposed approach significantly enhances the document-level translation capabilities of LLMs on 10 language pairs, effectively mitigating the sentence-level coverage issue in document-level translation. Experimentation on discourse phenomena has demonstrated that our document-level translation approach significantly improves translation quality, both in terms of BLEU score and discourse coherence.


title: A Study on Training and Developing Large Language Models for Behavior Tree Generation

abstract: This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT generation method is inefficient and heavily reliant on domain expertise. On the other hand, existing automatic BT generation technologies encounter bottlenecks related to task complexity, model adaptability, and reliability. In order to overcome these challenges, we propose a novel methodology that leverages the robust representation and reasoning abilities of LLMs. The core contribution of this paper lies in the design of a BT generation framework based on LLM, which encompasses the entire process, from data synthesis and model training to application developing and data verification. Synthetic data is introduced to train the BT generation model (BTGen model), enhancing its understanding and adaptability to various complex tasks, thereby significantly improving its overall performance. In order to ensure the effectiveness and executability of the generated BTs, we emphasize the importance of data verification and introduce a multilevel verification strategy. Additionally, we explore a range of agent design and development schemes with LLM as the central element. We hope that the work in this paper may provide a reference for the researchers who are interested in BT generation based on LLMs.


title: Into nonlinearity and beyond for Zernike-like wavefront sensors

abstract: Context: Telescopes like the Extremely Large Telescope (ELT) and the Giant Magellan Telescope (GMT) will be used together with extreme adaptive optics (AO) instruments to directly image Earth-like planets. The AO systems will need to perform at the fundamental limit in order to image Earth twins. A crucial component is the wavefront sensor. Interferometric wavefront sensors, such as the Zernike wavefront sensor (ZWFS), have been shown to perform close to the fundamental sensitivity limit. However, sensitivity comes at the cost of linearity; the ZWFS has strong nonlinear behavior. Aims: The aim of this work is to increase the dynamic range of Zernike-like wavefront sensors by using nonlinear reconstruction algorithms combined with phase sorting interferometry (PSI) and multi-wavelength measurements. Methods: The response of the ZWFS is explored analytically and numerically. Results: The proposed iterative (non)linear reconstructors reach the machine precision for small aberrations (<0.25 rad rms). Coupling the nonlinear reconstruction algorithm with PSI increases the dynamic range of the ZWFS by a factor of three to about 0.75 rad rms. Adding multiple wavebands doubles the dynamic range again, to 1.4 radians rms. Conclusion: The ZWFS is one of the most sensitive wavefront sensors, but has a limited dynamic range. The ZWFS will be an ideal second-stage wavefront sensor if it is combined with the proposed nonlinear reconstruction algorithm.


title: 'One Style Does Not Regulate All': Moderation Practices in Public and Private WhatsApp Groups

abstract: WhatsApp is the largest social media platform in the Global South and is a virulent force in global misinformation and political propaganda. Due to end-to-end encryption WhatsApp can barely review any content and this often pushes the responsibility of moderation towards group admins. Yet, little is known about how WhatsApp group admins manage their groups, what factors and values influence moderation decisions, and what challenges they face in moderating their groups. To fill this gap, we interviewed admins of 32 diverse groups and reviewed content from 30 public groups in India and Bangladesh. We observed notable differences in the formation, members' behavior, and moderation of public versus private groups, as well as in how WhatsApp admins operate compared to those on other platforms. We used Baumrind's typology of 'parenting styles' as a lens to explore moderation practices in WhatsApp groups and identified four moderation styles based on how responsive and controlling the admins were and discuss design recommendations to help them better manage problematic content in WhatsApp groups.


title: A Survey of Resource-efficient LLM and Multimodal Foundation Models

abstract: Large foundation models, including large language models (LLMs), vision transformers (ViTs), diffusion, and LLM-based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the substantial advancements in versatility and performance these models offer come at a significant cost in terms of hardware resources. To support the growth of these large models in a scalable and environmentally sustainable way, there has been a considerable focus on developing resource-efficient strategies. This survey delves into the critical importance of such research, examining both algorithmic and systemic aspects. It offers a comprehensive analysis and valuable insights gleaned from existing literature, encompassing a broad array of topics from cutting-edge model architectures and training/serving algorithms to practical system designs and implementations. The goal of this survey is to provide an overarching understanding of how current approaches are tackling the resource challenges posed by large foundation models and to potentially inspire future breakthroughs in this field.


title: A Two-Step Longstaff Schwartz Monte Carlo Approach to Game Option Pricing

abstract: We proposed a two-step Longstaff Schwartz Monte Carlo (LSMC) method with two regression models fitted at each time step to price game options. Although the original LSMC can be used to price game options with an enlarged range of path in regression and a modified cashflow updating rule, we identified a drawback of such approach, which motivated us to propose our approach. We implemented numerical examples with benchmarks using binomial tree and numerical PDE, and it showed that our method produces more reliable results comparing to the original LSMC.


title: Optimal Insurance to Maximize Exponential Utility when Premium is Computed by a Convex Functional

abstract: We find the optimal indemnity to maximize the expected utility of terminal wealth of a buyer of insurance whose preferences are modeled by an exponential utility. The insurance premium is computed by a convex functional. We obtain a necessary condition for the optimal indemnity; then, because the candidate optimal indemnity is given implicitly, we use that necessary condition to develop a numerical algorithm to compute it. We prove that the numerical algorithm converges to a unique indemnity that, indeed, equals the optimal policy. We also illustrate our results with numerical examples.


title: DurFlex-EVC: Duration-Flexible Emotional Voice Conversion with Parallel Generation

abstract: Emotional voice conversion (EVC) seeks to modify the emotional tone of a speaker's voice while preserving the original linguistic content and the speaker's unique vocal characteristics. Recent advancements in EVC have involved the simultaneous modeling of pitch and duration, utilizing the potential of sequence-to-sequence (seq2seq) models. To enhance reliability and efficiency in conversion, this study shifts focus towards parallel speech generation. We introduce Duration-Flexible EVC (DurFlex-EVC), which integrates a style autoencoder and unit aligner. Traditional models, while incorporating self-supervised learning (SSL) representations that contain both linguistic and paralinguistic information, have neglected this dual nature, leading to reduced controllability. Addressing this issue, we implement cross-attention to synchronize these representations with various emotions. Additionally, a style autoencoder is developed for the disentanglement and manipulation of style elements. The efficacy of our approach is validated through both subjective and objective evaluations, establishing its superiority over existing models in the field.


title: Learning Disentangled Speech Representations with Contrastive Learning and Time-Invariant Retrieval

abstract: Voice conversion refers to transferring speaker identity with well-preserved content. Better disentanglement of speech representations leads to better voice conversion. Recent studies have found that phonetic information from input audio has the potential ability to well represent content. Besides, the speaker-style modeling with pre-trained models making the process more complex. To tackle these issues, we introduce a new method named "CTVC" which utilizes disentangled speech representations with contrastive learning and time-invariant retrieval. Specifically, a similarity-based compression module is used to facilitate a more intimate connection between the frame-level hidden features and linguistic information at phoneme-level. Additionally, a time-invariant retrieval is proposed for timbre extraction based on multiple segmentations and mutual information. Experimental results demonstrate that "CTVC" outperforms previous studies and improves the sound quality and similarity of converted results.


title: Fairness Concerns in App Reviews: A Study on AI-based Mobile Apps

abstract: Fairness is one of the socio-technical concerns that must be addressed in AI-based systems. Unfair AI-based systems, particularly unfair AI-based mobile apps, can pose difficulties for a significant proportion of the global population. This paper aims to analyze fairness concerns in AI-based app reviews. We first manually constructed a ground-truth dataset, including 1,132 fairness and 1,473 non-fairness reviews. Leveraging the ground-truth dataset, we developed and evaluated a set of machine learning and deep learning models that distinguish fairness reviews from non-fairness reviews. Our experiments show that our best-performing model can detect fairness reviews with a precision of 94%. We then applied the best-performing model on approximately 9.5M reviews collected from 108 AI-based apps and identified around 92K fairness reviews. Next, applying the K-means clustering technique to the 92K fairness reviews, followed by manual analysis, led to the identification of six distinct types of fairness concerns (e.g., 'receiving different quality of features and services in different platforms and devices' and 'lack of transparency and fairness in dealing with user-generated content'). Finally, the manual analysis of 2,248 app owners' responses to the fairness reviews identified six root causes (e.g., 'copyright issues') that app owners report to justify fairness concerns.


title: Attention-Based CNN-BiLSTM for Sleep State Classification of Spatiotemporal Wide-Field Calcium Imaging Data

abstract: Background: Wide-field calcium imaging (WFCI) with genetically encoded calcium indicators allows for spatiotemporal recordings of neuronal activity in mice. When applied to the study of sleep, WFCI data are manually scored into the sleep states of wakefulness, non-REM (NREM) and REM by use of adjunct EEG and EMG recordings. However, this process is time-consuming, invasive and often suffers from low inter- and intra-rater reliability. Therefore, an automated sleep state classification method that operates on spatiotemporal WFCI data is desired. New Method: A hybrid network architecture consisting of a convolutional neural network (CNN) to extract spatial features of image frames and a bidirectional long short-term memory network (BiLSTM) with attention mechanism to identify temporal dependencies among different time points was proposed to classify WFCI data into states of wakefulness, NREM and REM sleep. Results: Sleep states were classified with an accuracy of 84% and Cohen's kappa of 0.64. Gradient-weighted class activation maps revealed that the frontal region of the cortex carries more importance when classifying WFCI data into NREM sleep while posterior area contributes most to the identification of wakefulness. The attention scores indicated that the proposed network focuses on short- and long-range temporal dependency in a state-specific manner. Comparison with Existing Method: On a 3-hour WFCI recording, the CNN-BiLSTM achieved a kappa of 0.67, comparable to a kappa of 0.65 corresponding to the human EEG/EMG-based scoring. Conclusions: The CNN-BiLSTM effectively classifies sleep states from spatiotemporal WFCI data and will enable broader application of WFCI in sleep.


title: Inpainting Normal Maps for Lightstage data

abstract: This study introduces a novel method for inpainting normal maps using a generative adversarial network (GAN). Normal maps, often derived from a lightstage, are crucial in performance capture but can have obscured areas due to movement (e.g., by arms, hair, or props). Inpainting fills these missing areas with plausible data. Our approach extends previous general image inpainting techniques, employing a bow tie-like generator network and a discriminator network, with alternating training phases. The generator aims to synthesize images aligning with the ground truth and deceive the discriminator, which differentiates between real and processed images. Periodically, the discriminator undergoes retraining to enhance its ability to identify processed images. Importantly, our method adapts to the unique characteristics of normal map data, necessitating modifications to the loss function. We utilize a cosine loss instead of mean squared error loss for generator training. Limited training data availability, even with synthetic datasets, demands significant augmentation, considering the specific nature of the input data. This includes appropriate image flipping and in-plane rotations to accurately alter normal vectors. Throughout training, we monitored key metrics such as average loss, Structural Similarity Index Measure (SSIM), and Peak Signal-to-Noise Ratio (PSNR) for the generator, along with average loss and accuracy for the discriminator. Our findings suggest that the proposed model effectively generates high-quality, realistic inpainted normal maps, suitable for performance capture applications. These results establish a foundation for future research, potentially involving more advanced networks and comparisons with inpainting of source images used to create the normal maps.


title: KTVIC: A Vietnamese Image Captioning Dataset on the Life Domain

abstract: Image captioning is a crucial task with applications in a wide range of domains, including healthcare and education. Despite extensive research on English image captioning datasets, the availability of such datasets for Vietnamese remains limited, with only two existing datasets. In this study, we introduce KTVIC, a comprehensive Vietnamese Image Captioning dataset focused on the life domain, covering a wide range of daily activities. This dataset comprises 4,327 images and 21,635 Vietnamese captions, serving as a valuable resource for advancing image captioning in the Vietnamese language. We conduct experiments using various deep neural networks as the baselines on our dataset, evaluating them using the standard image captioning metrics, including BLEU, METEOR, CIDEr, and ROUGE. Our findings underscore the effectiveness of the proposed dataset and its potential contributions to the field of image captioning in the Vietnamese context.


title: Direct production of SM-singlet scalars at the muon collider

abstract: The present work proposes a minimal extension of the Standard Model~(SM) where a gauge-singlet scalar~($\phi$) can be directly produced at the muon colliders without relying on its mixing with any other doublet state present in the theory. The New Physics~(NP) interactions include a TeV-scale scalar leptoquark of electromagnetic charge 1/3 arising naturally in a grand unifying gauge formulation. Within the proposed framework, the SM-singlet scalar can effectively couple to various SM fields at the one-loop level, out of which the $\bar{\mu}\mu\phi$ and $\gamma\gamma\phi$ couplings are crucial to produce it at the future muon colliders. Assuming $\mathcal{O}(1)$ NP couplings, the decay widths and production cross-section of the singlet scalar have been discussed in detail over the considered parameter space. Depending on the resonance scale, di-lepton and/or di-gluon channels can be significant to test/falsify the model.


title: DIFFRENT: A Diffusion Model for Recording Environment Transfer of Speech

abstract: Properly setting up recording conditions, including microphone type and placement, room acoustics, and ambient noise, is essential to obtaining the desired acoustic characteristics of speech. In this paper, we propose Diff-R-EN-T, a Diffusion model for Recording ENvironment Transfer which transforms the input speech to have the recording conditions of a reference speech while preserving the speech content. Our model comprises the content enhancer, the recording environment encoder, and the diffusion decoder which generates the target mel-spectrogram by utilizing both enhancer and encoder as input conditions. We evaluate DiffRENT in the speech enhancement and acoustic matching scenarios. The results show that DiffRENT generalizes well to unseen environments and new speakers. Also, the proposed model achieves superior performances in objective and subjective evaluation. Sound examples of our proposed model are available online.


title: Resolving Ethics Trade-offs in Implementing Responsible AI

abstract: While the operationalisation of high-level AI ethics principles into practical AI/ML systems has made progress, there is still a theory-practice gap in managing tensions between the underlying AI ethics aspects. We cover five approaches for addressing the tensions via trade-offs, ranging from rudimentary to complex. The approaches differ in the types of considered context, scope, methods for measuring contexts, and degree of justification. None of the approaches is likely to be appropriate for all organisations, systems, or applications. To address this, we propose a framework which consists of: (i) proactive identification of tensions, (ii) prioritisation and weighting of ethics aspects, (iii) justification and documentation of trade-off decisions. The proposed framework aims to facilitate the implementation of well-rounded AI/ML systems that are appropriate for potential regulatory requirements.


title: A Reproducibility Study of Goldilocks: Just-Right Tuning of BERT for TAR

abstract: Screening documents is a tedious and time-consuming aspect of high-recall retrieval tasks, such as compiling a systematic literature review, where the goal is to identify all relevant documents for a topic. To help streamline this process, many Technology-Assisted Review (TAR) methods leverage active learning techniques to reduce the number of documents requiring review. BERT-based models have shown high effectiveness in text classification, leading to interest in their potential use in TAR workflows. In this paper, we investigate recent work that examined the impact of further pre-training epochs on the effectiveness and efficiency of a BERT-based active learning pipeline. We first report that we could replicate the original experiments on two specific TAR datasets, confirming some of the findings: importantly, that further pre-training is critical to high effectiveness, but requires attention in terms of selecting the correct training epoch. We then investigate the generalisability of the pipeline on a different TAR task, that of medical systematic reviews. In this context, we show that there is no need for further pre-training if a domain-specific BERT backbone is used within the active learning pipeline. This finding provides practical implications for using the studied active learning pipeline within domain-specific TAR tasks.


title: Hardware Acceleration for Real-Time Wildfire Detection Onboard Drone Networks

abstract: Early wildfire detection in remote and forest areas is crucial for minimizing devastation and preserving ecosystems. Autonomous drones offer agile access to remote, challenging terrains, equipped with advanced imaging technology that delivers both high-temporal and detailed spatial resolution, making them valuable assets in the early detection and monitoring of wildfires. However, the limited computation and battery resources of Unmanned Aerial Vehicles (UAVs) pose significant challenges in implementing robust and efficient image classification models. Current works in this domain often operate offline, emphasizing the need for solutions that can perform inference in real time, given the constraints of UAVs. To address these challenges, this paper aims to develop a real-time image classification and fire segmentation model. It presents a comprehensive investigation into hardware acceleration using the Jetson Nano P3450 and the implications of TensorRT, NVIDIA's high-performance deep-learning inference library, on fire classification accuracy and speed. The study includes implementations of Quantization Aware Training (QAT), Automatic Mixed Precision (AMP), and post-training mechanisms, comparing them against the latest baselines for fire segmentation and classification. All experiments utilize the FLAME dataset - an image dataset collected by low-altitude drones during a prescribed forest fire. This work contributes to the ongoing efforts to enable real-time, on-board wildfire detection capabilities for UAVs, addressing speed and the computational and energy constraints of these crucial monitoring systems. The results show a 13% increase in classification speed compared to similar models without hardware optimization. Comparatively, loss and accuracy are within 1.225% of the original values.


title: Teleparallel Gravity, Covariance and Their Geometrical Meaning

abstract: We explore the geometrical meaning of teleparallel geometries and the role of covariance in their definition. We argue that pure gauge connections are a necessary ingredient for describing geometry and gravity in terms of torsion and non-metricity. We show the other viable alternative is using the Einstein and Moller Lagrangians, but these are defined through the Riemannian connection coefficients and hence do not involve torsion nor non-metricity. We argue that the teleparallel geometries can be defined on the manifold without introducing any additional structures and that they naturally provide the covariant framework for the Einstein and Moller Lagrangians. We explore some consequences of this viewpoint for the modified theories of gravity as well.


title: Deep Shape-Texture Statistics for Completely Blind Image Quality Evaluation

abstract: Opinion-Unaware Blind Image Quality Assessment (OU-BIQA) models aim to predict image quality without training on reference images and subjective quality scores. Thereinto, image statistical comparison is a classic paradigm, while the performance is limited by the representation ability of visual descriptors. Deep features as visual descriptors have advanced IQA in recent research, but they are discovered to be highly texture-biased and lack of shape-bias. On this basis, we find out that image shape and texture cues respond differently towards distortions, and the absence of either one results in an incomplete image representation. Therefore, to formulate a well-round statistical description for images, we utilize the shapebiased and texture-biased deep features produced by Deep Neural Networks (DNNs) simultaneously. More specifically, we design a Shape-Texture Adaptive Fusion (STAF) module to merge shape and texture information, based on which we formulate qualityrelevant image statistics. The perceptual quality is quantified by the variant Mahalanobis Distance between the inner and outer Shape-Texture Statistics (DSTS), wherein the inner and outer statistics respectively describe the quality fingerprints of the distorted image and natural images. The proposed DSTS delicately utilizes shape-texture statistical relations between different data scales in the deep domain, and achieves state-of-the-art (SOTA) quality prediction performance on images with artificial and authentic distortions.


title: Development of HPK Capacitive Coupled LGAD (AC-LGAD) detectors

abstract: The detectors with $\mathcal{O}$(10) $\mu$m spatial resolution and $\mathcal{O}$(10) ps timing resolution construct powerful particle trackers for future hadron or lepton collider experiments. LGAD: Low-Gain-Avalanche-Diode is a semiconductor detector technology to improve timing resolution. Capacitive Coupled LGAD (AC-LGAD) detectors have been developed with HPK in order to meet both spatial and timing resolution requirements. Prototype samples with finely segmented electrodes have been produced and tested with various sensor fabrication parameters: doping concentrations, active thickness and electrode coupling capacitance. Timing resolution and signal height were evaluated with beta-ray. As a result, 100 $\mu$m pitch pixel detector has been successfully developed achieving a good signal to noise ratio and 30 ps timing resolution for beta-ray. The detectors have to meet radiation hardness requirements as well. Radiation hardness of LGAD detectors has to be improved to use the detectors as inner trackers for hadron colliders. One of the major mechanisms of radiation damage of LGAD detectors is acceptor removal: shallow dopants in the gain layer of LGAD detectors are reduced by radiation damage. Two novel ideas are tested on effectiveness of delaying the acceptor removal.


title: Entropy-Induced Phase Transitions in a Hidden Potts Model

abstract: A hidden state in which a spin does not interact with any other spin contributes to the entropy of an interacting spin system. Using the Ginzburg-Landau formalism in the mean-field limit, we explore the $q$-state Potts model with extra $r$ hidden states. We analytically demonstrate that when $1 < q \le 2$, the model exhibits a rich phase diagram comprising a variety of phase transitions such as continuous, discontinuous, two types of hybrids, and two consecutive second- and first-order transitions; moreover, several characteristics such as critical, critical endpoint, and tricritical point are identified. The critical line and critical end lines merge in a singular form at the tricritical point. Those complex critical behaviors are not wholly detected in previous research because the research is implemented only numerically. We microscopically investigate the origin of the discontinuous transition; it is induced by the competition between the interaction and entropy of the system in the Ising limit, whereas by the bi-stability of the hidden spin states in the percolation limit. Finally, we discuss the potential applications of the hidden Potts model to social opinion formation with shy voters and the percolation in interdependent networks.


title: Success probabilities in time-reversal based hybrid quantum state transfer

abstract: We consider two memory nodes of a quantum network connected by flying qubits. We are particularly interested in the case where a flying qubit produced by one node has to be transformed before it can interface efficiently with the next node. Such transformations can be utilized as a key part of the distribution of quantum states and hence entanglement between the nodes of a hybrid quantum network linking together different quantum technologies. We show how and why the probability of interfacing successfully is determined by the overlap of the spectral shape of the actual flying qubit and the ideal shape. This allows us to analytically and numerically analyze how the probability of success is impacted by realistic errors, and show the utility of our scheme (in consonance with known error correction methods) in connecting hybrid nodes of a quantum network. We focus here on a concrete implementation in which the memory nodes consist of three-level atoms in cavities and the flying qubits are photons.


title: Mobile Contactless Palmprint Recognition: Use of Multiscale, Multimodel Embeddings

abstract: Contactless palmprints are comprised of both global and local discriminative features. Most prior work focuses on extracting global features or local features alone for palmprint matching, whereas this research introduces a novel framework that combines global and local features for enhanced palmprint matching accuracy. Leveraging recent advancements in deep learning, this study integrates a vision transformer (ViT) and a convolutional neural network (CNN) to extract complementary local and global features. Next, a mobile-based, end-to-end palmprint recognition system is developed, referred to as Palm-ID. On top of the ViT and CNN features, Palm-ID incorporates a palmprint enhancement module and efficient dimensionality reduction (for faster matching). Palm-ID balances the trade-off between accuracy and latency, requiring just 18ms to extract a template of size 516 bytes, which can be efficiently searched against a 10,000 palmprint gallery in 0.33ms on an AMD EPYC 7543 32-Core CPU utilizing 128-threads. Cross-database matching protocols and evaluations on large-scale operational datasets demonstrate the robustness of the proposed method, achieving a TAR of 98.06% at FAR=0.01% on a newly collected, time-separated dataset. To show a practical deployment of the end-to-end system, the entire recognition pipeline is embedded within a mobile device for enhanced user privacy and security.


title: An overlapping information linear-quadratic Stackelberg stochastic differential game with two leaders and two followers

abstract: This paper is concerned with an overlapping information linear-quadratic (LQ) Stackelberg stochastic differential game with two leaders and two followers, where the diffusion terms of the state equation contain both the control and state variables. A distinct feature lies in that, the noisy information available to the leaders and the followers may be asymmetric and have overlapping part. Using a coupled system of Riccati equations, the followers first solve an LQ nonzero-sum stochastic differential Nash game with partial information, and then the leaders solve a partial information LQ nonzero-sum stochastic differential Nash game driven by a conditional mean-field type forward-backward stochastic differential equation (CMF-FBSDE). By maximum principle, completion of squares and decoupling methods, the state-estimate feedback representation of the Stackelberg-Nash equilibrium is obtained.


title: Feynman Graph Integrals on $\mathbb{C}^d$

abstract: We introduce a type of graph integrals which are holomorphic analogs of configuration space integrals. We prove their (ultraviolet) finiteness by considering a compactification of the moduli space of graphs with metrics, and study their failure to be holomorphic.