title: Diamond Surface Functionalization via Visible Light-Driven C-H Activation for Nanoscale Quantum Sensing

abstract: Nitrogen-vacancy centers in diamond are a promising platform for nanoscale nuclear magnetic resonance sensing. Despite significant progress towards using NV centers to detect and localize nuclear spins down to the single spin level, NV-based spectroscopy of individual, intact, arbitrary target molecules remains elusive. NV molecular sensing requires that target molecules are immobilized within a few nanometers of NV centers with long spin coherence time. The inert nature of diamond typically requires harsh functionalization techniques such as thermal annealing or plasma processing, limiting the scope of functional groups that can be attached to the surface. Solution-phase chemical methods can be more readily generalized to install diverse functional groups, but they have not been widely explored for single-crystal diamond surfaces. Moreover, realizing shallow NV centers with long spin coherence times requires highly ordered single-crystal surfaces, and solution-phase functionalization has not yet been shown to be compatible with such demanding conditions. In this work, we report a versatile strategy to directly functionalize C-H bonds on single-crystal diamond surfaces under ambient conditions using visible light. This functionalization method is compatible with charge stable NV centers within 10 nm of the surface with spin coherence times comparable to the state of the art. As a proof of principle, we use shallow ensembles of NV centers to detect nuclear spins from functional groups attached to the surface. Our approach to surface functionalization based on visible light-driven C-H bond activation opens the door to deploying NV centers as a broad tool for chemical sensing and single-molecule spectroscopy.


title: Space-Time Adaptive Processing for radars in Connected and Automated Vehicular Platoons

abstract: In this study, we develop a holistic framework for space-time adaptive processing (STAP) in connected and automated vehicle (CAV) radar systems. We investigate a CAV system consisting of multiple vehicles that transmit frequency-modulated continuous-waveforms (FMCW), thereby functioning as a multistatic radar. Direct application of STAP in a network of radar systems such as in a CAV may lead to excess interference. We exploit time division multiplexing (TDM) to perform transmitter scheduling over FMCW pulses to achieve high detection performance. The TDM design problem is formulated as a quadratic assignment problem which is tackled by power method-like iterations and applying the Hungarian algorithm for linear assignment in each iteration. Numerical experiments confirm that the optimized TDM is successful in enhancing the target detection performance.


title: Dynamics of cell-type transition mediated by epigenetic modifications

abstract: Maintaining tissue homeostasis requires appropriate regulation of stem cell differentiation. The Waddington landscape posits that gene circuits in a cell form a potential landscape of different cell types, wherein cells follow attractors of the probability landscape to develop into distinct cell types. However, how adult stem cells achieve a delicate balance between self-renewal and differentiation remains unclear. We propose that random inheritance of epigenetic states plays a pivotal role in stem cell differentiation and present a hybrid model of stem cell differentiation induced by epigenetic modifications. Our comprehensive model integrates gene regulation networks, epigenetic state inheritance, and cell regeneration, encompassing multi-scale dynamics ranging from transcription regulation to cell population. Through model simulations, we demonstrate that random inheritance of epigenetic states during cell divisions can spontaneously induce cell differentiation, dedifferentiation, and transdifferentiation. Furthermore, we investigate the influences of interfering with epigenetic modifications and introducing additional transcription factors on the probabilities of dedifferentiation and transdifferentiation, revealing the underlying mechanism of cell reprogramming. This \textit{in silico} model provides valuable insights into the intricate mechanism governing stem cell differentiation and cell reprogramming and offers a promising path to enhance the field of regenerative medicine.


title: Quatroids and Rational Plane Cubics

abstract: It is a classical result that there are $12$ (irreducible) rational cubic curves through $8$ generic points in $\mathbb{P}_{\mathbb{C}}^2$, but little is known about the non-generic cases. The space of $8$-point configurations is partitioned into strata depending on combinatorial objects we call quatroids, a higher-order version of representable matroids. We compute all $779777$ quatroids on eight distinct points in the plane, which produces a full description of the stratification. For each stratum, we generate several invariants, including the number of rational cubics through a generic configuration. As a byproduct of our investigation, we obtain a collection of results regarding the base loci of pencils of cubics and positive certificates for non-rationality.


title: Log-concavity with respect to the number of orbits for infinite tuples of commuting permutations

abstract: Let $A(p,n,k)$ be the number of $p$-tuples of commuting permutations of $n$ elements whose permutation action results in exactly $k$ orbits or connected components. We formulate the conjecture that, for every fixed $p$ and $n$, the $A(p,n,k)$ form a log-concave sequence with respect to $k$. For $p=1$ this is a well known property of unsigned Stirling numbers of the first kind. As the $p=2$ case, our conjecture includes a previous one by Heim and Neuhauser, which strengthens a unimodality conjecture for the Nekrasov-Okounkov hook length polynomials. In this article, we prove the $p=\infty$ case of our conjecture. We start from an expression for the $A(p,n,k)$ which follows from an identity by Bryan and Fulman, obtained in the their study of orbifold higher equivariant Euler characteristics. We then derive the $p\rightarrow\infty$ asymptotics. The last step essentially amounts to the log-concavity in $k$ of a generalized Tur\'an number, namely, the maximum product of $k$ positive integers whose sum is $n$.


title: Fast WDM provisioning with minimal probing: the first field experiments for DC exchanges

abstract: We propose an approach to estimate the end-to-end GSNR accurately in a short time when a data center interconnect (DCI) network operator receives a service request from users, not by measuring the GSNR at the operational route and wavelength for the End-End optical path but by simply applying a QoT probe channel link by link, at a convenient wavelength/modulation-format for measurement. Assuming connections between coherent transceivers of various frequency ranges, modulators, and modulation formats, we propose a new device software architecture in which the DCI network operator optimizes the transmission mode between user transceivers with high accuracy using only standard parameters such as Bit Error Rate. In this paper, we first experimentally built three different routes of 32 km/72 km/122 km in the C-band to confirm the accuracy of this approach. For the operational end-to-end GSNR measurements, the accuracy estimated from the sum of the measurements for each link was 0.6 dB, and the wavelength-dependent error was about 0.2 dB. Then, using field fibers deployed in the NSF COSMOS testbed (deployed in an urban area), a Linux-based transmission device software architecture, and coherent transceivers with different optical frequency ranges, modulators, and modulation formats, the fast WDM provisioning of an optical path was completed within 6 minutes (with a Q-factor error of about 0.7 dB).


title: Haptic search with the Smart Suction Cup on adversarial objects

abstract: Suction cups are an important gripper type in industrial robot applications, and prior literature focuses on using vision-based planners to improve grasping success in these tasks. Vision-based planners can fail due to adversarial objects or lose generalizability for unseen scenarios, without retraining learned algorithms. We propose haptic exploration to improve suction cup grasping when visual grasp planners fail. We present the Smart Suction Cup, an end-effector that utilizes internal flow measurements for tactile sensing. We show that model-based haptic search methods, guided by these flow measurements, improve grasping success by up to 2.5x as compared with using only a vision planner during a bin-picking task. In characterizing the Smart Suction Cup on both geometric edges and curves, we find that flow rate can accurately predict the ideal motion direction even with large postural errors. The Smart Suction Cup includes no electronics on the cup itself, such that the design is easy to fabricate and haptic exploration does not damage the sensor. This work motivates the use of suction cups with autonomous haptic search capabilities in especially adversarial scenarios.


title: Judging a video by its bitstream cover

abstract: Classifying videos into distinct categories, such as Sport and Music Video, is crucial for multimedia understanding and retrieval, especially in an age where an immense volume of video content is constantly being generated. Traditional methods require video decompression to extract pixel-level features like color, texture, and motion, thereby increasing computational and storage demands. Moreover, these methods often suffer from performance degradation in low-quality videos. We present a novel approach that examines only the post-compression bitstream of a video to perform classification, eliminating the need for bitstream. We validate our approach using a custom-built data set comprising over 29,000 YouTube video clips, totaling 6,000 hours and spanning 11 distinct categories. Our preliminary evaluations indicate precision, accuracy, and recall rates well over 80%. The algorithm operates approximately 15,000 times faster than real-time for 30fps videos, outperforming traditional Dynamic Time Warping (DTW) algorithm by six orders of magnitude.


title: Quasiregular distortion of dimensions

abstract: We investigate the distortion of the Assouad dimension and (regularized) spectrum of sets under planar quasiregular maps. While the respective results for the Hausdorff and upper box-counting dimension follow immediately from their quasiconformal counterparts by employing elementary properties of these dimension notions (e.g. countable stability and Lipschitz stability), the Assouad dimension and spectrum do not share such properties. We obtain upper bounds on the Assouad dimension and spectrum of images of compact sets under planar quasiregular maps by studying their behavior around their critical points. As an application the invariance of porosity of compact subsets of the plane under quasiregular maps is established.


title: Quota Mechanisms: Robustness and Finite-Sample Performance

abstract: A quota mechanism links together multiple decisions by imposing an aggregate quota on the type reports across all problems. We establish a tight bound on the ex-post decision error under quota mechanisms, for a finite number of linked problems. With this bound, we first generalize existing asymptotic results: as the number of decisions grows large, quota mechanisms can asymptotically implement a social choice function if and only if it is cyclically monotone. In this case, we also quantify the speed of convergence. Next, we bound the decision error that results if the designer's estimate of the type distribution is inaccurate. Finally, we show that quota mechanisms are robust to agents' beliefs about each other.


title: Hodge-Aware Contrastive Learning

abstract: Simplicial complexes prove effective in modeling data with multiway dependencies, such as data defined along the edges of networks or within other higher-order structures. Their spectrum can be decomposed into three interpretable subspaces via the Hodge decomposition, resulting foundational in numerous applications. We leverage this decomposition to develop a contrastive self-supervised learning approach for processing simplicial data and generating embeddings that encapsulate specific spectral information.Specifically, we encode the pertinent data invariances through simplicial neural networks and devise augmentations that yield positive contrastive examples with suitable spectral properties for downstream tasks. Additionally, we reweight the significance of negative examples in the contrastive loss, considering the similarity of their Hodge components to the anchor. By encouraging a stronger separation among less similar instances, we obtain an embedding space that reflects the spectral properties of the data. The numerical results on two standard edge flow classification tasks show a superior performance even when compared to supervised learning techniques. Our findings underscore the importance of adopting a spectral perspective for contrastive learning with higher-order data.


title: Addressing selection bias in cluster randomized experiments via weighting

abstract: In cluster randomized experiments, units are often recruited after the random cluster assignment, and data are only available for the recruited sample. Post-randomization recruitment can lead to selection bias, inducing systematic differences between the overall and the recruited populations, and between the recruited intervention and control arms. In this setting, we define causal estimands for the overall and the recruited populations. We first show that if units select their cluster independently of the treatment assignment, cluster randomization implies individual randomization in the overall population. We then prove that under the assumption of ignorable recruitment, the average treatment effect on the recruited population can be consistently estimated from the recruited sample using inverse probability weighting. Generally we cannot identify the average treatment effect on the overall population. Nonetheless, we show, via a principal stratification formulation, that one can use weighting of the recruited sample to identify treatment effects on two meaningful subpopulations of the overall population: units who would be recruited into the study regardless of the assignment, and units who would be recruited in the study under treatment but not under control. We develop a corresponding estimation strategy and a sensitivity analysis method for checking the ignorable recruitment assumption.


title: Induced Distributions from Generalized Unfair Dice

abstract: In this paper we analyze the probability distributions associated with rolling (possibly unfair) dice infinitely often. Specifically, given a $q$-sided die, if $x_i\in\{0,\ldots,q-1\}$ denotes the outcome of the $i^{\text{th}}$ toss, then the distribution function is $F(x)=\mathbb{P}[X\leq x]$, where $X = \sum_{i=1}^\infty x_i q^{-i}$. We show that $F$ is singular and establish a piecewise linear, iterative construction for it. We investigate two ways of comparing $F$ to the fair distribution -- one using supremum norms and another using arclength. In the case of coin flips, we also address the case where each independent flip could come from a different distribution. In part, this work aims to address outstanding claims in the literature on Bernoulli schemes. The results herein are motivated by emerging needs, desires, and opportunities in computation to leverage physical stochasticity in microelectronic devices for random number generation.


title: The kernel-balanced equation for deep neural networks

abstract: Deep neural networks have shown many fruitful applications in this decade. A network can get the generalized function through training with a finite dataset. The degree of generalization is a realization of the proximity scale in the data space. Specifically, the scale is not clear if the dataset is complicated. Here we consider a network for the distribution estimation of the dataset. We show the estimation is unstable and the instability depends on the data density and training duration. We derive the kernel-balanced equation, which gives a short phenomenological description of the solution. The equation tells us the reason for the instability and the mechanism of the scale. The network outputs a local average of the dataset as a prediction and the scale of averaging is determined along the equation. The scale gradually decreases along training and finally results in instability in our case.


title: Fabrics: A Foundationally Stable Medium for Encoding Prior Experience

abstract: Most dynamics functions are not well-aligned to task requirements. Controllers, therefore, often invert the dynamics and reshape it into something more useful. The learning community has found that these controllers, such as Operational Space Control (OSC), can offer important inductive biases for training. However, OSC only captures straight line end-effector motion. There's a lot more behavior we could and should be packing into these systems. Earlier work [15][16][19] developed a theory that generalized these ideas and constructed a broad and flexible class of second-order dynamical systems which was simultaneously expressive enough to capture substantial behavior (such as that listed above), and maintained the types of stability properties that make OSC and controllers like it a good foundation for policy design and learning. This paper, motivated by the empirical success of the types of fabrics used in [20], reformulates the theory of fabrics into a form that's more general and easier to apply to policy learning problems. We focus on the stability properties that make fabrics a good foundation for policy synthesis. Fabrics create a fundamentally stable medium within which a policy can operate; they influence the system's behavior without preventing it from achieving tasks within its constraints. When a fabrics is geometric (path consistent) we can interpret the fabric as forming a road network of paths that the system wants to follow at constant speed absent a forcing policy, giving geometric intuition to its role as a prior. The policy operating over the geometric fabric acts to modulate speed and steers the system from one road to the next as it accomplishes its task. We reformulate the theory of fabrics here rigorously and develop theoretical results characterizing system behavior and illuminating how to design these systems, while also emphasizing intuition throughout.


title: Hybrid Attention-based Encoder-decoder Model for Efficient Language Model Adaptation

abstract: Attention-based encoder-decoder (AED) speech recognition model has been widely successful in recent years. However, the joint optimization of acoustic model and language model in end-to-end manner has created challenges for text adaptation. In particular, effectively, quickly and inexpensively adapting text has become a primary concern for deploying AED systems in industry. To address this issue, we propose a novel model, the hybrid attention-based encoder-decoder (HAED) speech recognition model that preserves the modularity of conventional hybrid automatic speech recognition systems. Our HAED model separates the acoustic and language models, allowing for the use of conventional text-based language model adaptation techniques. We demonstrate that the proposed HAED model yields 21\% Word Error Rate (WER) improvements in relative when out-of-domain text data is used for language model adaptation, and with only a minor degradation in WER on a general test set compared with conventional AED model.


title: Highly-Sensitive Resonance-Enhanced Organic Photodetectors for Shortwave Infrared Sensing

abstract: Shortwave infrared (SWIR) has various applications, including night vision, remote sensing, and medical imaging. SWIR organic photodetectors (OPDs) offer advantages such as flexibility, cost-effectiveness, and tunable properties, however, lower sensitivity and limited spectral coverage compared to inorganic counterparts are major drawbacks. Here, we propose a simple yet effective and widely applicable strategy to extend the wavelength detection range of OPD to a longer wavelength, using resonant optical microcavity. We demonstrate a proof-of-concept in PTB7-Th:COTIC-4F blend system, achieving external quantum efficiency (EQE) > 50 % over a broad spectrum 450 - 1100 nm with a peak specific detectivity (D*) of 1.1E13 Jones at 1100 nm, while cut-off bandwidth, speed, and linearity are preserved. By employing a novel small-molecule acceptor IR6, a record high EQE = 35 % and D* = 4.1E12 Jones are obtained at 1150 nm. This research emphasizes the importance of optical design in optoelectronic devices, presenting a considerably simpler method to expand the photodetection range compared to a traditional approach that involves developing absorbers with narrow optical gaps.


title: The Fiscal Cost of Public Debt and Government Spending Shocks

abstract: This paper investigates how the cost of public debt shapes fiscal policy and its effect on the economy. Using U.S. historical data, I show that when servicing the debt creates a fiscal burden, the government responds to spending shocks by limiting debt issuance. As a result, the initial shock triggers only a limited increase in public spending in the short run, and even leads to spending reversal in the long run. Under these conditions, fiscal policy loses its ability to stimulate economic activity. This outcome arises as the fiscal authority limits its own ability to borrow to ensure public debt sustainability. These findings are robust to several identification and estimation strategies.


title: Training Audio Captioning Models without Audio

abstract: Automated Audio Captioning (AAC) is the task of generating natural language descriptions given an audio stream. A typical AAC system requires manually curated training data of audio segments and corresponding text caption annotations. The creation of these audio-caption pairs is costly, resulting in general data scarcity for the task. In this work, we address this major limitation and propose an approach to train AAC systems using only text. Our approach leverages the multimodal space of contrastively trained audio-text models, such as CLAP. During training, a decoder generates captions conditioned on the pretrained CLAP text encoder. During inference, the text encoder is replaced with the pretrained CLAP audio encoder. To bridge the modality gap between text and audio embeddings, we propose the use of noise injection or a learnable adapter, during training. We find that the proposed text-only framework performs competitively with state-of-the-art models trained with paired audio, showing that efficient text-to-audio transfer is possible. Finally, we showcase both stylized audio captioning and caption enrichment while training without audio or human-created text captions.


title: Signatures for tetraquark mixing from partial decay widths of the two light-meson nonets

abstract: In this talk, we present successful aspects of the tetraquark mixing model for the two light-meson nonets in the $J^{PC} = 0^{++}$ channel, the light nonet [$a_0(980)$, $K_0^*(700)$, $f_0(500)$, $f_0(980)$] and the heavy nonet [$a_0(1450)$, $K_0^*(1430)$, $f_0(1370)$, $f_0(1500)$]. In particular, we focus on how their experimental partial decay widths extracted from Particle Data Group (PDG) can support this mixing model. Currently, the experimental data exhibit an unnatural tendency that partial widths of the light nonet are consistently larger than those of the heavy nonet. This unnatural tendency can be explained if the coupling into two pseudoscalar mesons is enhanced in the light nonet and suppressed in the heavy nonet as predicted by the tetraquark mixing model. Therefore, this could be strong evidence to support for the tetraquark mixing model.


title: Beta quantile regression for robust estimation of uncertainty in the presence of outliers

abstract: Quantile Regression (QR) can be used to estimate aleatoric uncertainty in deep neural networks and can generate prediction intervals. Quantifying uncertainty is particularly important in critical applications such as clinical diagnosis, where a realistic assessment of uncertainty is essential in determining disease status and planning the appropriate treatment. The most common application of quantile regression models is in cases where the parametric likelihood cannot be specified. Although quantile regression is quite robust to outlier response observations, it can be sensitive to outlier covariate observations (features). Outlier features can compromise the performance of deep learning regression problems such as style translation, image reconstruction, and deep anomaly detection, potentially leading to misleading conclusions. To address this problem, we propose a robust solution for quantile regression that incorporates concepts from robust divergence. We compare the performance of our proposed method with (i) least trimmed quantile regression and (ii) robust regression based on the regularization of case-specific parameters in a simple real dataset in the presence of outlier. These methods have not been applied in a deep learning framework. We also demonstrate the applicability of the proposed method by applying it to a medical imaging translation task using diffusion models.


title: Convergence Properties of Fast quasi-LPV Model Predictive Control

abstract: In this paper, we study the convergence properties of an iterative algorithm for fast nonlinear model predictive control of quasi-linear parameter-varying systems without inequality constraints. Compared to previous works considering this algorithm, we contribute conditions under which the iterations are guaranteed to converge. Furthermore, we show that the algorithm converges to suboptimal solutions and propose an optimality-preserving variant with moderately increased computational complexity. Finally, we compare both variants in terms of quality of solution and computational performance with a state-of-the-art solver for nonlinear model predictive control in two simulation benchmarks.


title: VCD: A Video Conferencing Dataset for Video Compression

abstract: Commonly used datasets for evaluating video codecs are all very high quality and not representative of video typically used in video conferencing scenarios. We present the Video Conferencing Dataset (VCD) for evaluating video codecs for real-time communication, the first such dataset focused on video conferencing. VCD includes a wide variety of camera qualities and spatial and temporal information. It includes both desktop and mobile scenarios and two types of video background processing. We report the compression efficiency of H.264, H.265, H.266, and AV1 in low-delay settings on VCD and compare it with the non-video conferencing datasets UVC, MLC-JVC, and HEVC. The results show the source quality and the scenarios have a significant effect on the compression efficiency of all the codecs. VCD enables the evaluation and tuning of codecs for this important scenario. The VCD is publicly available as an open-source dataset at https://github.com/microsoft/VCD.


title: Towards Universal Speech Discrete Tokens: A Case Study for ASR and TTS

abstract: Self-supervised learning (SSL) proficiency in speech-related tasks has driven research into utilizing discrete tokens for speech tasks like recognition and translation, which offer lower storage requirements and great potential to employ natural language processing techniques. However, these studies, mainly single-task focused, faced challenges like overfitting and performance degradation in speech recognition tasks, often at the cost of sacrificing performance in multi-task scenarios. This study presents a comprehensive comparison and optimization of discrete tokens generated by various leading SSL models in speech recognition and synthesis tasks. We aim to explore the universality of speech discrete tokens across multiple speech tasks. Experimental results demonstrate that discrete tokens achieve comparable results against systems trained on FBank features in speech recognition tasks and outperform mel-spectrogram features in speech synthesis in subjective and objective metrics. These findings suggest that universal discrete tokens have enormous potential in various speech-related tasks. Our work is open-source and publicly available at https://github.com/k2-fsa/icefall.


title: The Mars Science Laboratory record of optical depth measurements via solar imaging

abstract: The Mars Science Laboratory Curiosity rover has monitored the Martian environment in Gale crater since landing in 2012. This study reports the record of optical depth derived from visible and near-infrared images of the Sun. Aerosol optical depth, which is mostly due to dust but also includes ice, dominates the record, with gas optical depth too small to measure. The optical depth record includes the effects of regional dust storms and one planet-encircling dust event, showing the expected peaks during southern spring and summer and relatively lower and more stable optical depth in fall and winter. The measurements show that there is a seasonally varying diurnal change in dust load, with the optical depth peaking in the morning during southern spring and summer, correlated with thermotidal pressure changes. However, there was no systematic diurnal change during autumn and winter, except after one regional storm. There were indications that the dust was relatively enhanced at high altitudes during high-optical-depth periods and that high-altitude ice was significant during winter. The observations did not provide much information about particle size or composition, but they were consistent with a smaller particle size after aphelion (in southern winter). No scattering halos were seen in associated sky images, even when there was visual evidence of ice hazes or clouds, which suggests small or amorphous ice particles. Unexpectedly, the measurement campaign revealed that the cameras collected saltating sand in their sunshades 1.97 m above the surface. As a result, the measurement strategy had to be adjusted to avoid high-elevation imaging to avoid sand covering the optics.


title: A closed manifold is a fat CW complex

abstract: In this paper, we introduce a notion of a fat CW complex to show that a closed manifold is a regular CW complex, while it is not always the case if we discuss about a smooth CW structure, introduced by the first author, instead of a fat CW structure. We also verify that de Rham theorem holds for a fat CW complex and that a regular CW complex is reflexive in the sense of Y.~Karshon, J.~Watts and P.~I-Zemmour. Further, any topological CW complex is topologically homotopy equivalent to a fat CW complex. It implies that there are lots of non-manifold examples supporting de Rham theorem.


title: Domain-adaptive Graph Attention-supervised Network for Cross-network Edge Classification

abstract: Graph neural networks (GNNs) have shown great ability in modeling graphs, however, their performance would significantly degrade when there are noisy edges connecting nodes from different classes. To alleviate negative effect of noisy edges on neighborhood aggregation, some recent GNNs propose to predict the label agreement between node pairs within a single network. However, predicting the label agreement of edges across different networks has not been investigated yet. Our work makes the pioneering attempt to study a novel problem of cross-network homophilous and heterophilous edge classification (CNHHEC), and proposes a novel domain-adaptive graph attention-supervised network (DGASN) to effectively tackle the CNHHEC problem. Firstly, DGASN adopts multi-head GAT as the GNN encoder, which jointly trains node embeddings and edge embeddings via the node classification and edge classification losses. As a result, label-discriminative embeddings can be obtained to distinguish homophilous edges from heterophilous edges. In addition, DGASN applies direct supervision on graph attention learning based on the observed edge labels from the source network, thus lowering the negative effects of heterophilous edges while enlarging the positive effects of homophilous edges during neighborhood aggregation. To facilitate knowledge transfer across networks, DGASN employs adversarial domain adaptation to mitigate domain divergence. Extensive experiments on real-world benchmark datasets demonstrate that the proposed DGASN achieves the state-of-the-art performance in CNHHEC.


title: International Competition on Graph Counting Algorithms 2023

abstract: This paper reports on the details of the International Competition on Graph Counting Algorithms (ICGCA) held in 2023. The graph counting problem is to count the subgraphs satisfying specified constraints on a given graph. The problem belongs to #P-complete, a computationally tough class. Since many essential systems in modern society, e.g., infrastructure networks, are often represented as graphs, graph counting algorithms are a key technology to efficiently scan all the subgraphs representing the feasible states of the system. In the ICGCA, contestants were asked to count the paths on a graph under a length constraint. The benchmark set included 150 challenging instances, emphasizing graphs resembling infrastructure networks. Eleven solvers were submitted and ranked by the number of benchmarks correctly solved within a time limit. The winning solver, TLDC, was designed based on three fundamental approaches: backtracking search, dynamic programming, and model counting or #SAT (a counting version of Boolean satisfiability). Detailed analyses show that each approach has its own strengths, and one approach is unlikely to dominate the others. The codes and papers of the participating solvers are available: https://afsa.jp/icgca/.


title: Less is More for Long Document Summary Evaluation by LLMs

abstract: Large Language Models (LLMs) have shown promising performance in summary evaluation tasks, yet they face challenges such as high computational costs and the Lost-in-the-Middle problem where important information in the middle of long documents is often overlooked. To address these issues, this paper introduces a novel approach, Extract-then-Evaluate, which involves extracting key sentences from a long source document and then evaluating the summary by prompting LLMs. The results reveal that the proposed method not only significantly reduces evaluation costs but also exhibits a higher correlation with human evaluations. Furthermore, we provide practical recommendations for optimal document length and sentence extraction methods, contributing to the development of cost-effective yet more accurate methods for LLM-based text generation evaluation.


title: Rates of Convergence in Certain Native Spaces of Approximations used in Reinforcement Learning

abstract: This paper studies convergence rates for some value function approximations that arise in a collection of reproducing kernel Hilbert spaces (RKHS) $H(\Omega)$. By casting an optimal control problem in a specific class of native spaces, strong rates of convergence are derived for the operator equation that enables offline approximations that appear in policy iteration. Explicit upper bounds on error in value function and controller approximations are derived in terms of power function $\mathcal{P}_{H,N}$ for the space of finite dimensional approximants $H_N$ in the native space $H(\Omega)$. These bounds are geometric in nature and refine some well-known, now classical results concerning convergence of approximations of value functions.


title: An Interactive Framework for Profiling News Media Sources

abstract: The recent rise of social media has led to the spread of large amounts of fake and biased news, content published with the intent to sway beliefs. While detecting and profiling the sources that spread this news is important to maintain a healthy society, it is challenging for automated systems. In this paper, we propose an interactive framework for news media profiling. It combines the strengths of graph based news media profiling models, Pre-trained Large Language Models, and human insight to characterize the social context on social media. Experimental results show that with as little as 5 human interactions, our framework can rapidly detect fake and biased news media, even in the most challenging settings of emerging news events, where test data is unseen.


title: Multi-dimensional Speech Quality Assessment in Crowdsourcing

abstract: Subjective speech quality assessment is the gold standard for evaluating speech enhancement processing and telecommunication systems. The commonly used standard ITU-T Rec. P.800 defines how to measure speech quality in lab environments, and ITU-T Rec.~P.808 extended it for crowdsourcing. ITU-T Rec. P.835 extends P.800 to measure the quality of speech in the presence of noise. ITU-T Rec. P.804 targets the conversation test and introduces perceptual speech quality dimensions which are measured during the listening phase of the conversation. The perceptual dimensions are noisiness, coloration, discontinuity, and loudness. We create a crowdsourcing implementation of a multi-dimensional subjective test following the scales from P.804 and extend it to include reverberation, the speech signal, and overall quality. We show the tool is both accurate and reproducible. The tool has been used in the ICASSP 2023 Speech Signal Improvement challenge and we show the utility of these speech quality dimensions in this challenge. The tool will be publicly available as open-source at https://github.com/microsoft/P.808.


title: A Stein's Method Approach to the Linear Noise Approximation for Stationary Distributions of Chemical Reaction Networks

abstract: Stochastic Chemical Reaction Networks are continuous time Markov chain models that describe the time evolution of the molecular counts of species interacting stochastically via discrete reactions. Such models are ubiquitous in systems and synthetic biology, but often have a large or infinite number of states, and thus are not amenable to computation and analysis. Due to this, approximations that rely on the molecular counts and the volume being large are commonly used, with the most common being the Reaction Rate Equations and the Linear Noise Approximation. For finite time intervals, Kurtz established the validity of the Reaction Rate Equations and Linear Noise Approximation, by proving law of large numbers and central limit theorem results respectively. However, the analogous question for the stationary distribution of the Markov chain model has remained mostly unanswered, except for chemical reaction networks with special structures or bounded molecular counts. In this work, we use Stein's Method to obtain sufficient conditions for the stationary distribution of an appropriately scaled Stochastic Chemical Reaction Network to converge to the Linear Noise Approximation as the system size goes to infinity. Our results give non asymptotic bounds on the error in the Reaction Rate Equations and in the Linear Noise Approximation as applied to the stationary distribution. As a special case, we give conditions under which the global exponential stability of an equilibrium point of the Reaction Rate Equations is sufficient to obtain our error bounds, thus permitting one to obtain conclusions about the Markov chain by analyzing the deterministic Reaction Rate Equations.

categories: q-bio.QM math.PR physics.chem-ph q-bio.MN


title: VDialogUE: A Unified Evaluation Benchmark for Visually-grounded Dialogue

abstract: Visually-grounded dialog systems, which integrate multiple modes of communication such as text and visual inputs, have become an increasingly popular area of investigation. However, the absence of a standardized evaluation framework poses a challenge in assessing the development of this field. To this end, we propose \textbf{VDialogUE}, a \textbf{V}isually-grounded \textbf{Dialog}ue benchmark for \textbf{U}nified \textbf{E}valuation. It defines five core multi-modal dialogue tasks and covers six datasets. Furthermore, in order to provide a comprehensive assessment of the model's performance across all tasks, we developed a novel evaluation metric called VDscore, which is based on the Analytic Hierarchy Process~(AHP) method. Additionally, we present a straightforward yet efficient baseline model, named \textbf{VISIT}~(\textbf{VIS}ually-grounded d\textbf{I}alog \textbf{T}ransformer), to promote the advancement of general multi-modal dialogue systems. It progressively builds its multi-modal foundation and dialogue capability via a two-stage pre-training strategy. We believe that the VDialogUE benchmark, along with the evaluation scripts and our baseline models, will accelerate the development of visually-grounded dialog systems and lead to the development of more sophisticated and effective pre-trained models.


title: On Autonomous Agents in a Cyber Defence Environment

abstract: Autonomous Cyber Defence is required to respond to high-tempo cyber-attacks. To facilitate the research in this challenging area, we explore the utility of the autonomous cyber operation environments presented as part of the Cyber Autonomy Gym for Experimentation (CAGE) Challenges, with a specific focus on CAGE Challenge 2. CAGE Challenge 2 required a defensive Blue agent to defend a network from an attacking Red agent. We provide a detailed description of the this challenge and describe the approaches taken by challenge participants. From the submitted agents, we identify four classes of algorithms, namely, Single- Agent Deep Reinforcement Learning (DRL), Hierarchical DRL, Ensembles, and Non-DRL approaches. Of these classes, we found that the hierarchical DRL approach was the most capable of learning an effective cyber defensive strategy. Our analysis of the agent policies identified that different algorithms within the same class produced diverse strategies and that the strategy used by the defensive Blue agent varied depending on the strategy used by the offensive Red agent. We conclude that DRL algorithms are a suitable candidate for autonomous cyber defence applications.


title: Theoretical prediction of diffusive ionic current through nanopores under salt gradients

abstract: In charged nanopores, ionic diffusion current reflects the ionic selectivity and ionic permeability of nanopores which determines the performance of osmotic energy conversion, i.e. the output power and efficiency. Here, theoretical predictions of the diffusive currents through cation-selective nanopores have been developed based on the investigation of diffusive ionic transport under salt gradients with simulations. The ionic diffusion current I satisfies a reciprocal relationship with the pore length I correlates with a/L (a is a constant) in long nanopores. a is determined by the cross-sectional areas of diffusion paths for anions and cations inside nanopores which can be described with a quadratic power of the diameter, and the superposition of a quadratic power and a first power of the diameter, respectively. By using effective concentration gradients instead of nominal ones, the deviation caused by the concentration polarization can be effectively avoided in the prediction of ionic diffusion current. With developed equations of effective concentration difference and ionic diffusion current, the diffusion current across nanopores can be well predicted in cases of nanopores longer than 100 nm and without overlapping of electric double layers. Our results can provide a convenient way for the quantitative prediction of ionic diffusion currents under salt gradients.


title: Unleashing the Power of Depth and Pose Estimation Neural Networks by Designing Compatible Endoscopic Images

abstract: Deep learning models have witnessed depth and pose estimation framework on unannotated datasets as a effective pathway to succeed in endoscopic navigation. Most current techniques are dedicated to developing more advanced neural networks to improve the accuracy. However, existing methods ignore the special properties of endoscopic images, resulting in an inability to fully unleash the power of neural networks. In this study, we conduct a detail analysis of the properties of endoscopic images and improve the compatibility of images and neural networks, to unleash the power of current neural networks. First, we introcude the Mask Image Modelling (MIM) module, which inputs partial image information instead of complete image information, allowing the network to recover global information from partial pixel information. This enhances the network' s ability to perceive global information and alleviates the phenomenon of local overfitting in convolutional neural networks due to local artifacts. Second, we propose a lightweight neural network to enhance the endoscopic images, to explicitly improve the compatibility between images and neural networks. Extensive experiments are conducted on the three public datasets and one inhouse dataset, and the proposed modules improve baselines by a large margin. Furthermore, the enhanced images we proposed, which have higher network compatibility, can serve as an effective data augmentation method and they are able to extract more stable feature points in traditional feature point matching tasks and achieve outstanding performance.


title: EnCodecMAE: Leveraging neural codecs for universal audio representation learning

abstract: The goal of universal audio representation learning is to obtain foundational models that can be used for a variety of downstream tasks involving speech, music and environmental sounds. To approach this problem, methods inspired by works on self-supervised learning for NLP, like BERT, or computer vision, like masked autoencoders (MAE), are often adapted to the audio domain. In this work, we propose masking representations of the audio signal, and training a MAE to reconstruct the masked segments. The reconstruction is done by predicting the discrete units generated by EnCodec, a neural audio codec, from the unmasked inputs. We evaluate this approach, which we call EnCodecMAE, on a wide range of tasks involving speech, music and environmental sounds. Our best model outperforms various state-of-the-art audio representation models in terms of global performance. Additionally, we evaluate the resulting representations in the challenging task of automatic speech recognition (ASR), obtaining decent results and paving the way for a universal audio representation.


title: High-sensitivity transition-edge-sensed bolometers: improved speed and characterization with AC and DC bias

abstract: We report on efforts to improve the speed of low-G far-infrared transition-edged-sensed bolometers. We use a fabrication process that does not require any dry etch steps to reduce heat capacity on the suspended device and measure a reduction in the detector time constant. However, we also measure an increase in the temperature-normalized thermal conductance (G), and a corresponding increase in the noise-equivalent power (NEP). We employ a new near-IR photon-noise technique using a near-IR laser to calibrate the frequency-domain multiplexed AC system and compare the results to a well-understood DC circuit. We measure an NEP white noise level of 0.8 aW/rtHz with a 1/f knee below 0.1 Hz and a time constant of 3.2 ms.


title: Continuous frequency tuning of an external cavity diode laser significantly beyond the free spectral range by sweeping the injection current

abstract: In this study, the frequency of an external cavity diode laser with an antireflection-coated laser diode was continuously tuned over a range of 14.8 GHz, which was 4.5 times larger than the free spectral range, by only sweeping the injection current to the laser diode. Without the antireflection coating, the tuning range was reduced to one-fifth of the free spectral range, and mode hops occurred with hysteresis. The theoretical analysis starting from the hysteresis indicated that an unexpectedly wide tuning is possible if the longitudinal modes of the solitary laser diode vanish owing to antireflection coating.


title: Nucleus-aware Self-supervised Pretraining Using Unpaired Image-to-image Translation for Histopathology Images

abstract: Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate on the extraction of nucleus-level information, which is essential for pathologic analysis. In this work, we propose a novel nucleus-aware self-supervised pretraining framework for histopathology images. The framework aims to capture the nuclear morphology and distribution information through unpaired image-to-image translation between histopathology images and pseudo mask images. The generation process is modulated by both conditional and stochastic style representations, ensuring the reality and diversity of the generated histopathology images for pretraining. Further, an instance segmentation guided strategy is employed to capture instance-level information. The experiments on 7 datasets show that the proposed pretraining method outperforms supervised ones on Kather classification, multiple instance learning, and 5 dense-prediction tasks with the transfer learning protocol, and yields superior results than other self-supervised approaches on 8 semi-supervised tasks. Our project is publicly available at https://github.com/zhiyuns/UNITPathSSL.


title: Feasibility study to characterize the production of antineutrons in high energy $pp$ collisions through charge exchange interactions

abstract: Simulations to evaluate the feasibility of $\bar{n}$ identification and kinematic characterization via the hadronic charge exchange (CEX) interaction $n+\bar{n}\rightarrow p+\bar{p}$ are reported. The target neutrons are those composing the silicon nuclei of which inner tracking devices present in LHC experiments are made. Simulations of $pp$ collisions in PYTHIA were carried out at different energies to investigate $\bar{n}$ production and the expected $\bar{n}$ energy spectra. Then, two types of GEANT4 simulations were performed, placing an $\bar{n}$ point source at the ALICE primary vertex as a working example. In the first simulation, the $E_k$ was kept at an arbitrary (1 GeV) fix value to develop an $\bar{n}$ identification and kinematics reconstruction protocol. The second GEANT4 simulation used the resulting PYTHIA at $\sqrt{s_{pp}}=13$ TeV $\bar{n}$ energy spectra. In both simulations, the occurrence of CEX interactions was identified by the unique outgoing $\bar{p}$. The simplified simulation allowed to estimate a 0.11% CEX-interaction identification efficiency at $E_k = 1$ GeV. The $p$ CEX-partner identification is challenging because of the presence of silicon nucleus-fragmentation protons. Momentum correlations between the $\bar{n}$ and all possible $\bar{p}p$ pairs showed that $p$ CEX-partner identification and $\bar{n}$ kinematics reconstruction corresponds to minimal momentum-loss events. The use of ITS $dE/dx$ information is found to improve $\bar{n}$ identification and kinematic characterization in both simulations. The final protocol applied to the realistic simulation resulted in a $\bar{n}$ identification and kinematic reconstruction efficiency of 0.006%, based solely on $\bar{p}p $ pair observable. Thus, the expected rate of identified and kinematically reconstructed $\bar{n}$ should lie in the order of 100,000 per second, illustrating the feasibility of the method.


title: DebCSE: Rethinking Unsupervised Contrastive Sentence Embedding Learning in the Debiasing Perspective

abstract: Several prior studies have suggested that word frequency biases can cause the Bert model to learn indistinguishable sentence embeddings. Contrastive learning schemes such as SimCSE and ConSERT have already been adopted successfully in unsupervised sentence embedding to improve the quality of embeddings by reducing this bias. However, these methods still introduce new biases such as sentence length bias and false negative sample bias, that hinders model's ability to learn more fine-grained semantics. In this paper, we reexamine the challenges of contrastive sentence embedding learning from a debiasing perspective and argue that effectively eliminating the influence of various biases is crucial for learning high-quality sentence embeddings. We think all those biases are introduced by simple rules for constructing training data in contrastive learning and the key for contrastive learning sentence embedding is to mimic the distribution of training data in supervised machine learning in unsupervised way. We propose a novel contrastive framework for sentence embedding, termed DebCSE, which can eliminate the impact of these biases by an inverse propensity weighted sampling method to select high-quality positive and negative pairs according to both the surface and semantic similarity between sentences. Extensive experiments on semantic textual similarity (STS) benchmarks reveal that DebCSE significantly outperforms the latest state-of-the-art models with an average Spearman's correlation coefficient of 80.33% on BERTbase.


title: Solving Einstein equations using deep learning

abstract: Einstein field equations are notoriously challenging to solve due to their complex mathematical form, with few analytical solutions available in the absence of highly symmetric systems or ideal matter distribution. However, accurate solutions are crucial, particularly in systems with strong gravitational field such as black holes or neutron stars. In this work, we use neural networks and auto differentiation to solve the Einstein field equations numerically inspired by the idea of physics-informed neural networks (PINNs). By utilizing these techniques, we successfully obtain the Schwarzschild metric and the charged Schwarzschild metric given the energy-momentum tensor of matter. This innovative method could open up a different way for solving space-time coupled Einstein field equations and become an integral part of numerical relativity.


title: Semantic Adversarial Attacks via Diffusion Models

abstract: Traditional adversarial attacks concentrate on manipulating clean examples in the pixel space by adding adversarial perturbations. By contrast, semantic adversarial attacks focus on changing semantic attributes of clean examples, such as color, context, and features, which are more feasible in the real world. In this paper, we propose a framework to quickly generate a semantic adversarial attack by leveraging recent diffusion models since semantic information is included in the latent space of well-trained diffusion models. Then there are two variants of this framework: 1) the Semantic Transformation (ST) approach fine-tunes the latent space of the generated image and/or the diffusion model itself; 2) the Latent Masking (LM) approach masks the latent space with another target image and local backpropagation-based interpretation methods. Additionally, the ST approach can be applied in either white-box or black-box settings. Extensive experiments are conducted on CelebA-HQ and AFHQ datasets, and our framework demonstrates great fidelity, generalizability, and transferability compared to other baselines. Our approaches achieve approximately 100% attack success rate in multiple settings with the best FID as 36.61. Code is available at https://github.com/steven202/semantic_adv_via_dm.


title: Geometric Derivation of the Finite $N$ Master Loop Equation

abstract: In this paper we provide a geometric derivation of the master loop equation for the lattice Yang-Mills model with structure group $G \in \{SO(N),SU(N), U(N)\}$. This approach is based on integration by parts on $G$. In the appendix we compare our approach to that of \cite{Ch19a} and \cite{J16} based on Schwinger-Dyson equations, and \cite{SheSmZh22} based on stochastic analysis. In particular these approaches are all easily seen to be equivalent. The novelty in our approach is the use of intrinsic geometry of $G$ which we believe simplifies the derivation.


title: HIGT: Hierarchical Interaction Graph-Transformer for Whole Slide Image Analysis

abstract: In computation pathology, the pyramid structure of gigapixel Whole Slide Images (WSIs) has recently been studied for capturing various information from individual cell interactions to tissue microenvironments. This hierarchical structure is believed to be beneficial for cancer diagnosis and prognosis tasks. However, most previous hierarchical WSI analysis works (1) only characterize local or global correlations within the WSI pyramids and (2) use only unidirectional interaction between different resolutions, leading to an incomplete picture of WSI pyramids. To this end, this paper presents a novel Hierarchical Interaction Graph-Transformer (i.e., HIGT) for WSI analysis. With Graph Neural Network and Transformer as the building commons, HIGT can learn both short-range local information and long-range global representation of the WSI pyramids. Considering that the information from different resolutions is complementary and can benefit each other during the learning process, we further design a novel Bidirectional Interaction block to establish communication between different levels within the WSI pyramids. Finally, we aggregate both coarse-grained and fine-grained features learned from different levels together for slide-level prediction. We evaluate our methods on two public WSI datasets from TCGA projects, i.e., kidney carcinoma (KICA) and esophageal carcinoma (ESCA). Experimental results show that our HIGT outperforms both hierarchical and non-hierarchical state-of-the-art methods on both tumor subtyping and staging tasks.


title: Multi-Grade Deep Learning for Partial Differential Equations with Applications to the Burgers Equation

abstract: We develop in this paper a multi-grade deep learning method for solving nonlinear partial differential equations (PDEs). Deep neural networks (DNNs) have received super performance in solving PDEs in addition to their outstanding success in areas such as natural language processing, computer vision, and robotics. However, training a very deep network is often a challenging task. As the number of layers of a DNN increases, solving a large-scale non-convex optimization problem that results in the DNN solution of PDEs becomes more and more difficult, which may lead to a decrease rather than an increase in predictive accuracy. To overcome this challenge, we propose a two-stage multi-grade deep learning (TS-MGDL) method that breaks down the task of learning a DNN into several neural networks stacked on top of each other in a staircase-like manner. This approach allows us to mitigate the complexity of solving the non-convex optimization problem with large number of parameters and learn residual components left over from previous grades efficiently. We prove that each grade/stage of the proposed TS-MGDL method can reduce the value of the loss function and further validate this fact through numerical experiments. Although the proposed method is applicable to general PDEs, implementation in this paper focuses only on the 1D, 2D, and 3D viscous Burgers equations. Experimental results show that the proposed two-stage multi-grade deep learning method enables efficient learning of solutions of the equations and outperforms existing single-grade deep learning methods in predictive accuracy. Specifically, the predictive errors of the single-grade deep learning are larger than those of the TS-MGDL method in 26-60, 4-31 and 3-12 times, for the 1D, 2D, and 3D equations, respectively.


title: Semi-supervised Domain Adaptation on Graphs with Contrastive Learning and Minimax Entropy

abstract: Label scarcity in a graph is frequently encountered in real-world applications due to the high cost of data labeling. To this end, semi-supervised domain adaptation (SSDA) on graphs aims to leverage the knowledge of a labeled source graph to aid in node classification on a target graph with limited labels. SSDA tasks need to overcome the domain gap between the source and target graphs. However, to date, this challenging research problem has yet to be formally considered by the existing approaches designed for cross-graph node classification. This paper proposes a novel method called SemiGCL to tackle the graph \textbf{Semi}-supervised domain adaptation with \textbf{G}raph \textbf{C}ontrastive \textbf{L}earning and minimax entropy training. SemiGCL generates informative node representations by contrasting the representations learned from a graph's local and global views. Additionally, SemiGCL is adversarially optimized with the entropy loss of unlabeled target nodes to reduce domain divergence. Experimental results on benchmark datasets demonstrate that SemiGCL outperforms the state-of-the-art baselines on the SSDA tasks. The source codes of SemiGCL are publicly available at https://github.com/ JiarenX/SemiGCL.


title: Flexible Visual Recognition by Evidential Modeling of Confusion and Ignorance

abstract: In real-world scenarios, typical visual recognition systems could fail under two major causes, i.e., the misclassification between known classes and the excusable misbehavior on unknown-class images. To tackle these deficiencies, flexible visual recognition should dynamically predict multiple classes when they are unconfident between choices and reject making predictions when the input is entirely out of the training distribution. Two challenges emerge along with this novel task. First, prediction uncertainty should be separately quantified as confusion depicting inter-class uncertainties and ignorance identifying out-of-distribution samples. Second, both confusion and ignorance should be comparable between samples to enable effective decision-making. In this paper, we propose to model these two sources of uncertainty explicitly with the theory of Subjective Logic. Regarding recognition as an evidence-collecting process, confusion is then defined as conflicting evidence, while ignorance is the absence of evidence. By predicting Dirichlet concentration parameters for singletons, comprehensive subjective opinions, including confusion and ignorance, could be achieved via further evidence combinations. Through a series of experiments on synthetic data analysis, visual recognition, and open-set detection, we demonstrate the effectiveness of our methods in quantifying two sources of uncertainties and dealing with flexible recognition.


title: Holographic Einstein rings of Non-commutative black holes

abstract: With the help of the AdS/CFT correspondence, we easily derive the desired response function of QFT on the boundary. Using the virtual optical system with a convex lens, we are able to obtain the image of the black hole from the response function and further study the Einstein ring of the non-commutative black holes. All the results show that there are some common features and different features compared to the previous study of other background black holes. And with the change of the observation position, this ring will change into a luminosity-deformed ring, or light points. In addition to these similarities, there are some different features which are due to the singularity of the event horizon temperature. Explicitly, the relation between temperature and the event horizon $T-z_h$ has two branches when the non-commutative parameter $n$ is fixed. These in turn have an effect on the behavior of the response function and the Einstein ring. However, the amplitude of $|\langle O\rangle|$ increases with the decrease of the temperature $T$ for the left branch of $T-z_h$ relation, while the amplitude of $|\langle O\rangle|$ decreases with the decrease of the temperature $T$ for the right branch. These differences are also reflected in the Einstein ring. Therefore, these differences can be used to distinguish different black hole backgrounds. Furthermore, we show that the non-commutative parameter has an effect on the brightness and the position of Einstein ring.


title: FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codec

abstract: This paper presents FunCodec, a fundamental neural speech codec toolkit, which is an extension of the open-source speech processing toolkit FunASR. FunCodec provides reproducible training recipes and inference scripts for the latest neural speech codec models, such as SoundStream and Encodec. Thanks to the unified design with FunASR, FunCodec can be easily integrated into downstream tasks, such as speech recognition. Along with FunCodec, pre-trained models are also provided, which can be used for academic or generalized purposes. Based on the toolkit, we further propose the frequency-domain codec models, FreqCodec, which can achieve comparable speech quality with much lower computation and parameter complexity. Experimental results show that, under the same compression ratio, FunCodec can achieve better reconstruction quality compared with other toolkits and released models. We also demonstrate that the pre-trained models are suitable for downstream tasks, including automatic speech recognition and personalized text-to-speech synthesis. This toolkit is publicly available at https://github.com/alibaba-damo-academy/FunCodec.


title: Secure and Scalable Circuit-based Protocol for Multi-Party Private Set Intersection

abstract: We propose a novel protocol for computing a circuit which implements the multi-party private set intersection functionality (PSI). Circuit-based approach has advantages over using custom protocols to achieve this task, since many applications of PSI do not require the computation of the intersection itself, but rather specific functional computations over the items in the intersection. Our protocol represents the pioneering circuit-based multi-party PSI protocol, which builds upon and optimizes the two-party SCS \cite{huang2012private} protocol. By using secure computation between two parties, our protocol sidesteps the complexities associated with multi-party interactions and demonstrates good scalability. In order to mitigate the high overhead associated with circuit-based constructions, we have further enhanced our protocol by utilizing simple hashing scheme and permutation-based hash functions. These tricks have enabled us to minimize circuit size by employing bucketing techniques while simultaneously attaining noteworthy reductions in both computation and communication expenses.


title: Deep Reinforcement Learning-based Scheduling for Optimizing System Load and Response Time in Edge and Fog Computing Environments

abstract: Edge/fog computing, as a distributed computing paradigm, satisfies the low-latency requirements of ever-increasing number of IoT applications and has become the mainstream computing paradigm behind IoT applications. However, because large number of IoT applications require execution on the edge/fog resources, the servers may be overloaded. Hence, it may disrupt the edge/fog servers and also negatively affect IoT applications' response time. Moreover, many IoT applications are composed of dependent components incurring extra constraints for their execution. Besides, edge/fog computing environments and IoT applications are inherently dynamic and stochastic. Thus, efficient and adaptive scheduling of IoT applications in heterogeneous edge/fog computing environments is of paramount importance. However, limited computational resources on edge/fog servers imposes an extra burden for applying optimal but computationally demanding techniques. To overcome these challenges, we propose a Deep Reinforcement Learning-based IoT application Scheduling algorithm, called DRLIS to adaptively and efficiently optimize the response time of heterogeneous IoT applications and balance the load of the edge/fog servers. We implemented DRLIS as a practical scheduler in the FogBus2 function-as-a-service framework for creating an edge-fog-cloud integrated serverless computing environment. Results obtained from extensive experiments show that DRLIS significantly reduces the execution cost of IoT applications by up to 55%, 37%, and 50% in terms of load balancing, response time, and weighted cost, respectively, compared with metaheuristic algorithms and other reinforcement learning techniques.


title: An Explicit Method for Fast Monocular Depth Recovery in Corridor Environments

abstract: Monocular cameras are extensively employed in indoor robotics, but their performance is limited in visual odometry, depth estimation, and related applications due to the absence of scale information.Depth estimation refers to the process of estimating a dense depth map from the corresponding input image, existing researchers mostly address this issue through deep learning-based approaches, yet their inference speed is slow, leading to poor real-time capabilities. To tackle this challenge, we propose an explicit method for rapid monocular depth recovery specifically designed for corridor environments, leveraging the principles of nonlinear optimization. We adopt the virtual camera assumption to make full use of the prior geometric features of the scene. The depth estimation problem is transformed into an optimization problem by minimizing the geometric residual. Furthermore, a novel depth plane construction technique is introduced to categorize spatial points based on their possible depths, facilitating swift depth estimation in enclosed structural scenarios, such as corridors. We also propose a new corridor dataset, named Corr\_EH\_z, which contains images as captured by the UGV camera of a variety of corridors. An exhaustive set of experiments in different corridors reveal the efficacy of the proposed algorithm.


title: Masked Diffusion with Task-awareness for Procedure Planning in Instructional Videos

abstract: A key challenge with procedure planning in instructional videos lies in how to handle a large decision space consisting of a multitude of action types that belong to various tasks. To understand real-world video content, an AI agent must proficiently discern these action types (e.g., pour milk, pour water, open lid, close lid, etc.) based on brief visual observation. Moreover, it must adeptly capture the intricate semantic relation of the action types and task goals, along with the variable action sequences. Recently, notable progress has been made via the integration of diffusion models and visual representation learning to address the challenge. However, existing models employ rudimentary mechanisms to utilize task information to manage the decision space. To overcome this limitation, we introduce a simple yet effective enhancement - a masked diffusion model. The introduced mask acts akin to a task-oriented attention filter, enabling the diffusion/denoising process to concentrate on a subset of action types. Furthermore, to bolster the accuracy of task classification, we harness more potent visual representation learning techniques. In particular, we learn a joint visual-text embedding, where a text embedding is generated by prompting a pre-trained vision-language model to focus on human actions. We evaluate the method on three public datasets and achieve state-of-the-art performance on multiple metrics. Code is available at https://github.com/ffzzy840304/Masked-PDPP.


title: Baryon Number Violating Rate as A Function of the Proton-Proton Collision Energy

abstract: The baryon-number violation (BV) happens in the standard electroweak model. According to the Bloch-wave picture, the BV event rate shall be significantly enhanced when the proton-proton collision center of mass (COM) energy goes beyond the sphaleron barrier height $E_{\rm sph}\simeq 9.0\,{\rm TeV}$. Here we compare the BV event rates at different COM energies, using the Bloch-wave band structure and the CT18 parton distribution function data, with the phase space suppression factor included. As an example, the BV cross section at 25 TeV is 4 orders of magnitude bigger than its cross section at 13 TeV. The probability of detection is further enhanced at higher energies since an event at higher energy will produce on average more same sign charged leptons.


title: Interpretable and Efficient Beamforming-Based Deep Learning for Single Snapshot DOA Estimation

abstract: We introduce an interpretable deep learning approach for direction of arrival (DOA) estimation with a single snapshot. Classical subspace-based methods like MUSIC and ESPRIT use spatial smoothing on uniform linear arrays for single snapshot DOA estimation but face drawbacks in reduced array aperture and inapplicability to sparse arrays. Single-snapshot methods such as compressive sensing and iterative adaptation approach (IAA) encounter challenges with high computational costs and slow convergence, hampering real-time use. Recent deep learning DOA methods offer promising accuracy and speed. However, the practical deployment of deep networks is hindered by their black-box nature. To address this, we propose a deep-MPDR network translating minimum power distortionless response (MPDR)-type beamformer into deep learning, enhancing generalization and efficiency. Comprehensive experiments conducted using both simulated and real-world datasets substantiate its dominance in terms of inference time and accuracy in comparison to conventional methods. Moreover, it excels in terms of efficiency, generalizability, and interpretability when contrasted with other deep learning DOA estimation networks.


title: Advancing Regular Language Reasoning in Linear Recurrent Neural Networks

abstract: In recent studies, linear recurrent neural networks (LRNNs) have achieved Transformer-level performance in natural language and long-range modeling, while offering rapid parallel training and constant inference cost. With the resurgence of interest in LRNNs, we study whether they can learn the hidden rules in training sequences, such as the grammatical structures of regular language. We theoretically analyze some existing LRNNs and discover their limitations in modeling regular language. Motivated by this analysis, we propose a new LRNN equipped with a block-diagonal and input-dependent transition matrix. Experiments suggest that the proposed model is the only LRNN capable of performing length extrapolation on regular language tasks such as Sum, Even Pair, and Modular Arithmetic. The code is released at \url{https://github.com/tinghanf/RegluarLRNN}.


title: CPPF: A contextual and post-processing-free model for automatic speech recognition

abstract: ASR systems have become increasingly widespread in recent years. However, their textual outputs often require post-processing tasks before they can be practically utilized. To address this issue, we draw inspiration from the multifaceted capabilities of LLMs and Whisper, and focus on integrating multiple ASR text processing tasks related to speech recognition into the ASR model. This integration not only shortens the multi-stage pipeline, but also prevents the propagation of cascading errors, resulting in direct generation of post-processed text. In this study, we focus on ASR-related processing tasks, including Contextual ASR and multiple ASR post processing tasks. To achieve this objective, we introduce the CPPF model, which offers a versatile and highly effective alternative to ASR processing. CPPF seamlessly integrates these tasks without any significant loss in recognition performance.


title: PromptASR for contextualized ASR with controllable style

abstract: Prompts are crucial to large language models as they provide context information such as topic or logical relationships. Inspired by this, we propose PromptASR, a framework that integrates prompts in end-to-end automatic speech recognition (E2E ASR) systems to achieve contextualized ASR with controllable style of transcriptions. Specifically, a dedicated text encoder encodes the text prompts and the encodings are injected into the speech encoder by cross-attending the features from two modalities. When using the ground truth text from preceding utterances as content prompt, the proposed system achieves 21.9% and 6.8% relative word error rate reductions on a book reading dataset and an in-house dataset compared to a baseline ASR system. The system can also take word-level biasing lists as prompt to improve recognition accuracy on rare words. An additional style prompt can be given to the text encoder and guide the ASR system to output different styles of transcriptions. The code is available at icefall.


title: Client-side Gradient Inversion Against Federated Learning from Poisoning

abstract: Federated Learning (FL) enables distributed participants (e.g., mobile devices) to train a global model without sharing data directly to a central server. Recent studies have revealed that FL is vulnerable to gradient inversion attack (GIA), which aims to reconstruct the original training samples and poses high risk against the privacy of clients in FL. However, most existing GIAs necessitate control over the server and rely on strong prior knowledge including batch normalization and data distribution information. In this work, we propose Client-side poisoning Gradient Inversion (CGI), which is a novel attack method that can be launched from clients. For the first time, we show the feasibility of a client-side adversary with limited knowledge being able to recover the training samples from the aggregated global model. We take a distinct approach in which the adversary utilizes a malicious model that amplifies the loss of a specific targeted class of interest. When honest clients employ the poisoned global model, the gradients of samples belonging to the targeted class are magnified, making them the dominant factor in the aggregated update. This enables the adversary to effectively reconstruct the private input belonging to other clients using the aggregated update. In addition, our CGI also features its ability to remain stealthy against Byzantine-robust aggregation rules (AGRs). By optimizing malicious updates and blending benign updates with a malicious replacement vector, our method remains undetected by these defense mechanisms. To evaluate the performance of CGI, we conduct experiments on various benchmark datasets, considering representative Byzantine-robust AGRs, and exploring diverse FL settings with different levels of adversary knowledge about the data. Our results demonstrate that CGI consistently and successfully extracts training input in all tested scenarios.


title: M3-AUDIODEC: Multi-channel multi-speaker multi-spatial audio codec

abstract: We introduce M3-AUDIODEC, an innovative neural spatial audio codec designed for efficient compression of multi-channel (binaural) speech in both single and multi-speaker scenarios, while retaining the spatial location information of each speaker. This model boasts versatility, allowing configuration and training tailored to a predetermined set of multi-channel, multi-speaker, and multi-spatial overlapping speech conditions. Key contributions are as follows: 1) Previous neural codecs are extended from single to multi-channel audios. 2) The ability of our proposed model to compress and decode for overlapping speech. 3) A groundbreaking architecture that compresses speech content and spatial cues separately, ensuring the preservation of each speaker's spatial context after decoding. 4) M3-AUDIODEC's proficiency in reducing the bandwidth for compressing two-channel speech by 48% when compared to individual binaural channel compression. Impressively, at a 12.6 kbps operation, it outperforms Opus at 24 kbps and AUDIODEC at 24 kbps by 37% and 52%, respectively. In our assessment, we employed speech enhancement and room acoustic metrics to ascertain the accuracy of clean speech and spatial cue estimates from M3-AUDIODEC. Audio demonstrations and source code are available online at https://github.com/anton-jeran/MULTI-AUDIODEC .


title: On the singular problem involving $g$-Laplacian

abstract: In this paper, we show that the existence of a positive weak solution to the equation $(-\Delta_g)^s u=f u^{-q(x)}\;\mbox{in}\; \Omega,$ where $\Omega$ is a smooth bounded domain in $R^N$, $q\in C^1(\overline{\Omega})$, and $(-\Delta_g)^s$ is the fractional $g$-Laplacian with $g$ is the antiderivative of a Young function and $f$ in suitable Orlicz space subjected to zero Dirichlet condition. This includes the mixed fractional $(p,q)-$Laplacian as a special case. The solution so obtained is also shown to be locally H\"older continuous.


title: A Fast Optimization View: Reformulating Single Layer Attention in LLM Based on Tensor and SVM Trick, and Solving It in Matrix Multiplication Time

abstract: Large language models (LLMs) have played a pivotal role in revolutionizing various facets of our daily existence. Solving attention regression is a fundamental task in optimizing LLMs. In this work, we focus on giving a provable guarantee for the one-layer attention network objective function $L(X,Y) = \sum_{j_0 = 1}^n \sum_{i_0 = 1}^d ( \langle \langle \exp( \mathsf{A}_{j_0} x ) , {\bf 1}_n \rangle^{-1} \exp( \mathsf{A}_{j_0} x ), A_{3} Y_{*,i_0} \rangle - b_{j_0,i_0} )^2$. Here $\mathsf{A} \in \mathbb{R}^{n^2 \times d^2}$ is Kronecker product between $A_1 \in \mathbb{R}^{n \times d}$ and $A_2 \in \mathbb{R}^{n \times d}$. $A_3$ is a matrix in $\mathbb{R}^{n \times d}$, $\mathsf{A}_{j_0} \in \mathbb{R}^{n \times d^2}$ is the $j_0$-th block of $\mathsf{A}$. The $X, Y \in \mathbb{R}^{d \times d}$ are variables we want to learn. $B \in \mathbb{R}^{n \times d}$ and $b_{j_0,i_0} \in \mathbb{R}$ is one entry at $j_0$-th row and $i_0$-th column of $B$, $Y_{*,i_0} \in \mathbb{R}^d$ is the $i_0$-column vector of $Y$, and $x \in \mathbb{R}^{d^2}$ is the vectorization of $X$. In a multi-layer LLM network, the matrix $B \in \mathbb{R}^{n \times d}$ can be viewed as the output of a layer, and $A_1= A_2 = A_3 \in \mathbb{R}^{n \times d}$ can be viewed as the input of a layer. The matrix version of $x$ can be viewed as $QK^\top$ and $Y$ can be viewed as $V$. We provide an iterative greedy algorithm to train loss function $L(X,Y)$ up $\epsilon$ that runs in $\widetilde{O}( ({\cal T}_{\mathrm{mat}}(n,n,d) + {\cal T}_{\mathrm{mat}}(n,d,d) + d^{2\omega}) \log(1/\epsilon) )$ time. Here ${\cal T}_{\mathrm{mat}}(a,b,c)$ denotes the time of multiplying $a \times b$ matrix another $b \times c$ matrix, and $\omega\approx 2.37$ denotes the exponent of matrix multiplication.


title: Mandarin Lombard Flavor Classification

abstract: The Lombard effect refers to individuals' unconscious modulation of vocal effort in response to variations in the ambient noise levels, intending to enhance speech intelligibility. The impact of different decibel levels and types of background noise on Lombard effects remains unclear. Building upon the characteristic of Lombard speech that individuals adjust their speech to improve intelligibility dynamically based on the self-feedback speech, we propose a flavor classification approach for the Lombard effect. We first collected Mandarin Lombard speech under different noise conditions, then simulated self-feedback speech, and ultimately conducted the statistical test on the word correct rate. We found that both SSN and babble noise types result in four distinct categories of Mandarin Lombard speech in the range of 30 to 80 dBA with different transition points.


title: A new break near 10 TeV in the energy spectrum of protons according to data from space-based instruments: astrophysical interpretation

abstract: Recent experimental data from space-based instruments of the DAMPE and CALET collaborations have shown that the energy spectrum of protons has a new feature, a break in the $\sim 10$ TeV region. In this energy range, the spectrum index of the observed particles varies from $-2.6$ to $-2.9$. The purpose of this work is to establish the local sources's position and age that determine this break, the index of the proton generation spectrum in them, as well as the astrophysical interpretation of the results obtained in the DAMPE and CALET experiments. Within the framework of the model of nonclassical diffusion of cosmic rays developed by the authors, which has break due to the propagation of particles in a sharply inhomogeneous (fractal type) galactic medium, it is shown that break in this energy range is formed by tevatron located at a distance of $\sim 120$ pc from the Earth. These source, whose age is $\sim 5 \cdot 10^5$ years, generate particles with a spectrum index $\sim 2.7$. The power-law behavior of the proton spectrum before and after the break, soft spectrum of particles generation in the source, first obtained in the DAMPE and CALET experiments, should be considered as an indication of the need to revise the standard paradigm accepted today about the sources of cosmic rays, mechanisms of particle acceleration in them and particles propagation in the Galaxy.


title: Where are the Pevatrons that Form the Knee in the Spectrum of the Cosmic Ray Nucleon Component around 4 PeV?

abstract: The paper discusses an approach that made it possible to estimate the distance to the nearest pevatrons, which form a knee in the spectrum of the cosmic ray nucleon component of about $4$ PeV. It is based on the spectra of nucleons and electrons obtained by the authors in the framework of the superdiffusion model of nonclassical cosmic rays diffusion, which have a knee, on the assumption that nucleons and electrons are accelerated by the same type sources and their propagation in an inhomogeneous turbulent galactic medium is characterized by the same diffusion coefficient, and also on the knee in the spectrum of the electronic component in the region of $0.9$ TeV, established in the DAMPE experiment. It is shown that pevatrons, which form a knee in the spectrum of the cosmic ray nucleon component of about $4$ PeV, are located at distances of the order of $0.75$ kpc from the Earth.


title: Grid-Aware On-Route Fast-Charging Infrastructure Planning for Battery Electric Bus with Equity Considerations: A Case Study in South King County

abstract: The transition from traditional bus fleets to zero-emission ones necessitates the development of effective planning models for battery electric bus (BEB) charging infrastructure. On-route fast charging stations, distinct from on-base charging stations, present unique challenges related to safe operation and power supply capacity, making it difficult to control grid operational costs. This paper establishes a novel framework that integrates the bus route network and power network, which leverages the inter-dependency between both networks to optimize the planning outcomes of on-route BEB charging stations in South King County. The problem is formulated as a mixed-integer second-order cone programming model, aiming to minimize the overall planning cost, which includes investments in charging equipment, power facility, and grid operation. Furthermore, fairness measurements are incorporated into the planning process, allowing for the consideration of both horizontal transit equity and vertical transit equity based on different zone merging criteria within the county's existing census tracts. The results of this planning model offer valuable insights into achieving both economic efficiency and social justice in the design of on-route charging facilities for BEBs in South King County.


title: ChatGPT MT: Competitive for High- (but not Low-) Resource Languages

abstract: Large language models (LLMs) implicitly learn to perform a range of language tasks, including machine translation (MT). Previous studies explore aspects of LLMs' MT capabilities. However, there exist a wide variety of languages for which recent LLM MT performance has never before been evaluated. Without published experimental evidence on the matter, it is difficult for speakers of the world's diverse languages to know how and whether they can use LLMs for their languages. We present the first experimental evidence for an expansive set of 204 languages, along with MT cost analysis, using the FLORES-200 benchmark. Trends reveal that GPT models approach or exceed traditional MT model performance for some high-resource languages (HRLs) but consistently lag for low-resource languages (LRLs), under-performing traditional MT for 84.1% of languages we covered. Our analysis reveals that a language's resource level is the most important feature in determining ChatGPT's relative ability to translate it, and suggests that ChatGPT is especially disadvantaged for LRLs and African languages.


title: Composition and Structure Based GGA Bandgap Prediction Using Machine Learning Approach

abstract: This study focuses on developing precise machine learning (ML) regression models for predicting energy bandgap values based on chemical compositions and crystal structures. The primary aim is to match the accuracy of predictions derived from GGA-PBE calculations and validate them through density functional theory (DFT)-based band structure calculations. We assessed eight standalone ML regression models, including AdaBoost, Bagging, CatBoost, LGBM, RF, DT, GB, and XGB. These models were analyzed for their ability to predict GGA-PBE bandgap values across diverse material structures and compositions, using a dataset containing bandgap values for 106,113 compounds. Additionally, we constructed four ensemble models using the stacking method and seven using the bagging method. These ensemble models incorporated RidgeCV and LassoCV to explore if ensemble techniques could enhance prediction accuracy. The dataset was divided into subsets of varying sizes: 10,000, 25,000, 50,000, and 100,000 entries. We determined feature importance through permutation techniques and established a correlation coefficient matrix using the Pearson correlation method. The Random Forest (RF) model emerged as the top performer among standalone models, achieving an R2 value of 0.943 and an RMSE value of 0.504 eV. Bagging regression demonstrated improved performance across different dataset sizes with streamlined feature selection. Ensemble models, particularly bagging, consistently outperformed standalone models, achieving the best R2 value of 0.948 and an RMSE value of 0.479 eV in the test dataset. Using the best-performing model, we predicted bandgap values for new half-Heusler compounds with 18 valence electron counts. These predictions were successfully validated using accurate DFT calculations. DFT calculations indicated that the newly predicted compounds are narrow bandgap semiconductors with dynamic stability.


title: JSMNet Improving Indoor Point Cloud Semantic and Instance Segmentation through Self-Attention and Multiscale

abstract: The semantic understanding of indoor 3D point cloud data is crucial for a range of subsequent applications, including indoor service robots, navigation systems, and digital twin engineering. Global features are crucial for achieving high-quality semantic and instance segmentation of indoor point clouds, as they provide essential long-range context information. To this end, we propose JSMNet, which combines a multi-layer network with a global feature self-attention module to jointly segment three-dimensional point cloud semantics and instances. To better express the characteristics of indoor targets, we have designed a multi-resolution feature adaptive fusion module that takes into account the differences in point cloud density caused by varying scanner distances from the target. Additionally, we propose a framework for joint semantic and instance segmentation by integrating semantic and instance features to achieve superior results. We conduct experiments on S3DIS, which is a large three-dimensional indoor point cloud dataset. Our proposed method is compared against other methods, and the results show that it outperforms existing methods in semantic and instance segmentation and provides better results in target local area segmentation. Specifically, our proposed method outperforms PointNet (Qi et al., 2017a) by 16.0% and 26.3% in terms of semantic segmentation mIoU in S3DIS (Area 5) and instance segmentation mPre, respectively. Additionally, it surpasses ASIS (Wang et al., 2019) by 6.0% and 4.6%, respectively, as well as JSPNet (Chen et al., 2022) by a margin of 3.3% for semantic segmentation mIoU and a slight improvement of 0.3% for instance segmentation mPre.


title: At the borderline of shape coexistence: Mo and Ru

abstract: Background Even-even isotopes of Mo ($Z=42$) and Ru ($Z=44$) are nuclei close to the subshell closure at $Z=40$, where shape coexistence plays a significant role. As a result, their spectroscopic properties are expected to resemble those of Sr ($Z=38$) and Zr ($Z=40$). Exploring the evolution of these properties as they move away from the subshell closure is of great interest. Purpose The purpose of this study is to reproduce the spectroscopic properties of even-even $^{96-110}_{\phantom{961-}42}$Mo and $^{98-114}_{\phantom{961-}44}$Ru isotopes and to determine the influence of shape coexistence. Method We have employed the interacting boson model with configuration mixing as the framework to calculate all the observables for Mo and Ru isotopes. We have considered two types of configurations: 0-particle-0-hole and 2-particle-2-hole excitations. The model parameters have been determined using a least-squares fitting to match the excitation energies and the $B(E2)$ transition rates. Results We have obtained the excitation energies, $B(E2)$ values, two-neutron separation energies, nuclear radii, and isotope shifts for the entire chain of isotopes. Our theoretical results have shown good agreement with experimental data. Furthermore, we have conducted a detailed analysis of the wave functions and obtained the mean-field energy surfaces and the nuclear deformation parameter, $\beta$, for all considered isotopes. Conclusions Our findings reveal that shape coexistence plays a significant role in Mo isotopes, with the crossing of intruder and regular configurations occurring at neutron number $60$ ($A=102$), which induces a quantum phase transition. In contrast, in Ru isotopes, the intruder states have minimal influence, remaining at higher energies. However, at neutron number $60$, also a quantum phase transition occurs in Ru isotopes.


title: Measuring Higher-Order Rationality with Belief Control

abstract: Determining an individual's strategic reasoning capability based solely on choice data is a complex task. This complexity arises because sophisticated players might have non-equilibrium beliefs about others, leading to non-equilibrium actions. In our study, we pair human participants with computer players known to be fully rational. This use of robot players allows us to disentangle limited reasoning capacity from belief formation and social biases. Our results show that, when paired with robots, subjects consistently demonstrate higher levels of rationality and maintain stable rationality levels across different games compared to when paired with humans. This suggests that strategic reasoning might indeed be a consistent trait in individuals. Furthermore, the identified rationality limits could serve as a measure for evaluating an individual's strategic capacity when their beliefs about others are adequately controlled.


title: Physical Invisible Backdoor Based on Camera Imaging

abstract: Backdoor attack aims to compromise a model, which returns an adversary-wanted output when a specific trigger pattern appears yet behaves normally for clean inputs. Current backdoor attacks require changing pixels of clean images, which results in poor stealthiness of attacks and increases the difficulty of the physical implementation. This paper proposes a novel physical invisible backdoor based on camera imaging without changing nature image pixels. Specifically, a compromised model returns a target label for images taken by a particular camera, while it returns correct results for other images. To implement and evaluate the proposed backdoor, we take shots of different objects from multi-angles using multiple smartphones to build a new dataset of 21,500 images. Conventional backdoor attacks work ineffectively with some classical models, such as ResNet18, over the above-mentioned dataset. Therefore, we propose a three-step training strategy to mount the backdoor attack. First, we design and train a camera identification model with the phone IDs to extract the camera fingerprint feature. Subsequently, we elaborate a special network architecture, which is easily compromised by our backdoor attack, by leveraging the attributes of the CFA interpolation algorithm and combining it with the feature extraction block in the camera identification model. Finally, we transfer the backdoor from the elaborated special network architecture to the classical architecture model via teacher-student distillation learning. Since the trigger of our method is related to the specific phone, our attack works effectively in the physical world. Experiment results demonstrate the feasibility of our proposed approach and robustness against various backdoor defenses.


title: Semantic Parsing in Limited Resource Conditions

abstract: This thesis explores challenges in semantic parsing, specifically focusing on scenarios with limited data and computational resources. It offers solutions using techniques like automatic data curation, knowledge transfer, active learning, and continual learning. For tasks with no parallel training data, the thesis proposes generating synthetic training examples from structured database schemas. When there is abundant data in a source domain but limited parallel data in a target domain, knowledge from the source is leveraged to improve parsing in the target domain. For multilingual situations with limited data in the target languages, the thesis introduces a method to adapt parsers using a limited human translation budget. Active learning is applied to select source-language samples for manual translation, maximizing parser performance in the target language. In addition, an alternative method is also proposed to utilize machine translation services, supplemented by human-translated data, to train a more effective parser. When computational resources are limited, a continual learning approach is introduced to minimize training time and computational memory. This maintains the parser's efficiency in previously learned tasks while adapting it to new tasks, mitigating the problem of catastrophic forgetting. Overall, the thesis provides a comprehensive set of methods to improve semantic parsing in resource-constrained conditions.