title: Few-Shot Classification of Skin Lesions from Dermoscopic Images by Meta-Learning Representative Embeddings

abstract: Annotated images and ground truth for the diagnosis of rare and novel diseases are scarce. This is expected to prevail, considering the small number of affected patient population and limited clinical expertise to annotate images. Further, the frequently occurring long-tailed class distributions in skin lesion and other disease classification datasets cause conventional training approaches to lead to poor generalization due to biased class priors. Few-shot learning, and meta-learning in general, aim to overcome these issues by aiming to perform well in low data regimes. This paper focuses on improving meta-learning for the classification of dermoscopic images. Specifically, we propose a baseline supervised method on the meta-training set that allows a network to learn highly representative and generalizable feature embeddings for images, that are readily transferable to new few-shot learning tasks. We follow some of the previous work in literature that posit that a representative feature embedding can be more effective than complex meta-learning algorithms. We empirically prove the efficacy of the proposed meta-training method on dermoscopic images for learning embeddings, and show that even simple linear classifiers trained atop these representations suffice to outperform some of the usual meta-learning methods.


title: Learning to Defer to Multiple Experts: Consistent Surrogate Losses, Confidence Calibration, and Conformal Ensembles

abstract: We study the statistical properties of learning to defer (L2D) to multiple experts. In particular, we address the open problems of deriving a consistent surrogate loss, confidence calibration, and principled ensembling of experts. Firstly, we derive two consistent surrogates -- one based on a softmax parameterization, the other on a one-vs-all (OvA) parameterization -- that are analogous to the single expert losses proposed by Mozannar and Sontag (2020) and Verma and Nalisnick (2022), respectively. We then study the frameworks' ability to estimate P( m_j = y | x ), the probability that the jth expert will correctly predict the label for x. Theory shows the softmax-based loss causes mis-calibration to propagate between the estimates while the OvA-based loss does not (though in practice, we find there are trade offs). Lastly, we propose a conformal inference technique that chooses a subset of experts to query when the system defers. We perform empirical validation on tasks for galaxy, skin lesion, and hate speech classification.


title: Reward Shaping Using Convolutional Neural Network

abstract: In this paper, we propose Value Iteration Network for Reward Shaping (VIN-RS), a potential-based reward shaping mechanism using Convolutional Neural Network (CNN). The proposed VIN-RS embeds a CNN trained on computed labels using the message passing mechanism of the Hidden Markov Model. The CNN processes images or graphs of the environment to predict the shaping values. Recent work on reward shaping still has limitations towards training on a representation of the Markov Decision Process (MDP) and building an estimate of the transition matrix. The advantage of VIN-RS is to construct an effective potential function from an estimated MDP while automatically inferring the environment transition matrix. The proposed VIN-RS estimates the transition matrix through a self-learned convolution filter while extracting environment details from the input frames or sampled graphs. Due to (1) the previous success of using message passing for reward shaping; and (2) the CNN planning behavior, we use these messages to train the CNN of VIN-RS. Experiments are performed on tabular games, Atari 2600 and MuJoCo, for discrete and continuous action space. Our results illustrate promising improvements in the learning speed and maximum cumulative reward compared to the state-of-the-art.


title: Quantum Error Correction in the Lowest Landau Level

abstract: We develop finite-dimensional versions of the quantum error-correcting codes proposed by Albert, Covey, and Preskill (ACP) for continuous-variable quantum computation on configuration spaces with nonabelian symmetry groups. Our codes can be realized by a charged particle in a Landau level on a spherical geometry -- in contrast to the planar Landau level realization of the qudit codes of Gottesman, Kitaev, and Preskill (GKP) -- or more generally by spin coherent states. Our quantum error-correction scheme is inherently approximate, and the encoded states may be easier to prepare than those of GKP or ACP.


title: Topological Josephson junction in transverse magnetic field

abstract: We consider Majorana zero modes in a Josephson junction on top of a topological insulator in transverse magnetic field. Majorana zero modes reside at periodically located nodes of Josephson vortices. We find that hybridization of these modes is prohibited by symmetries of the problem at vanishing chemical potential, which ensures better protection of zero modes and yields methods to control the tunnel coupling between Majorana modes for quantum information processing applications.


title: On the $p$-adic zeros of the Tribonacci sequence

abstract: In this paper, we refute some conjectures of Marques and Lengyel concerning the $p$-adic valuations of members of the Tribonacci sequence.


title: Multilingual Multimodality: A Taxonomical Survey of Datasets, Techniques, Challenges and Opportunities

abstract: Contextualizing language technologies beyond a single language kindled embracing multiple modalities and languages. Individually, each of these directions undoubtedly proliferated into several NLP tasks. Despite this momentum, most of the multimodal research is primarily centered around English and multilingual research is primarily centered around contexts from text modality. Challenging this conventional setup, researchers studied the unification of multilingual and multimodal (MultiX) streams. The main goal of this work is to catalogue and characterize these works by charting out the categories of tasks, datasets and methods to address MultiX scenarios. To this end, we review the languages studied, gold or silver data with parallel annotations, and understand how these modalities and languages interact in modeling. We present an account of the modeling approaches along with their strengths and weaknesses to better understand what scenarios they can be used reliably. Following this, we present the high-level trends in the overall paradigm of the field. Finally, we conclude by presenting a road map of challenges and promising research directions.


title: Regularization of relative holonomic D-modules

abstract: Let $X$ and $S$ be complex analytic manifolds where $S$ plays the role of a parameter space. Using the sheaf $\DXS^{\infty}$ of relative differential operators of infinite order, we construct functorially the regular holonomic $\DXS$-module $\shm_{reg}$ associated to a relative holonomic $\DXS$-module $\shm$, extending to the relative case classical theorems by Kashiwara-Kawai: denoting by $\shm^{\infty}$ the tensor product of $\shm$ by $\DXS^{\infty}$ we explicit $\shm^{\infty}$ in terms of the sheaf of holomorphic solutions of $\shm$ and prove that $\shm^{\infty}$ and $\shm_{reg}^{\infty}$ are isomorphic.


title: Evaporation of water in a microfluidic channel under magnetic field

abstract: The evaporation of drops of water placed at the center of long poly(methyl methacrylate) microfluidic channels with a rectangular cross section of 0.38 mm2 is studied by simultaneously monitoring the shapes of two samples, one is in a 300 mT magnetic field, the other is in no field. A magnetic enhancement of the evaporation rate of up to 140 % is observed, which can be understood by treating the ortho and para nuclear isomers of water vapor as quasi-independent gasses with an ortho:para ratio in fresh vapor close to 2:3. It would take much longer than the 2 - 4 h duration of an experiment in the channel, for the ratio to approach the 3:1 equilibrium value. Magnetic field influences evaporation rate by equalizing the isomeric populations in the vapor phase. The atmosphere in the channel is saturated with water vapor yet the evaporation rate far exceeds that in open beakers.


title: Learning Heuristics for the Maximum Clique Enumeration Problem Using Low Dimensional Representations

abstract: Approximate solutions to various NP-hard combinatorial optimization problems have been found by learned heuristics using complex learning models. In particular, vertex (node) classification in graphs has been a helpful method towards finding the decision boundary to distinguish vertices in an optimal set from the rest. By following this approach, we use a learning framework for a pruning process of the input graph towards reducing the runtime of the maximum clique enumeration problem. We extensively study the role of using different vertex representations on the performance of this heuristic method, using graph embedding algorithms, such as Node2vec and DeepWalk, and representations using higher-order graph features comprising local subgraph counts. Our results show that Node2Vec and DeepWalk are promising embedding methods in representing nodes towards classification purposes. We observe that using local graph features in the classification process produce more accurate results when combined with a feature elimination process. Finally, we provide tests on random graphs to show the robustness and scalability of our method.


title: The algebraic origin of the Doppler factor in the Lienard-Wiechert potentials

abstract: After reviewing the algebraic derivation of the Doppler factor in the Lienard-Wiechert potentials of an electrically charged point particle, we conclude that the Dirac delta function used in electrodynamics must be the one obeying the weak definition, non-zero in an infinitesimal neighborhood, and not the one obeying the strong definition, non-zero in a point. This conclusion emerges from our analysis of a) the derivation of an important Dirac delta function identity, which generates the Doppler factor, b) the linear superposition principle implicitly used by the Green function method, and c) the two equivalent formulations of the Schwarzschild-Tetrode-Fokker action. As a consequence, in full agreement with our previous discussion of the geometrical origin of the Doppler factor, we conclude that the electromagnetic interaction takes place not between points in Minkowski space, but between corresponding infinitesimal segments along the worldlines of the particles.


title: Development of an Efficient Formulation for Volterra's Equations of Motion for Multibody Dynamical Systems

abstract: In this paper, we present an efficient form of Volterra's equations of motion for both unconstrained and constrained multibody dynamical systems that include ignorable coordinates. The proposed method is applicable for systems with both holonomic and nonholonomic constraints. Firstly, based on the definition of ignorable coordinates, one of the motion constants (the generalized momentum vector corresponding to the ignorable coordinates) is dealt with as a constraint, which will be referred to as dynamical constraints. These constraints, along with ordinary constraints, namely kinematical constraints, are then used in the proposed method to derive motion equations. This approach gives the minimum number of equations needed to study the behavior of a dynamical system. Three simulation examples are provided to evaluate the proposed method and to compare it to existing methods. The first case study is a constrained dynamical system, which moves in two-dimensional space. The second one is an unconstrained multibody system including three connected rigid bodies. Finally, the last case study includes a cubic satellite that uses a deployable boom to move a mass to a desired location. The results of the numerical simulations are compared to the conventional methods and the better performance of the proposed method is demonstrated.


title: Interpretable Geometric Deep Learning via Learnable Randomness Injection

abstract: Point cloud data is ubiquitous in scientific fields. Recently, geometric deep learning (GDL) has been widely applied to solve prediction tasks with such data. However, GDL models are often complicated and hardly interpretable, which poses concerns to scientists who are to deploy these models in scientific analysis and experiments. This work proposes a general mechanism, learnable randomness injection (LRI), which allows building inherently interpretable models based on general GDL backbones. LRI-induced models, once trained, can detect the points in the point cloud data that carry information indicative of the prediction label. We also propose four datasets from real scientific applications that cover the domains of high-energy physics and biochemistry to evaluate the LRI mechanism. Compared with previous post-hoc interpretation methods, the points detected by LRI align much better and stabler with the ground-truth patterns that have actual scientific meanings. LRI is grounded by the information bottleneck principle, and thus LRI-induced models are also more robust to distribution shifts between training and test scenarios. Our code and datasets are available at \url{https://github.com/Graph-COM/LRI}.


title: Modelling the 2020 November 29 solar energetic particle event using the EUHFORIA and the iPATH model

abstract: We present the implementation of coupling the EUropean Heliospheric FORcasting Information Asset (EUHFORIA) and the improved Particle Acceleration and Transport in the Heliosphere (iPATH) model and simulate the widespread solar energetic particle (SEP) event of 2020 November 29. We compare the simulated time intensity profiles with measurements at Parker Solar Probe (PSP), the Solar Terrestrial Relations Observatory (STEREO)-A, SOlar and Heliospheric Observatory (SOHO) and Solar Orbiter (SolO). We focus on the influence of the history of shock acceleration on the varying SEP time intensity profiles and investigate the underlying causes in the origin of this widespread SEP event. The temporal evolution of shock parameters and particle fluxes during this event are examined. We find that adopting a realistic solar wind background can significantly impact the expansion of the shock and consequently the shock parameters. Time intensity profiles with an energetic storm particle event at PSP are well reproduced from the simulation. In addition, the simulated and observed time intensity profiles of protons show a similar two-phase enhancement at STA. These results illustrate that modelling a shock using a realistic solar wind is crucial in determining the characteristics of SEP events. The decay phase of the modelled time intensity profiles at Earth agrees well with observations, indicating the importance of perpendicular diffusion in widespread SEP events. Taking into account the possible large curved magnetic field line connecting to SolO, the modelled time intensity profiles show good agreement with the observation. We suggest that the largely distorted magnetic field lines due to a stream interaction region may be a key factor in understanding the observed SEPs at SolO in this event.


title: Discovery of a Dusty, Chemically Mature Companion to a z$\sim$4 Starburst Galaxy in JWST ERS Data

abstract: We report the discovery of two companion sources to a strongly lensed galaxy SPT0418-47 ("ring") at redshift 4.225, targeted by the JWST Early Release Science program. We confirm that these sources are at a similar redshift as the ring based on H$\alpha$ detected in the NIRSpec spectrum, and [C II] 158 $\mu$m line from ALMA. Using multiple spectral lines detected in JWST/NIRSpec, the rest-frame optical to infrared images from NIRCam and MIRI, and far-infrared (FIR) dust continuum detected by ALMA, we argue that the newly discovered sources are actually lensed images of the same companion galaxy, hereafter referred to as SPT0418-SE ("SE"), located within 5 kpc in the source plane of the ring. The star formation rate derived using [C II] and dust continuum puts a lower limit of 17 M$_\odot$/yr, while the SFR$_\mathrm{H\alpha}$ is estimated to be >2 times lower, thereby confirming that SE is a heavily dust obscured star-forming galaxy. Analysis using optical strong line diagnostics suggests that SE has near solar elemental abundance, while the ring appears to have super-solar metallicity O/H and N/O. We attempt to reconcile the high metallicity in this system by invoking early onset of star formation with continuous high star forming efficiency, or that optical strong line diagnostics need revision at high redshift. We suggest that SPT0418-47 resides in a massive dark matter halo with yet to be discovered neighbors. This work highlights the importance of joint analysis of JWST and ALMA data for a deep and complete picture of the early Universe.


title: Forecasting Hierarchical Time Series

abstract: This paper addresses a common problem with hierarchical time series. Time series analysis demands the series for a model to be the sum of multiple series at corresponding sub-levels. Hierarchical Time Series presents a two-fold problem. First, each individual time series model at each level in the hierarchy must be estimated separately. Second, those models must maintain their hierarchical structure over the specified period of time, which is complicated by performance degradation of the higher-level models in the hierarchy. This performance loss is attributable to the summation of the bottom-level time series models. In this paper, the proposed methodology works to correct this degradation of performance through a top-down approach using odds, time series and systems of linear equations. Vertically, the total counts of corresponding series at each sub-level are captured while horizontally odds are computed to establish and preserve the relationship between each respective time series model at each level. The results, based on root mean square percentage error with simulated hierarchical time series data, are promising.


title: Semantic-Native Communication: A Simplicial Complex Perspective

abstract: Semantic communication enables intelligent agents to extract meaning (or semantics) of information via interaction, to carry out collaborative tasks. In this paper, we study semantic communication from a topological space perspective, in which higher-order data semantics live in a simplicial complex. Specifically, a transmitter first maps its data into a $k$-order simplicial complex and then learns its high-order correlations. The simplicial structure and corresponding features are encoded into semantic embeddings in latent space for transmission. Subsequently, the receiver decodes the structure and infers the missing or distorted data. The transmitter and receiver collaboratively train a simplicial convolutional autoencoder to accomplish the semantic communication task. Experiments are carried out on a real dataset of Semantic Scholar Open Research Corpus, where one part of the semantic embedding is missing or distorted during communication. Numerical results show that the simplicial convolutional autoencoder enabled semantic communication effectively rebuilds the simplicial features and infer the missing data with $95\%$ accuracy, while achieving stable performance under channel noise. In contrast, the conventional autoencoder enabled communication fails to infer any missing data. Moreover, our approach is shown to effectively infer the distorted data without prior simplicial structure knowledge at the receiver, by learning extracted semantic information during communications. Leveraging the topological nature of information, the proposed method is also shown to be more reliable and efficient compared to several baselines, notably at low signal-to-noise (SNR) levels.


title: A note on directed analogues of the Sidorenko and forcing conjectures

abstract: We study analogues of Sidorenko's conjecture and the forcing conjecture in oriented graphs, showing that natural variants of these conjectures in directed graphs are equivalent to the asymmetric, undirected analogues of the conjectures.


title: Shallow-flow velocity predictions using discontinuous Galerkin solutions

abstract: Numerical solvers of the two-dimensional (2D) shallow water equations (2D-SWE) can be an efficient option to predict spatial distribution of velocity fields in quasi-steady flows past or throughout hydraulic engineering structures. A second-order finite volume solver (FV2) spuriously elongates small-scale recirculating eddies within its predictions, unless sustained by an artificial eddy viscosity, while a third-order finite volume (FV3) solver can distort the eddies within its predictions. The extra complexity in a second-order discontinuous Galerkin (DG2) solver leads to significantly reduced error dissipation and improved predictions at a coarser resolution, making it a viable contender to acquire velocity predictions in shallow flows. This paper analyses this predictive capability for a grid-based, open source DG2 solver with reference to FV2 or FV3 solvers for simulating velocity magnitude and direction at the sub-meter scale. The simulated predictions are assessed against measured velocity data for four experimental test cases. The results consistently indicate that the DG2 solver is a competitive choice to efficiently produce more accurate velocity distributions for the simulations dominated by smooth flow regions.


title: Glasner property for linear group actions and their products

abstract: A theorem of Glasner from 1979 shows that if $Y \subset \mathbb{T} = \mathbb{R}/\mathbb{Z}$ is infinite then for each $\epsilon > 0$ there exists an integer $n$ such that $nY$ is $\epsilon$-dense. This has been extended in various works by showing that certain irreducible linear semigroup actions on $\mathbb{T}^d$ also satisfy such a \textit{Glasner property} where each infinite set (in fact, arbitrarily large finite set) will have an $\epsilon$-dense image under some element from the acting semigroup. We improve these works by proving a quantitative Glasner theorem for irreducible linear group actions with Zariski-connected Zariski-closure. This makes use of recent results on linear random walks on the torus. We also pose a natural question that asks whether the cartesian product of two actions satisfying the Glasner property also satisfy a Glasner property for infinite subsets which contain no two points on a common vertical or horizontal line. We answer this question affirmatively for many such Glasner actions by providing a new Glasner-type theorem for linear actions that are not irreducible, as well as polynomial versions of such results.


title: The Discrete Gauss Image Problem

abstract: The Gauss Image problem is a generalization to the question originally posed by Aleksandrov, who studied the existence of the convex body with prescribed Aleksandrov's integral curvature. A simple discrete case of the Gauss Image Problem can be formulated as follows: given a finite set of directions in $\mathbb R^n$ and the same number of unit vectors, does there exist a convex polytope in $\mathbb R^n$ containing the origin in its interior with vertices at given directions such that each normal cone at the vertex contains exactly one of the given vectors in its interior? We pose a combinatorial problem, called the Assignment Problem, for discrete measures. It is shown that the discrete Gauss Image Problem and the Assignment Problem are equivalent. We establish a geometric condition for measures which solves the Assignment Problem and, hence, the Gauss Image Problem. We also show that generically, the Assignment Problem has a solution. The proper reformulation for the uniqueness questions is also addressed and analyzed. The work establishes interesting connections of the Discrete Gauss Image problem to Hall's marriage theorem and transportation polytopes.


title: Deflating Spacetime: A Dynamics-First View of the Spacetime Manifold

abstract: What, if anything, can help us explain the dynamical behavior of matter? One may be tempted here to appeal to the laws of nature, or to the world's geometric structure, or even to the smooth topological structure of the spacetime manifold itself. Some think, however, that the metaphysics involved in such explanatory strategies is excessively spooky. Indeed, some opt to reverse the arrow of explanation, putting dynamics first. For instance, one can use Lewis's Best Systems Analysis (BSA) to view the laws of nature as merely being codifications of certain patterns in the dynamical behavior of matter. Similarly, one can use Huggett's Regularity Relationism to achieve an analogous view of the world's geometric structure. At present, however, there is no such dynamics-first view of the spacetime manifold itself. This dissertation puts forward such a view: The spacetime manifold is merely a codification of certain patterns in the dynamical behavior of matter. This dissertation develops powerful mathematical tools for investigating and negotiating between a wide variety of spacetime settings for a wide range of spacetime theories. From here, a competition between different spacetime codifications is invoked analogous to the competition between different law-like codifications in Lewis's BSA. Whereas the BSA judges law-like codifications based on their balance of simplicity and strength, spacetime codifications are to be judged by how well they fit the theory's dynamics and kinematics.


title: Representation Learning for General-sum Low-rank Markov Games

abstract: We study multi-agent general-sum Markov games with nonlinear function approximation. We focus on low-rank Markov games whose transition matrix admits a hidden low-rank structure on top of an unknown non-linear representation. The goal is to design an algorithm that (1) finds an $\varepsilon$-equilibrium policy sample efficiently without prior knowledge of the environment or the representation, and (2) permits a deep-learning friendly implementation. We leverage representation learning and present a model-based and a model-free approach to construct an effective representation from the collected data. For both approaches, the algorithm achieves a sample complexity of poly$(H,d,A,1/\varepsilon)$, where $H$ is the game horizon, $d$ is the dimension of the feature vector, $A$ is the size of the joint action space and $\varepsilon$ is the optimality gap. When the number of players is large, the above sample complexity can scale exponentially with the number of players in the worst case. To address this challenge, we consider Markov games with a factorized transition structure and present an algorithm that escapes such exponential scaling. To our best knowledge, this is the first sample-efficient algorithm for multi-agent general-sum Markov games that incorporates (non-linear) function approximation. We accompany our theoretical result with a neural network-based implementation of our algorithm and evaluate it against the widely used deep RL baseline, DQN with fictitious play.


title: Growth of torsion groups of elliptic curves upon base change from number fields

abstract: Given a number field $F_0$ that contains no Hilbert class field of any imaginary quadratic field, we show that under GRH there exists an effectively computable constant $B:=B(F_0)\in\mathbb{Z}^+$ for which the following holds: for any finite extension $L/F_0$ whose degree $[L:F_0]$ is coprime to $B$, one has for all elliptic curves $E_{/F_0}$ that the $L$-rational torsion subgroup $E(L)[\textrm{tors}]=E(F_0)[\textrm{tors}]$. This generalizes a previous result of Gonz\'{a}lez-Jim\'{e}nez and Najman over $F_0=\mathbb{Q}$. Towards showing this, we also prove a result on relative uniform divisibility of the index of a mod-$\ell$ Galois representation of an elliptic curve over $F_0$. Additionally, we show that the main result's conclusion fails when we allow $F_0$ to have rationally defined CM, due to the existence of $F_0$-rational isogenies of arbitrarily large prime degrees satisfying certain congruency conditions.


title: XMD: An End-to-End Framework for Interactive Explanation-Based Debugging of NLP Models

abstract: NLP models are susceptible to learning spurious biases (i.e., bugs) that work on some datasets but do not properly reflect the underlying task. Explanation-based model debugging aims to resolve spurious biases by showing human users explanations of model behavior, asking users to give feedback on the behavior, then using the feedback to update the model. While existing model debugging methods have shown promise, their prototype-level implementations provide limited practical utility. Thus, we propose XMD: the first open-source, end-to-end framework for explanation-based model debugging. Given task- or instance-level explanations, users can flexibly provide various forms of feedback via an intuitive, web-based UI. After receiving user feedback, XMD automatically updates the model in real time, by regularizing the model so that its explanations align with the user feedback. The new model can then be easily deployed into real-world applications via Hugging Face. Using XMD, we can improve the model's OOD performance on text classification tasks by up to 18%.


title: When Do We Need Graph Neural Networks for Node Classification?

abstract: Graph Neural Networks (GNNs) extend basic Neural Networks (NNs) by additionally making use of graph structure based on the relational inductive bias (edge bias), rather than treating the nodes as collections of independent and identically distributed (i.i.d.) samples. Though GNNs are believed to outperform basic NNs in real-world tasks, it is found that in some cases, GNNs have little performance gain or even underperform graph-agnostic NNs. To identify these cases, based on graph signal processing and statistical hypothesis testing, we propose two measures which analyze the cases in which the edge bias in features and labels does not provide advantages. Based on the measures, a threshold value can be given to predict the potential performance advantages of graph-aware models over graph-agnostic models.


title: Near-Ultraviolet Continuum Modeling of the 1985 April 12 Great Flare of AD Leo

abstract: White-light stellar flares are now reported by the thousands in long-baseline, high precision, broad-band photometry from missions like Kepler, K2, and TESS. These observations are crucial inputs for assessments of biosignatures in exoplanetary atmospheres and surface ultraviolet radiation dosages for habitable zone planets around low-mass stars. A limitation of these assessments, however, is the lack of near-ultraviolet spectral observations of stellar flares. To motivate further empirical investigation, we use a grid of radiative-hydrodynamic simulations with an updated treatment of the pressure broadening of hydrogen lines to predict the $\lambda \approx 1800-3300$ \AA\ continuum flux during the rise and peak phases of a well-studied superflare from the dM3e star AD Leo. These predictions are based on semi-empirical superpositions of radiative flux spectra consisting of a high-flux electron beam simulation with a large, low-energy cutoff ($\gtrsim 85$ keV) and a lower-flux electron beam simulation with a smaller, low-energy cutoff ($\lesssim 40$ keV). The two-component models comprehensively explain the hydrogen Balmer line broadening, the optical continuum color temperature, the Balmer jump strength, and the far-ultraviolet continuum strength and shape in the rise/peak phase of this flare. We use spatially resolved analyses of solar flare data from the Interface Region Imaging Spectrograph, combined with the results of previous radiative-hydrodynamic modeling of the 2014 Mar 29 X1 solar flare (SOL20140329T17:48), to interpret the two-component electron beam model as representing the spatial superposition of bright kernels and fainter ribbons over a larger area.


title: Monitoring and Detection of Low-current High-Impedance Faults in Distribution Networks

abstract: Faults in electricity distribution networks have the potential to ignite fires, cause electrocution, and damage the system itself. High current Low Impedance Faults (LIF) are typically detected and mitigated via over-current, distance, directional relays, fuses, etc. In contrast, while High Impedance Faults (HIF) are equally hazardous, they are much more challenging to detect due to the fault current being much lower than load currents and their time-varying and nonlinear behaviour. Moreover, New Zealand distribution networks are extensive and largely unmonitored beyond the substation, and suitable HIF detection schemes are still an ongoing research challenge. To date, we have built a physical test facility for power system fault analysis and developing and evaluating our sensing and fault detection system. We have simulated LIF and HIF with different fault surface materials and load-switching events. From the data collected, we have characterized the unique fault behaviour for both LIF and HIF in 400V networks and trained a Deep Learning classifier to recognize the type of fault present from its unique signature. We have developed an outdoor pole mountable sensing system and have installed this in Wellington Electricity's network for ongoing data collection and evaluation. This paper will describe the test facility and our experience developing and implementing the sensing system. The widest range of HIF phenomena observed was in the fault experiments involving the tree branch. For brevity, therefore, this paper reports on the results of just these tree-branch experiments. HIF faults on other surface materials will be reported elsewhere. Finally, we will detail the pole-mountable sensing system installed in Wellington Electricity's network and the outcomes thus far.


title: Computation of parabolic cylinder functions having complex argument

abstract: Numerical methods for the computation of the parabolic cylinder $U(a,z)$ for real $a$ and complex $z$ are presented. The main tools are recent asymptotic expansions involving exponential and Airy functions, with slowly varying analytic coefficient functions involving simple coefficients, and stable integral representations; these two main main methods can be complemented with Maclaurin series and a Poincar\'e asymptotic expansion. We provide numerical evidence showing that the combination of these methods is enough for computing the function with $5\times 10^{-13}$ relative accuracy in double precision floating point arithmetic.


title: Cosmology in theories with spontaneous scalarization of neutron stars

abstract: In a model of spontaneous scalarization of neutron stars proposed by Damour and Esposite-Farese, a general relativistic branch becomes unstable to trigger tachyonic growth of a scalar field $\phi$ toward a scalarized branch. Applying this scenario to cosmology, there is fatal tachyonic instability of $\phi$ during inflation and matter dominance being incompatible with solar-system constraints on today's field value $\phi_0$. In the presence of a four-point coupling $g^2 \phi^2 \chi^2/2$ between $\phi$ and an inflaton field $\chi$, it was argued by Anson et al. that a positive mass squared heavier than the square of a Hubble expansion rate leads to the exponential suppression of $\phi$ during inflation and that $\phi_0$ can remain small even with the growth of $\phi$ after the radiation-dominated epoch. For several inflaton potentials approximated as $V(\chi)=m^2 \chi^2/2$ about the potential minimum, we study the dynamics of $\phi$ during reheating as well as other cosmological epochs in detail. For certain ranges of the coupling $g$, the homogeneous field $\phi$ can be amplified by parametric resonance during a coherent oscillation of the inflaton. Incorporating the backreaction of created particles under a Hartree approximation, the maximum values of $\phi$ reached during preheating are significantly smaller than those obtained without the backreaction. We also find that the minimum values of $g$ consistent with solar system bounds on $\phi$ at the end of reheating are of order $10^{-5}$ and hence there is a wide range of acceptable values of $g$. Thus, the scenario proposed by Anson et al. naturally leads to the viable cosmological evolution of $\phi$ consistent with local gravity constraints, without modifying the property of scalarized neutron stars.


title: Synthesizer Preset Interpolation using Transformer Auto-Encoders

abstract: Sound synthesizers are widespread in modern music production but they increasingly require expert skills to be mastered. This work focuses on interpolation between presets, i.e., sets of values of all sound synthesis parameters, to enable the intuitive creation of new sounds from existing ones. We introduce a bimodal auto-encoder neural network, which simultaneously processes presets using multi-head attention blocks, and audio using convolutions. This model has been tested on a popular frequency modulation synthesizer with more than one hundred parameters. Experiments have compared the model to related architectures and methods, and have demonstrated that it performs smoother interpolations. After training, the proposed model can be integrated into commercial synthesizers for live interpolation or sound design tasks.


title: Space-time design for deep joint source channel coding of images Over MIMO channels

abstract: We propose novel deep joint source-channel coding (DeepJSCC) algorithms for wireless image transmission over multi-input multi-output (MIMO) Rayleigh fading channels, when channel state information (CSI) is available only at the receiver. We consider two different schemes; one exploiting the spatial diversity and the other exploiting the spatial multiplexing gain of the MIMO channel, respectively. For the former, we utilize an orthogonal space-time block code (OSTBC) to achieve full diversity and increase the robustness against channel variations. In the latter, we directly map the input to the antennas, where the additional degree of freedom can be used to send more information about the source signal. Simulation results show that the diversity scheme outperforms the multiplexing scheme for lower signal-to-noise ratio (SNR) values and a smaller number of receive antennas at the AP. When the number of transmit antennas is greater than two, however, the full-diversity scheme becomes less beneficial. We also show that both the diversity and multiplexing schemes can achieve comparable performance with the state-of-the-art BPG algorithm delivered at the instantaneous capacity of the MIMO channel, which serves as an upper bound on the performance of separation-based practical systems.


title: A Practical Distributed ADMM Solver for Billion-Scale Generalized Assignment Problems

abstract: Assigning items to owners is a common problem found in various real-world applications, for example, audience-channel matching in marketing campaigns, borrower-lender matching in loan management, and shopper-merchant matching in e-commerce. Given an objective and multiple constraints, an assignment problem can be formulated as a constrained optimization problem. Such assignment problems are usually NP-hard, so when the number of items or the number of owners is large, solving for exact solutions becomes challenging. In this paper, we are interested in solving constrained assignment problems with hundreds of millions of items. Thus, with just tens of owners, the number of decision variables is at billion-scale. This scale is usually seen in the internet industry, which makes decisions for large groups of users. We relax the possible integer constraint, and formulate a general optimization problem that covers commonly seen assignment problems. Its objective function is convex. Its constraints are either linear, or convex and separable by items. We study to solve our generalized assignment problems in the Bregman Alternating Direction Method of Multipliers (BADMM) framework where we exploit Bregman divergence to transform the Augmented Lagrangian into a separable form, and solve many subproblems in parallel. The entire solution can thus be implemented using a MapReduce-style distributed computation framework. We present experiment results on both synthetic and real-world datasets to verify its accuracy and scalability.


title: Symbolic Distillation for Learned TCP Congestion Control

abstract: Recent advances in TCP congestion control (CC) have achieved tremendous success with deep reinforcement learning (RL) approaches, which use feedforward neural networks (NN) to learn complex environment conditions and make better decisions. However, such "black-box" policies lack interpretability and reliability, and often, they need to operate outside the traditional TCP datapath due to the use of complex NNs. This paper proposes a novel two-stage solution to achieve the best of both worlds: first to train a deep RL agent, then distill its (over-)parameterized NN policy into white-box, light-weight rules in the form of symbolic expressions that are much easier to understand and to implement in constrained environments. At the core of our proposal is a novel symbolic branching algorithm that enables the rule to be aware of the context in terms of various network conditions, eventually converting the NN policy into a symbolic tree. The distilled symbolic rules preserve and often improve performance over state-of-the-art NN policies while being faster and simpler than a standard neural network. We validate the performance of our distilled symbolic rules on both simulation and emulation environments. Our code is available at https://github.com/VITA-Group/SymbolicPCC.


title: Data Bricks Space Mission: Teaching Kids about Data with Physicalization

abstract: The Data Bricks Space Mission is a prototype activity based on data physicalization for teaching kids about data. The design of the activity is based on a literature review and interviews with elementary school teachers, and targets kids aged 10-12. Using Lego bricks and a fictional space adventure story, teachers can use the Data Bricks Space Mission activity to empower kids to produce data, communicate their findings, and gain a better understanding of the relationship between data and the world around them.


title: Validity Assessment of Legal Will Statements as Natural Language Inference

abstract: This work introduces a natural language inference (NLI) dataset that focuses on the validity of statements in legal wills. This dataset is unique because: (a) each entailment decision requires three inputs: the statement from the will, the law, and the conditions that hold at the time of the testator's death; and (b) the included texts are longer than the ones in current NLI datasets. We trained eight neural NLI models in this dataset. All the models achieve more than 80% macro F1 and accuracy, which indicates that neural approaches can handle this task reasonably well. However, group accuracy, a stricter evaluation measure that is calculated with a group of positive and negative examples generated from the same statement as a unit, is in mid 80s at best, which suggests that the models' understanding of the task remains superficial. Further ablative analyses and explanation experiments indicate that all three text segments are used for prediction, but some decisions rely on semantically irrelevant tokens. This indicates that overfitting on these longer texts likely happens, and that additional research is required for this task to be solved.


title: Translocation through conical pores: A direction-dependent process

abstract: The transport of biomolecules across a cell membrane is an important phenomena that plays a pivotal role in the functioning of biological cells. In this paper, we investigate such processes by modeling the translocation of polymers through a conical channel, directed from the wider opening to the narrow end of the conical channel. We use the molecular dynamics approach to study the problem. The effect of the different conical pore geometry and polymer lengths on translocation dynamics is determined from the behavior of the total translocation time, $\tau$, and waiting time distributions, $w(s)$. The escape of polymer segments from the narrow end of the conical channel is tracked by studying their velocity profile ($v_{s}$). To demonstrate the asymmetric pore effects on the translocation dynamics, we compare the translocation process from both the ends of the conical channel. We find striking differences in the translocation dynamics for both processes, which are in agreement with the experimental study. We have accounted the effect of various rigidity, and increasing length of a polymer chain, on both types of processes. The study can be used to find the transition from a directional dependent to a directional independent translocation process through a asymmetric channel.


title: Non-Robustness of the Cluster-Robust Inference: with a Proposal of a New Robust Method

abstract: The conventional cluster-robust (CR) standard errors may not be robust. They are vulnerable to data that contain a small number of large clusters. When a researcher uses the 51 states in the U.S. as clusters, the largest cluster (California) consists of about 10% of the total sample. Such a case in fact violates the assumptions under which the widely used CR methods are guaranteed to work. We formally show that the conventional CR methods fail if the distribution of cluster sizes follows a power law with exponent less than two. Besides the example of 51 state clusters, some examples are drawn from a list of recent original research articles published in a top journal. In light of these negative results about the existing CR methods, we propose a weighted CR (WCR) method as a simple fix. Simulation studies support our arguments that the WCR method is robust while the conventional CR methods are not.


title: Advanced ensemble modeling method for space object state prediction accounting for uncertainty in atmospheric density

abstract: For objects in the low Earth orbit region, uncertainty in atmospheric density estimation is an important source of orbit prediction error, which is critical for space situational awareness activities such as the satellite conjunction analysis. This paper investigates the evolution of orbit error distribution in the presence of atmospheric density uncertainties, which are modeled using probabilistic machine learning techniques. The recently proposed HASDM-ML, CHAMP-ML, and MSIS-UQ machine learning models for density estimation are used in this work. The investigation is convoluted because of the spatial and temporal correlation of the atmospheric density values. We develop several Monte Carlo methods, each capturing a different spatiotemporal density correlation, to study the effects of density uncertainty on orbit uncertainty propagation. However, Monte Carlo analysis is computationally expensive, so a faster method based on the Kalman filtering technique for orbit uncertainty propagation is also explored. It is difficult to translate the uncertainty in atmospheric density to the uncertainty in orbital states under a standard extended Kalman filter or unscented Kalman filter framework. This work uses the so-called consider covariance sigma point (CCSP) filter that can account for the density uncertainties during orbit propagation. As a test-bed for validation purposes, a comparison between CCSP and Monte Carlo methods of orbit uncertainty propagation is carried out. Finally, using the HASDM-ML, CHAMP-ML, and MSIS-UQ density models, we propose an ensemble approach for orbit uncertainty quantification for four different space weather conditions.


title: STN: a new tensor network method to identify stimulus category from brain activity pattern

abstract: Neural decoding is still a challenge and hot topic in neurocomputing science. Recently, many studies have shown that brain network patterns containing rich spatial and temporal structure information, which represents the activation information of brain under external stimuli. %Therefore, the research of decoding stimuli from brain network received extensive more attention. The traditional method extracts brain network features directly from the common machine learning method, then puts these features into the classifier, and realizes to decode external stimuli. However, this method cannot effectively extract the multi-dimensional structural information, which is hidden in the brain network. The tensor researchers show that the tensor decomposition model can fully mine unique spatio-temporal structure characteristics in multi-dimensional structure data. This research proposed a stimulus constrained tensor brain model(STN)which involves the tensor decomposition idea and stimulus category constraint information. The model was verified on the real neuroimaging data sets (MEG and fMRI). The experimental results show that the STN model achieves more than 11.06% and 18.46% on accuracy matrix compared with others methods on two modal data sets. These results imply the superiority of extracting discriminative characteristics about STN model, especially for decoding object stimuli with semantic information.


title: Comparison of two artificial neural networks trained for the surrogate modeling of stress in materially heterogeneous elastoplastic solids

abstract: The purpose of this work is the systematic comparison of the application of two artificial neural networks (ANNs) to the surrogate modeling of the stress field in materially heterogeneous periodic polycrystalline microstructures. The first ANN is a UNet-based convolutional neural network (CNN) for periodic data, and the second is based on Fourier neural operators (FNO). Both of these were trained, validated, and tested with results from the numerical solution of the boundary-value problem (BVP) for quasi-static mechanical equilibrium in periodic grain microstructures with square domains. More specifically, these ANNs were trained to correlate the spatial distribution of material properties with the equilibrium stress field under uniaxial tensile loading. The resulting trained ANNs (tANNs) calculate the stress field for a given microstructure on the order of 1000 (UNet) to 2500 (FNO) times faster than the numerical solution of the corresponding BVP. For microstructures in the test dataset, the FNO-based tANN, or simply FNO, is more accurate than its UNet-based counterpart; the normalized mean absolute error of different stress components for the former is 0.25-0.40% as compared to 1.41-2.15% for the latter. Errors in FNO are restricted to grain boundary regions, whereas the error in U-Net also comes from within the grain. In comparison to U-Net, errors in FNO are more robust to large variations in spatial resolution as well as small variations in grain density. On other hand, errors in U-Net are robust to variations in boundary box aspect ratio, whereas errors in FNO increase as the domain becomes rectangular. Both tANNs are however unable to reproduce strong stress gradients, especially around regions of stress concentration.


title: Ultrasonic imaging in highly heterogeneous backgrounds

abstract: This work formally investigates the differential evolution indicators as a tool for ultrasonic tracking of elastic transformation and fracturing in randomly heterogeneous solids. Within the framework of periodic sensing, it is assumed that the background contains (i) a multiply connected set of viscoelastic, anisotropic, and piecewise homogeneous inclusions, and (ii) a union of possibly disjoint fractures and pores. The support, material properties, and interfacial condition of scatterers in (i) and (ii) are unknown, while elastic constants of the matrix are provided. The domain undergoes progressive variations of arbitrary chemo-mechanical origins such that its geometric configuration and elastic properties at future times are distinct. At every sensing step $t_\circ, t_1, \ldots,$ multi-modal incidents are generated by a set of boundary excitations, and the resulting scattered fields are captured over the observation surface. The test data are then used to construct a sequence of wavefront densities by solving the spectral scattering equation. The incident fields affiliated with distinct pairs of obtained wavefronts are analyzed over the stationary and evolving scatterers for a suit of geometric and elastic evolution scenarios entailing both interfacial and volumetric transformations. The main theorem establishes the invariance of pertinent incident fields at the loci of static fractures and inclusions between a given pair of time steps, while certifying variation of the same fields over the modified regions. These results furnish a basis for theoretical justification of differential evolution indicators for imaging in complex composites which, in turn, enable the exclusive tomography of evolution in a background endowed with many unknown features.


title: Iterative mean-field approach to the spherical collapse of dark matter halos

abstract: Gravitational collapse of dark matter overdensities leads to the formation of dark matter halos which embed galaxies and galaxy clusters. An intriguing feature of dark matter halos is that their density profiles closely follow a universal form irrespective of the initial condition or the corresponding growth history. This represents a class of dynamical systems with emergent universalities. We propose an "iterative mean-field approach" to compute the solutions of the gravitational collapse dynamics. This approach iteratively searches for the evolution of the interaction field $\phi(t)$ -- in this case the enclosed mass profile $M(r,t)$ -- that is consistent with the dynamics, thus that $\phi(t)$ is the fix-point of the iterative mapping, $\mathcal{H}(\phi) = \phi$. The formalism replaces the N-body interactions with one-body interactions with the coarse-grained interaction field, and thus shares the spirit of the mean-field theory in statistical physics. This "iterative mean-field approach" combines the versatility of numerical simulations and the comprehensiveness of analytical solutions, and is particularly powerful in searching for and understanding intermediate asymptotic states in a wide range of dynamical systems where the solutions can not be obtained through the traditional self-similar analysis.


title: Convergence Rates of Stochastic Zeroth-order Gradient Descent for \L ojasiewicz Functions

abstract: We prove convergence rates of Stochastic Zeroth-order Gradient Descent (SZGD) algorithms for Lojasiewicz functions. The SZGD algorithm iterates as \begin{align*} \mathbf{x}_{t+1} = \mathbf{x}_t - \eta_t \widehat{\nabla} f (\mathbf{x}_t), \qquad t = 0,1,2,3,\cdots , \end{align*} where $f$ is the objective function that satisfies the \L ojasiewicz inequality with \L ojasiewicz exponent $\theta$, $\eta_t$ is the step size (learning rate), and $ \widehat{\nabla} f (\mathbf{x}_t) $ is the approximate gradient estimated using zeroth-order information only. Our results show that $ \{ f (\mathbf{x}_t) - f (\mathbf{x}_\infty) \}_{t \in \mathbb{N} } $ can converge faster than $ \{ \| \mathbf{x}_t - \mathbf{x}_\infty \| \}_{t \in \mathbb{N} }$, regardless of whether the objective $f$ is smooth or nonsmooth.


title: TPGen: A Self-Stabilizing GPU-Based Method for Prime and Test Paths Generation

abstract: This paper presents a novel scalable GPU-based method for Test Paths (TPs) and Prime Paths (PPs) Generation, called TPGen, used in structural testing and in test data generation. TPGen outperforms existing methods for PPs and TPs generation in several orders of magnitude, both in time and space efficiency. Improving both time and space efficiency is made possible through devising a new non-contiguous and hierarchical memory allocation method, called Three-level Path Access Method (TPAM), that enables efficient storage of maximal simple paths in memory. In addition to its high time and space efficiency, a major significance of TPGen includes its self-stabilizing design where threads execute in a fully asynchronous and order-oblivious way without using any atomic instructions. TPGen can generate PPs and TPs of structurally complex programs that have an extremely high cyclomatic and Npath complexity.


title: Uniqueness of positive solutions to elliptic equations with the critical exponential growth on the unit disc and its applications

abstract: In this paper, we will solve this uniqueness problem of positive solutions to the following equations of exponential growth: \begin{equation*} \begin{cases} -\Delta u =\lambda ue^{u^2},\quad\quad & x\in B_1\subset \mathbb{R}^2,\\ u>0, & x\in B_1,\ \\ u=0,\quad\quad &x\in \partial B_1, \end{cases} \end{equation*} where $ 0<\lambda<\lambda_1(B_1)$ and $\lambda_1(B_1)$ denotes the first eigenvalue of the operator $-\Delta$ with the Dirichlet boundary in unit disk. Our method relies on delicate and difficult analysis of radial solutions to the above equation and careful asymptotic expansion of solutions near the boundary. This uniqueness result will shed some light on solving the conjecture that maximizers of the Trudinger-Moser inequality on the unit disc are unique. Furthermore, based on this uniqueness result, we develop a new strategy to establish the quantization property of elliptic equations with the critical exponential growth in the balls of hyperbolic spaces, and obtain the multiplicity and non-existence of positive critical points for super-critical Trudinger-Moser functional. Our method for the quantization property and non-existence of the critical points avoids using the complicated blow-up analysis used in the literature. This method can also be applied to study the similar problems in balls of high dimensional Euclidean space $\mathbb{R}^n$ or hyperbolic spaces provided the uniqueness for the corresponding quasilinear elliptic equations with the critical exponential growth is established.


title: Ensemble transport smoothing. Part I: Unified framework

abstract: Smoothers are algorithms for Bayesian time series re-analysis. Most operational smoothers rely either on affine Kalman-type transformations or on sequential importance sampling. These strategies occupy opposite ends of a spectrum that trades computational efficiency and scalability for statistical generality and consistency: non-Gaussianity renders affine Kalman updates inconsistent with the true Bayesian solution, while the ensemble size required for successful importance sampling can be prohibitive. This paper revisits the smoothing problem from the perspective of measure transport, which offers the prospect of consistent prior-to-posterior transformations for Bayesian inference. We leverage this capacity by proposing a general ensemble framework for transport-based smoothing. Within this framework, we derive a comprehensive set of smoothing recursions based on nonlinear transport maps and detail how they exploit the structure of state-space models in fully non-Gaussian settings. We also describe how many standard Kalman-type smoothing algorithms emerge as special cases of our framework. A companion paper (Ramgraber et al., 2023) explores the implementation of nonlinear ensemble transport smoothers in greater depth.


title: Holomorphic Floer theory and Donaldson-Thomas invariants

abstract: We present several expected properties of the holomorphic Floer theory of a holomorphic symplectic manifold. In particular, we propose a conjecture relating holomorphic Floer theory of Hitchin integrable systems and Donaldson-Thomas invariants of non-compact Calabi-Yau 3-folds. More generally, we conjecture that the BPS spectrum of a $\mathcal{N}=2$ 4-dimensional quantum field theory can be recovered from the holomorphic Floer theory of the corresponding Seiberg-Witten integrable system.


title: Two-band description of the strong `spin'-orbit coupled one-dimensional hole gas in a cylindrical Ge nanowire

abstract: The low-energy effective Hamiltonian of the strong `spin'-orbit coupled one-dimensional hole gas in a cylindrical Ge nanowire in the presence of a strong magnetic field is studied both numerically and analytically. Basing on the Luttinger-Kohn Hamiltonian in the spherical approximation, we show this strong `spin'-orbit coupled one-dimensional hole gas can be accurately described by an effective two-band Hamiltonian $H^{\rm ef}=\hbar^{2}k^{2}_{z}/(2m^{*}_{h})+\alpha\sigma^{x}k_{z}+g^{*}_{h}\mu_{B}B\sigma^{z}/2$, as long as the magnetic field is purely longitudinal or purely transverse. The explicit magnetic field dependent expressions of the `spin'-orbit coupling $\alpha\equiv\alpha(B)$ and the effective $g$-factor $g^{*}_{h}\equiv\,g^{*}_{h}(B)$ are given. When the magnetic field is applied in an arbitrary direction, the two-band Hamiltonian description is still a good approximation.


title: Finite Convergence of Circumcentered-Reflection Method on Closed Convex Cones in Hilbert Spaces

abstract: We establish finite convergence of circumcentered-reflection method (CRM) for the case of intersection of two closed convex cones in a real Hilbert space. We apply this result to prove the finite convergence for two polyhedral sets in R^n.


title: Character-level White-Box Adversarial Attacks against Transformers via Attachable Subwords Substitution

abstract: We propose the first character-level white-box adversarial attack method against transformer models. The intuition of our method comes from the observation that words are split into subtokens before being fed into the transformer models and the substitution between two close subtokens has a similar effect to the character modification. Our method mainly contains three steps. First, a gradient-based method is adopted to find the most vulnerable words in the sentence. Then we split the selected words into subtokens to replace the origin tokenization result from the transformer tokenizer. Finally, we utilize an adversarial loss to guide the substitution of attachable subtokens in which the Gumbel-softmax trick is introduced to ensure gradient propagation. Meanwhile, we introduce the visual and length constraint in the optimization process to achieve minimum character modifications. Extensive experiments on both sentence-level and token-level tasks demonstrate that our method could outperform the previous attack methods in terms of success rate and edit distance. Furthermore, human evaluation verifies our adversarial examples could preserve their origin labels.


title: Superconductivity in CeBeH$_{8}$ and CeBH$_{8}$ at moderate pressures

abstract: High-pressure structural searches of superhydrides CeBeH$_8$ and CeBH$_8$ were performed under ambient pressure up to 300 GPa. We identify $Fm\overline{3}m$-CeBeH$_8$ with a superconducting transition temperature $T_{c}$ of 56 K at 10 GPa. Two more phases with spacegroup $R\overline{3}m$ and $C2/m$, were investigated within the increasing pressures. CeBH$_8$ shows a similar phase transition process as CeBeH$_8$ but with higher transition pressures and higher $T_c$. $Fm\overline{3}m$-CeBH$_8$ is predicted to be superconducting above 120 GPa with a maximum $T_{c}$ of 118 K at 150 GPa. $R\overline{3}m$-CeBH$_8$ and $C2/m$-CeBH$_8$ are dynamically stable above 120 GPa and 100 GPa, respectively. The maximum $T_{c}$ is 123 K at 195 GPa for $R\overline{3}m$-CeBH$_8$, and 115 K at 350 GPa for $C2/m$-CeBH$_8$. Our work enriches the family of ternary hydrides and may provide a useful guideline for further search for superconducting hydrides at low and moderate pressures.


title: An Ore-type condition for hamiltonicity in tough graphs and the extremal examples

abstract: Let $G$ be a $t$-tough graph on $n\ge 3$ vertices for some $t>0$. It was shown by Bauer et al. in 1995 that if the minimum degree of $G$ is greater than $\frac{n}{t+1}-1$, then $G$ is hamiltonian. In terms of Ore-type hamiltonicity conditions, the problem was only studied when $t$ is between 1 and 2, and recently the author proved a general result. The result states that if the degree sum of any two nonadjacent vertices of $G$ is greater than $\frac{2n}{t+1}+t-2$, then $G$ is hamiltonian. It was conjectured in the same paper that the ``$+t$" in the bound $\frac{2n}{t+1}+t-2$ can be removed. Here we confirm the conjecture. The result generalizes the result by Bauer, Broersma, van den Heuvel, and Veldman. Furthermore, we characterize all $t$-tough graphs $G$ on $n\ge 3$ vertices for which $\sigma_2(G) = \frac{2n}{t+1}-2$ but $G$ is non-hamiltonian.


title: Long time solutions for 1D cubic dispersive equations, Part II: the focusing case

abstract: This article is concerned with one dimensional dispersive flows with cubic nonlinearities on the real line. In a very recent work, the authors have introduced a broad conjecture for such flows, asserting that in the defocusing case, small initial data yields global, scattering solutions. Then this conjecture was proved in the case of a Schr\"odinger dispersion relation. In terms of scattering, our global solutions were proved to satisfy both global $L^6$ Strichartz estimates and bilinear $L^2$ bounds. Notably, no localization assumption is made on the initial data. In this article we consider the focusing scenario. There potentially one may have small solitons, so one cannot hope to have global scattering solutions in general. Instead, we look for long time solutions, and ask what is the time-scale on which the solutions exist and satisfy good dispersive estimates. Our main result, which also applies in the case of the Schr\"odinger dispersion relation, asserts that for initial data of size $\epsilon$, the solutions exist on the time-scale $\epsilon^{-8}$, and satisfy the desired $L^6$ Strichartz estimates and bilinear $L^2$ bounds on the time-scale $\epsilon^{-6}$. To the best of our knowledge, this is the first result to reach such a threshold.


title: Stokes's theorem in R

abstract: In this short article I introduce the stokes package which provides functionality for working with tensors, alternating forms, wedge products, and related concepts from the exterior calculus. Notation and spirit follow Spivak. Stokes's generalized integral theorem, viz $\int_{\partial X}\phi=\int_Xd\phi$, is demonstrated here using the package; it is available on CRAN athttps://CRAN.R-project.org/package=stokes.


title: Point-Syn2Real: Semi-Supervised Synthetic-to-Real Cross-Domain Learning for Object Classification in 3D Point Clouds

abstract: Object classification using LiDAR 3D point cloud data is critical for modern applications such as autonomous driving. However, labeling point cloud data is labor-intensive as it requires human annotators to visualize and inspect the 3D data from different perspectives. In this paper, we propose a semi-supervised cross-domain learning approach that does not rely on manual annotations of point clouds and performs similar to fully-supervised approaches. We utilize available 3D object models to train classifiers that can generalize to real-world point clouds. We simulate the acquisition of point clouds by sampling 3D object models from multiple viewpoints and with arbitrary partial occlusions. We then augment the resulting set of point clouds through random rotations and adding Gaussian noise to better emulate the real-world scenarios. We then train point cloud encoding models, e.g., DGCNN, PointNet++, on the synthesized and augmented datasets and evaluate their cross-domain classification performance on corresponding real-world datasets. We also introduce Point-Syn2Real, a new benchmark dataset for cross-domain learning on point clouds. The results of our extensive experiments with this dataset demonstrate that the proposed cross-domain learning approach for point clouds outperforms the related baseline and state-of-the-art approaches in both indoor and outdoor settings in terms of cross-domain generalizability. The code and data will be available upon publishing.


title: Recent progress on multi-bubble blow-ups and multi-solitons to (stochastic) focusing nonlinear Schr\"odinger equations

abstract: We review the recent progress on the long-time behavior for a general class of focusing $L^2$-critical nonlinear Schr\"odinger equations (NLS) with lower order perturbations. Two canonical models are the stochastic NLS driven by linear multiplicative noise and the classical deterministic NLS. We show the construction and uniqueness of the corresponding blow-up solutions and solitons, including the multi-bubble Bourgain-Wang type blow-up solutions and non-pure multi-solitons, which provide new examples for the mass quantization conjecture and the soliton resolution conjecture. The refined uniqueness of pure multi-bubble blow-ups and pure multi-solitons to NLS under very low asymptotical rate is also reviewed. Finally, as a new result, we prove the qualitative properties of stochastic blow-up solutions, including the concentration of mass, universality of critical mass blow-up profiles, as well as the vanishing of the virial at the blow-up time.


title: A picture of the space of typical learnable tasks

abstract: We develop information geometric techniques to understand the representations learned by deep networks when they are trained on different tasks using supervised, meta-, semi-supervised and contrastive learning. We shed light on the following phenomena that relate to the structure of the space of tasks: (1) the manifold of probabilistic models trained on different tasks using different representation learning methods is effectively low-dimensional; (2) supervised learning on one task results in a surprising amount of progress even on seemingly dissimilar tasks; progress on other tasks is larger if the training task has diverse classes; (3) the structure of the space of tasks indicated by our analysis is consistent with parts of the Wordnet phylogenetic tree; (4) episodic meta-learning algorithms and supervised learning traverse different trajectories during training but they fit similar models eventually; (5) contrastive and semi-supervised learning methods traverse trajectories similar to those of supervised learning. We use classification tasks constructed from the CIFAR-10 and Imagenet datasets to study these phenomena.


title: GotFlow3D: Recurrent Graph Optimal Transport for Learning 3D Flow Motion in Particle Tracking

abstract: Flow visualization technologies such as particle tracking velocimetry (PTV) are broadly used in understanding the all-pervasiveness three-dimensional (3D) turbulent flow from nature and industrial processes. Despite the advances in 3D acquisition techniques, the developed motion estimation algorithms in particle tracking remain great challenges of large particle displacements, dense particle distributions and high computational cost. By introducing a novel deep neural network based on recurrent Graph Optimal Transport, called GotFlow3D, we present an end-to-end solution to learn the 3D fluid flow motion from double-frame particle sets. The proposed network constructs two graphs in the geometric and feature space and further enriches the original particle representations with the fused intrinsic and extrinsic features learnt from a graph neural network. The extracted deep features are subsequently utilized to make optimal transport plans indicating the correspondences of particle pairs, which are then iteratively and adaptively retrieved to guide the recurrent flow learning. Experimental evaluations, including assessments on numerical experiments and validations on real-world experiments, demonstrate that the proposed GotFlow3D achieves state-of-the-art performance against both recently-developed scene flow learners and particle tracking algorithms, with impressive accuracy, robustness and generalization ability, which can provide deeper insight into the complex dynamics of broad physical and biological systems.


title: Embedding Space Augmentation for Weakly Supervised Learning in Whole-Slide Images

abstract: Multiple Instance Learning (MIL) is a widely employed framework for learning on gigapixel whole-slide images (WSIs) from WSI-level annotations. In most MIL based analytical pipelines for WSI-level analysis, the WSIs are often divided into patches and deep features for patches (i.e., patch embeddings) are extracted prior to training to reduce the overall computational cost and cope with the GPUs' limited RAM. To overcome this limitation, we present EmbAugmenter, a data augmentation generative adversarial network (DA-GAN) that can synthesize data augmentations in the embedding space rather than in the pixel space, thereby significantly reducing the computational requirements. Experiments on the SICAPv2 dataset show that our approach outperforms MIL without augmentation and is on par with traditional patch-level augmentation for MIL training while being substantially faster.


title: Parametrically driven inertial sensing in chip-scale optomechanical cavities at the thermodynamical limits with extended dynamic range

abstract: Recent scientific and technological advances have enabled the detection of gravitational waves, autonomous driving, and the proposal of a communications network on the Moon (Lunar Internet or LunaNet). These efforts are based on the measurement of minute displacements and correspondingly the forces or fields transduction, which translate to acceleration, velocity, and position determination for navigation. State-of-the-art accelerometers use capacitive or piezo resistive techniques, and micro-electromechanical systems (MEMS) via integrated circuit (IC) technologies in order to drive the transducer and convert its output for electric readout. In recent years, laser optomechanical transduction and readout have enabled highly sensitive detection of motional displacement. Here we further examine the theoretical framework for the novel mechanical frequency readout technique of optomechanical transduction when the sensor is driven into oscillation mode [8]. We demonstrate theoretical and physical agreement and characterize the most relevant performance parameters with a device with 1.5mg/Hz acceleration sensitivity, a 2.5 fm/Hz1/2 displacement resolution corresponding to a 17.02 ug/Hz1/2 force-equivalent acceleration, and a 5.91 Hz/nW power sensitivity, at the thermodynamical limits. In addition, we present a novel technique for dynamic range extension while maintaining the precision sensing sensitivity. Our inertial accelerometer is integrated on-chip, and enabled for packaging, with a laser-detuning-enabled approach.


title: Emotional Brain State Classification on fMRI Data Using Deep Residual and Convolutional Networks

abstract: The goal of emotional brain state classification on functional MRI (fMRI) data is to recognize brain activity patterns related to specific emotion tasks performed by subjects during an experiment. Distinguishing emotional brain states from other brain states using fMRI data has proven to be challenging due to two factors: a difficulty to generate fast yet accurate predictions in short time frames, and a difficulty to extract emotion features which generalize to unseen subjects. To address these challenges, we conducted an experiment in which 22 subjects viewed pictures designed to stimulate either negative, neutral or rest emotional responses while their brain activity was measured using fMRI. We then developed two distinct Convolution-based approaches to decode emotional brain states using only spatial information from single, minimally pre-processed (slice timing and realignment) fMRI volumes. In our first approach, we trained a 1D Convolutional Network (84.9% accuracy; chance level 33%) to classify 3 emotion conditions using One-way Analysis of Variance (ANOVA) voxel selection combined with hyperalignment. In our second approach, we trained a 3D ResNet-50 model (78.0% accuracy; chance level 50%) to classify 2 emotion conditions from single 3D fMRI volumes directly. Our Convolutional and Residual classifiers successfully learned group-level emotion features and could decode emotion conditions from fMRI volumes in milliseconds. These approaches could potentially be used in brain computer interfaces and real-time fMRI neurofeedback research.


title: Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit

abstract: Speaker modeling is essential for many related tasks, such as speaker recognition and speaker diarization. The dominant modeling approach is fixed-dimensional vector representation, i.e., speaker embedding. This paper introduces a research and production oriented speaker embedding learning toolkit, Wespeaker. Wespeaker contains the implementation of scalable data management, state-of-the-art speaker embedding models, loss functions, and scoring back-ends, with highly competitive results achieved by structured recipes which were adopted in the winning systems in several speaker verification challenges. The application to other downstream tasks such as speaker diarization is also exhibited in the related recipe. Moreover, CPU- and GPU-compatible deployment codes are integrated for production-oriented development. The toolkit is publicly available at https://github.com/wenet-e2e/wespeaker.


title: Blank Collapse: Compressing CTC emission for the faster decoding

abstract: Connectionist Temporal Classification (CTC) model is a very efficient method for modeling sequences, especially for speech data. In order to use CTC model as an Automatic Speech Recognition (ASR) task, the beam search decoding with an external language model like n-gram LM is necessary to obtain reasonable results. In this paper we analyze the blank label in CTC beam search deeply and propose a very simple method to reduce the amount of calculation resulting in faster beam search decoding speed. With this method, we can get up to 78% faster decoding speed than ordinary beam search decoding with a very small loss of accuracy in LibriSpeech datasets. We prove this method is effective not only practically by experiments but also theoretically by mathematical reasoning. We also observe that this reduction is more obvious if the accuracy of the model is higher.


title: The HI mass function of star-forming galaxies at $\mathbf{z \sim 0.35}$

abstract: The neutral atomic hydrogen (HI) mass function (HIMF) describes the distribution of the HI content of galaxies at any epoch; its evolution provides an important probe of models of galaxy formation and evolution. Here, we report Giant Metrewave Radio Telescope HI 21cm spectroscopy of blue star-forming galaxies at $z\approx0.20-0.42$ in the Extended Groth Strip, which has allowed us to determine the scaling relation between the average HI mass ($\rm{M_{HI}}$) and the absolute B-band magnitude ($\rm{M_B}$) of such galaxies at $z \approx 0.35$, by stacking the HI 21cm emission signals of galaxy subsamples in different $\rm{M_B}$ ranges. We combine this $\rm{M_{HI}-M_B}$ scaling relation (with a scatter assumed to be equal to that in the local Universe) with the known B-band luminosity function of star-forming galaxies at these redshifts to determine the HIMF at $z\approx0.35$. We show that the use of the correct scatter in the $\rm{M_{HI}-M_B}$ scaling relation is critical for an accurate estimate of the HIMF. We find that the HIMF has evolved significantly from $z\approx0.35$ to $z\approx0$, i.e. over the last four Gyr, especially at the high-mass end. High-mass galaxies, with $\rm{M_{HI}\gtrsim10^{10}\ M_\odot}$, are a factor of $\approx3.4$ less prevalent at $z\approx0.35$ than at $z \approx 0$. Conversely, there are more low-mass galaxies, with $\rm{M_{HI} \approx10^9\ {M}_\odot}$, at $z\approx0.35$ than in the local Universe. While our results may be affected by cosmic variance, we find that massive star-forming galaxies have acquired a significant amount of HI through merger events or accretion from the circumgalactic medium over the past four Gyr.


title: Sylvester sums on the Frobenius set in arithmetic progression with initial gaps

abstract: Let $a_1,a_2,\dots,a_k$ be positive integers with $\gcd(a_1,a_2,\dots,a_k)=1$. Frobenius number is the largest positive integer that is NOT representable in terms of $a_1,a_2,\dots,a_k$. When $k\ge 3$, there is no explicit formula in general, but some formulae may exist for special sequences $a_1,a_2,\dots,a_k$, including, those forming arithmetic progressions and their modifications. In this paper we give explicit formulae for the sum of nonrepresentable positive integers (Sylvester sum) as well as Frobenius numbers and the number of nonrepresentable positive integers (Sylverster number) for $a_1,a_2,\dots,a_k$ forming arithmetic progressions with initial gaps.


title: A Law of Data Separation in Deep Learning

abstract: While deep learning has enabled significant advances in many areas of science, its black-box nature hinders architecture design for future artificial intelligence applications and interpretation for high-stakes decision makings. We addressed this issue by studying the fundamental question of how deep neural networks process data in the intermediate layers. Our finding is a simple and quantitative law that governs how deep neural networks separate data according to class membership throughout all layers for classification. This law shows that each layer improves data separation at a constant geometric rate, and its emergence is observed in a collection of network architectures and datasets during training. This law offers practical guidelines for designing architectures, improving model robustness and out-of-sample performance, as well as interpreting the predictions.


title: Ranking and Unranking Restricted Permutations

abstract: We discuss efficient methods for unranking derangements and m\'enage permutations. That is, we will provide an algorithm to efficiently extract the $k$-th earliest such permutation under the lexicographic ordering. We will show that this problem can be reduced to the problem of computing the number of restricted permutations with a given prefix, and then we will use rook theory to solve this counting problem. This has applications to combinatorics, probability, statistics, and modeling.


title: High Gradient Testing of off-Axis Coupled C-band Cu and CuAg Accelerating Structures

abstract: We report the results of high gradient testing of two single cell off axis coupled standing wave accelerating structures. Two brazed standing wave side coupled structures with the same geometry were tested one made of pure copper Cu and one made of a copper silver CuAg alloy with silver concentration of 0.08 percent. A peak surface electric field of 450 MV per m was achieved in the CuAg structure for a klystron input power of 14.5 MW and a 1 mirco s pulse length which was 25 percent higher than the peak surface electric field achieved in the Cu structure. The superb high gradient performance was achieved because of the two major optimizations in the cavity geometry 1 the shunt impedance of the cavity was maximized for a peak surface electric field to accelerating gradient ratio of 2 for a fully relativistic particle 2 the peak magnetic field enhancement due to the input coupler was minimized to limit pulse heating. These tests allow us to conclude that C band accelerating structures can operate at peak fields similar to those at higher frequencies while providing a larger beam iris for improved beam transport.

categories: physics.acc-ph hep-ex physics.app-ph physics.med-ph


title: Rotational symmetry breaking in superconducting nickelate Nd0.8Sr0.2NiO2 films

abstract: The infinite-layer nickelates, isostructural to the high-Tc superconductor cuprates, have risen as a promising platform to host unconventional superconductivity and stimulated growing interests in the condensed matter community. Despite numerous researches, the superconducting pairing symmetry of the nickelate superconductors, the fundamental characteristic of a superconducting state, is still under debate. Moreover, the strong electronic correlation in the nickelates may give rise to a rich phase diagram, where the underlying interplay between the superconductivity and other emerging quantum states with broken symmetry is awaiting exploration. Here, we study the angular dependence of the transport properties on the infinite-layer nickelate Nd0.8Sr0.2NiO2 superconducting films with Corbino-disk configuration. The azimuthal angular dependence of the magnetoresistance (R({\phi})) manifests the rotational symmetry breaking from isotropy to four-fold (C4) anisotropy with increasing magnetic field, revealing a symmetry breaking phase transition. Approaching the low temperature and large magnetic field regime, an additional two-fold (C2) symmetric component in the R({\phi}) curves and an anomalous upturn of the temperature-dependent critical field are observed simultaneously, suggesting the emergence of an exotic electronic phase. Our work uncovers the evolution of the quantum states with different rotational symmetries and provides deep insight into the global phase diagram of the nickelate superconductors.

categories: cond-mat.supr-con cond-mat.mes-hall cond-mat.mtrl-sci cond-mat.str-el


title: Transport models for wave propagation in scattering media with nonlinear absorption

abstract: This work considers the propagation of high-frequency waves in highly-scattering media where physical absorption of a nonlinear nature occurs. Using the classical tools of the Wigner transform and multiscale analysis, we derive semilinear radiative transport models for the phase-space intensity and the diffusive limits of such transport models. As an application, we consider an inverse problem for the semilinear transport equation, where we reconstruct the absorption coefficients of the equation from a functional of its solution. We obtain a uniqueness result on the inverse problem.


title: Joint Optimization of Sensing and Computation for Status Update in Mobile Edge Computing Systems

abstract: IoT devices recently are utilized to detect the state transition in the surrounding environment and then transmit the status updates to the base station for future system operations. To satisfy the stringent timeliness requirement of the status updates for the accurate system control, age of information (AoI) is introduced to quantify the freshness of the sensory data. Due to the limited computing resources, the status update can be offloaded to the mobile edge computing (MEC) server for execution to ensure the information freshness. Since the status updates generated by insufficient sensing operations may be invalid and cause additional processing time, the data sensing and processing operations need to be considered simultaneously. In this work, we formulate the joint data sensing and processing optimization problem to ensure the freshness of the status updates and reduce the energy consumption of IoT devices. Then, the formulated NP-hard problem is decomposed into the sampling, sensing and computation offloading optimization problems. Afterwards, we propose a multi-variable iterative system cost minimization algorithm to optimize the system overhead. Simulation results show the efficiency of our method in decreasing the system cost and dominance of sensing and processing under different scenarios.


title: Investigation of the neutron imaging applications using fine-grained nuclear emulsion

abstract: Neutron imaging is a non-destructive inspection technique with a wide range of applications. One of the important aspects concerning neutron imaging is achieving micrometer-scale spatial resolution. Developing a neutron detector with a high resolution is a challenging task. Neutron detectors, based on fine-grained nuclear emulsion, may be suitable for high resolution neutron imaging applications. High track density is a necessary requirement to improve the quality of neutron imaging. However, the available track analysis methods are difficult to apply under high track density conditions. Simulated images were used to determine the required track density for neutron imaging. It was concluded that a track density of the order of $10^4$ tracks per 100 $\times$ 100 $\mu$m$^2$ is sufficient to utilize neutron detectors for imaging applications. The contrast resolution was also investigated for the image data sets with various track densities and neutron transmission rates. Moreover, experiments were performed for neutron imaging of the gadolinium-based gratings with known geometries. The structure of gratings was successfully resolved. The calculated 1$\sigma$ 10-90 \% edge response, using the gray scale optical images of the grating slit with a periodic structure of 9 $\mu$m, was 0.945 $\pm$ 0.004 $\mu$m.


title: Joint Pre-Training with Speech and Bilingual Text for Direct Speech to Speech Translation

abstract: Direct speech-to-speech translation (S2ST) is an attractive research topic with many advantages compared to cascaded S2ST. However, direct S2ST suffers from the data scarcity problem because the corpora from speech of the source language to speech of the target language are very rare. To address this issue, we propose in this paper a Speech2S model, which is jointly pre-trained with unpaired speech and bilingual text data for direct speech-to-speech translation tasks. By effectively leveraging the paired text data, Speech2S is capable of modeling the cross-lingual speech conversion from source to target language. We verify the performance of the proposed Speech2S on Europarl-ST and VoxPopuli datasets. Experimental results demonstrate that Speech2S gets an improvement of about 5 BLEU scores compared to encoder-only pre-training models, and achieves a competitive or even better performance than existing state-of-the-art models1.


title: Improved Learning-augmented Algorithms for k-means and k-medians Clustering

abstract: We consider the problem of clustering in the learning-augmented setting, where we are given a data set in $d$-dimensional Euclidean space, and a label for each data point given by an oracle indicating what subsets of points should be clustered together. This setting captures situations where we have access to some auxiliary information about the data set relevant for our clustering objective, for instance the labels output by a neural network. Following prior work, we assume that there are at most an $\alpha \in (0,c)$ for some $c<1$ fraction of false positives and false negatives in each predicted cluster, in the absence of which the labels would attain the optimal clustering cost $\mathrm{OPT}$. For a dataset of size $m$, we propose a deterministic $k$-means algorithm that produces centers with improved bound on clustering cost compared to the previous randomized algorithm while preserving the $O( d m \log m)$ runtime. Furthermore, our algorithm works even when the predictions are not very accurate, i.e. our bound holds for $\alpha$ up to $1/2$, an improvement over $\alpha$ being at most $1/7$ in the previous work. For the $k$-medians problem we improve upon prior work by achieving a biquadratic improvement in the dependence of the approximation factor on the accuracy parameter $\alpha$ to get a cost of $(1+O(\alpha))\mathrm{OPT}$, while requiring essentially just $O(md \log^3 m/\alpha)$ runtime.


title: Poison Attack and Defense on Deep Source Code Processing Models

abstract: In the software engineering community, deep learning (DL) has recently been applied to many source code processing tasks. Due to the poor interpretability of DL models, their security vulnerabilities require scrutiny. Recently, researchers have identified an emergent security threat, namely poison attack. The attackers aim to inject insidious backdoors into models by poisoning the training data with poison samples. Poisoned models work normally with clean inputs but produce targeted erroneous results with poisoned inputs embedded with triggers. By activating backdoors, attackers can manipulate the poisoned models in security-related scenarios. To verify the vulnerability of existing deep source code processing models to the poison attack, we present a poison attack framework for source code named CodePoisoner as a strong imaginary enemy. CodePoisoner can produce compilable even human-imperceptible poison samples and attack models by poisoning the training data with poison samples. To defend against the poison attack, we further propose an effective defense approach named CodeDetector to detect poison samples in the training data. CodeDetector can be applied to many model architectures and effectively defend against multiple poison attack approaches. We apply our CodePoisoner and CodeDetector to three tasks, including defect detection, clone detection, and code repair. The results show that (1) CodePoisoner achieves a high attack success rate (max: 100%) in misleading models to targeted erroneous behaviors. It validates that existing deep source code processing models have a strong vulnerability to the poison attack. (2) CodeDetector effectively defends against multiple poison attack approaches by detecting (max: 100%) poison samples in the training data. We hope this work can help practitioners notice the poison attack and inspire the design of more advanced defense techniques.


title: Uncertainty Aware Trader-Company Method: Interpretable Stock Price Prediction Capturing Uncertainty

abstract: Machine learning is an increasingly popular tool with some success in predicting stock prices. One promising method is the Trader-Company~(TC) method, which takes into account the dynamism of the stock market and has both high predictive power and interpretability. Machine learning-based stock prediction methods including the TC method have been concentrating on point prediction. However, point prediction in the absence of uncertainty estimates lacks credibility quantification and raises concerns about safety. The challenge in this paper is to make an investment strategy that combines high predictive power and the ability to quantify uncertainty. We propose a novel approach called Uncertainty Aware Trader-Company Method~(UTC) method. The core idea of this approach is to combine the strengths of both frameworks by merging the TC method with the probabilistic modeling, which provides probabilistic predictions and uncertainty estimations. We expect this to retain the predictive power and interpretability of the TC method while capturing the uncertainty. We theoretically prove that the proposed method estimates the posterior variance and does not introduce additional biases from the original TC method. We conduct a comprehensive evaluation of our approach based on the synthetic and real market datasets. We confirm with synthetic data that the UTC method can detect situations where the uncertainty increases and the prediction is difficult. We also confirmed that the UTC method can detect abrupt changes in data generating distributions. We demonstrate with real market data that the UTC method can achieve higher returns and lower risks than baselines.


title: Exceptional Non-Abelian Topology in Multiband Non-Hermitian Systems

abstract: Defective spectral degeneracy, known as exceptional point (EP), lies at the heart of various intriguing phenomena in optics, acoustics, and other nonconservative systems. Despite extensive studies in the past two decades, the \textit{collective} behaviors (e.g., annihilation, coalescence, braiding, etc.) involving multiple exceptional points or lines and their interplay have been rarely understood. Here we put forward a universal non-Abelian conservation rule governing these collective behaviors in generic multiband non-Hermitian systems and uncover several counterintuitive phenomena. We demonstrate that two EPs with opposite charges (even the pairwise created) do not necessarily annihilate, depending on how they approach each other. Furthermore, we unveil that the conservation rule imposes strict constraints on the permissible exceptional-line configurations. It excludes structures like Hopf link yet permits novel staggered rings composed of noncommutative exceptional lines. These intriguing phenomena are illustrated by concrete models which could be readily implemented in platforms like coupled acoustic cavities, optical waveguides, and ring resonators. Our findings lay the cornerstone for a comprehensive understanding of the exceptional non-Abelian topology and shed light on the versatile manipulations and applications based on exceptional degeneracies in nonconservative systems.

categories: cond-mat.mes-hall math-ph math.MP physics.optics quant-ph


title: Interrelated Thermalization and Quantum Criticality in a Lattice Gauge Simulator

abstract: Gauge theory and thermalization are both foundations of physics and nowadays are both topics of essential importance for modern quantum science and technology. Simulating lattice gauge theories (LGTs) realized recently with ultracold atoms provides a unique opportunity for carrying out a correlated study of gauge theory and thermalization in the same setting. Theoretical studies have shown that an Ising quantum phase transition exists in this implemented LGT, and quantum thermalization can also signal this phase transition. Nevertheless, it remains an experimental challenge to accurately determine the critical point and controllably explore the thermalization dynamics in the quantum critical regime due to the lack of techniques for locally manipulating and detecting matter and gauge fields. Here, we report an experimental investigation of the quantum criticality in the LGT from both equilibrium and non-equilibrium thermalization perspectives by equipping the single-site addressing and atom-number-resolved detection into our LGT simulator. We accurately determine the quantum critical point agreed with the predicted value. We prepare a $|Z_{2}\rangle$ state deterministically and study its thermalization dynamics across the critical point, leading to the observation that this $|Z_{2}\rangle$ state thermalizes only in the critical regime. This result manifests the interplay between quantum many-body scars, quantum criticality, and symmetry breaking.


title: A Wave Packet Approach to Resonant Scattering

abstract: Resonant transmission occurs when constructive interference results in the complete passage of an incoming wave through an array of barriers. In this paper we explore such a scenario with one dimensional models. We adopt wave packets with finite width to illustrate the deterioration of resonance with decreasing wave packet width, and suggest an approximate wave function for the transmitted and reflected components, derived from aspects of both the wave packet and plane wave approaches. A comparison with exact numerical calculations shows excellent agreement, and provides insight into the scattering process.