title: Offline Learning of Closed-Loop Deep Brain Stimulation Controllers for Parkinson Disease Treatment

abstract: Deep brain stimulation (DBS) has shown great promise toward treating motor symptoms caused by Parkinson's disease (PD), by delivering electrical pulses to the Basal Ganglia (BG) region of the brain. However, DBS devices approved by the U.S. Food and Drug Administration (FDA) can only deliver continuous DBS (cDBS) stimuli at a fixed amplitude; this energy inefficient operation reduces battery lifetime of the device, cannot adapt treatment dynamically for activity, and may cause significant side-effects (e.g., gait impairment). In this work, we introduce an offline reinforcement learning (RL) framework, allowing the use of past clinical data to train an RL policy to adjust the stimulation amplitude in real time, with the goal of reducing energy use while maintaining the same level of treatment (i.e., control) efficacy as cDBS. Moreover, clinical protocols require the safety and performance of such RL controllers to be demonstrated ahead of deployments in patients. Thus, we also introduce an offline policy evaluation (OPE) method to estimate the performance of RL policies using historical data, before deploying them on patients. We evaluated our framework on four PD patients equipped with the RC+S DBS system, employing the RL controllers during monthly clinical visits, with the overall control efficacy evaluated by severity of symptoms (i.e., bradykinesia and tremor), changes in PD biomakers (i.e., local field potentials), and patient ratings. The results from clinical experiments show that our RL-based controller maintains the same level of control efficacy as cDBS, but with significantly reduced stimulation energy. Further, the OPE method is shown effective in accurately estimating and ranking the expected returns of RL controllers.


title: Prediction of non-Abelian fractional quantum Hall effect at $\nu = 2 + \frac{4}{11}$

abstract: The fractional quantum Hall effect (FQHE) in the second Landau level (SLL) likely stabilizes non-Abelian topological orders. Recently, a parton sequence has been proposed to capture many of the fractions observed in the SLL [Ajit C. Balram, SciPost Phys. {\bf 10}, 083 (2021)]. We consider the first member of this sequence which has not yet been studied, which is a non-Abelian state that occurs at $4/11$. As yet FQHE in the SLL at this fraction has not been observed in experiments. Nevertheless, by studying its competition with other candidate FQHE states in the SLL we show that this parton state might be viable. We also make predictions for experimentally measurable properties of the parton state which can distinguish it from other topological orders.


title: Hatemongers ride on echo chambers to escalate hate speech diffusion

abstract: Recent years have witnessed a swelling rise of hateful and abusive content over online social networks. While detection and moderation of hate speech have been the early go-to countermeasures, the solution requires a deeper exploration of the dynamics of hate generation and propagation. We analyze more than 32 million posts from over 6.8 million users across three popular online social networks to investigate the interrelations between hateful behavior, information dissemination, and polarised organization mediated by echo chambers. We find that hatemongers play a more crucial role in governing the spread of information compared to singled-out hateful content. This observation holds for both the growth of information cascades as well as the conglomeration of hateful actors. Dissection of the core-wise distribution of these networks points towards the fact that hateful users acquire a more well-connected position in the social network and often flock together to build up information cascades. We observe that this cohesion is far from mere organized behavior; instead, in these networks, hatemongers dominate the echo chambers -- groups of users actively align themselves to specific ideological positions. The observed dominance of hateful users to inflate information cascades is primarily via user interactions amplified within these echo chambers. We conclude our study with a cautionary note that popularity-based recommendation of content is susceptible to be exploited by hatemongers given their potential to escalate content popularity via echo-chambered interactions.


title: Temporal sorting of optical multi-wave-mixing processes in semiconductor quantum dots

abstract: Coherent control of ensembles of light emitters by means of multi-wave mixing processes is key for the realization of high capacity optical quantum memories and information processing devices. In this context, semiconductor quantum dots placed in optical microcavities represent excellent candidates to explore strong light-matter interactions beyond the limits of perturbative non-linear optics and control the unitary evolution of optically driven quantum systems. In this work, we demonstrate that a sequence of two optical picosecond pulses can be used to establish coherent control over the phase evolution of the ensemble of trions in (In,Ga)As quantum dots independent of their initial quantum state. Our approach is based on coherent transfer between degenerate multi-wave-mixing signals in the strong field limit where Rabi rotations in multi-level systems take place. In particular, we use the two-pulse photon echo sequence to uncover the coherent dynamics of the trion ensemble, whereas the areas of two additional control pulses serve as tuning knobs for adjusting the magnitude and timing of the coherent emission. Furthermore, we make use of the spin degeneracy of ground and excited state of trions to control the polarization state of the emitted signal. Surprisingly, we reveal that the use of optical control pulses, whose durations are comparable to the dephasing time of the ensemble, lifts the temporal degeneracy between wave-mixing processes of different order. This phenomenon is manifested in a significant modification of the temporal shape of the coherent optical response for strong optical fields. Lifting the temporal degeneracy allows to smoothly trace the transition from the perturbative to the regime of Rabi rotations and opens up new possibilities for the optical investigation of complex energy level structures in so far unexplored material systems.


title: Distributed Computation Offloading of an application from mobile/IoT device to cloud

abstract: In Covid-19 pandemic, the number of users connecting to the Internet using mobile devices increased. People are doing there every task using mobile phones [16]. These devices are battery-powered and have limited computation capabilities. Their computational capabilities can be enhanced by computation offloading in which required computation is to be done on a third-party server on a cloud instead of the device itself. The cloud offers virtually infinite computation and storage. We proposed that by exploiting parallelism within an application call hierarchy we can decrease the execution time of off-loadable parts and minimize data resend in case of VM crash. We determine function call paths that are independent of each other within an application and schedule each of them on separate VMs in a distributed way. Wherever such independent paths merge, we collapse to a single VM and whenever the paths diverge again, we schedule multiple VMs. If any single VM fails another copy will be created. However, only the code and data associated with the crashed VM needs to be re-transmitted from the client device. In the case of face reorganization application and montage application we decrease execution time to 27.5% and 43.43% respectively. Whereas the data resend in case if any of both VMs crash will be the portion of the application that had been offloaded to respective VM at depending upon the level of parallelism they have which save mobile battery in case of Resend. We will also discuss the energy consumption effect of using multiple Vms for a job VS single Vm for the same job.


title: Continuously Indexed Graphical Models

abstract: Let $X = \{X_{u}\}_{u \in U}$ be a real-valued Gaussian process indexed by a set $U$. It can be thought of as an undirected graphical model with every random variable $X_{u}$ serving as a vertex. We characterize this graph in terms of the covariance of $X$ through its reproducing kernel property. Unlike other characterizations in the literature, our characterization does not restrict the index set $U$ to be finite or countable, and hence can be used to model the intrinsic dependence structure of stochastic processes in continuous time/space. Consequently, this characterization is not in terms of the zero entries of an inverse covariance. This poses novel challenges for the problem of recovery of the dependence structure from a sample of independent realizations of $X$, also known as structure estimation. We propose a methodology that circumvents these issues, by targeting the recovery of the underlying graph up to a finite resolution, which can be arbitrarily fine and is limited only by the available sample size. The recovery is shown to be consistent so long as the graph is sufficiently regular in an appropriate sense. We derive corresponding convergence rates and finite sample guarantees. Our methodology is illustrated by means of a simulation study and two data analyses.


title: Multi-Task Self-Supervised Learning for Image Segmentation Task

abstract: Thanks to breakthroughs in AI and Deep learning methodology, Computer vision techniques are rapidly improving. Most computer vision applications require sophisticated image segmentation to comprehend what is image and to make an analysis of each section easier. Training deep learning networks for semantic segmentation required a large amount of annotated data, which presents a major challenge in practice as it is expensive and labor-intensive to produce such data. The paper presents 1. Self-supervised techniques to boost semantic segmentation performance using multi-task learning with Depth prediction and Surface Normalization . 2. Performance evaluation of the different types of weighing techniques (UW, Nash-MTL) used for Multi-task learning. NY2D dataset was used for performance evaluation. According to our evaluation, the Nash-MTL method outperforms single task learning(Semantic Segmentation).


title: Enriched quasi-categories and the templicial homotopy coherent nerve

abstract: We lay the foundations for a theory of quasi-categories in a monoidal category $\mathcal{V}$ replacing $\mathrm{Set}$, aimed at realising weak enrichment in the category $S\mathcal{V}$ of simplicial objects in $\mathcal{V}$. To accomodate non-cartesian monoidal products, we make use of an ambient category $S_{\otimes}\mathcal{V}$ of templicial - or 'tensor-simplicial' - objects in $\mathcal{V}$, which are certain colax monoidal functors following Leinster. Inspired by the description of the categorification functor due to Dugger and Spivak, we construct a templicial analogue of the homotopy coherent nerve functor which goes from $S\mathcal{V}$-enriched categories to templicial objects. We show that an $S\mathcal{V}$-enriched category whose underlying simplicial category is locally Kan, is turned into a quasi-category in $\mathcal{V}$ by this nerve functor.


title: Facts of US Firm Scale and Growth 1970-2019: An Illustrated Guide

abstract: This work analyzes data on all public US firms in the 50 year period 1970-2019, and presents 18 stylized facts of their scale, income, growth, return, investment, and dynamism. Special attention is given to (i) identifying distributional forms; and (ii) scale effects -- systematic difference between firms based on their scale of operations. Notable findings are that the Difference-of-Log-Normals (DLN) distribution has a central role in describing firm data, scale-dependent heteroskedasticity is rampant, and small firms are systematically different from large firms.


title: The Difference-of-Log-Normals Distribution: Properties, Estimation, and Growth

abstract: This paper describes the Difference-of-Log-Normals (DLN) distribution. A companion paper makes the case that the DLN is a fundamental distribution in nature, and shows how a simple application of the CLT gives rise to the DLN in many disparate phenomena. Here, I characterize its PDF, CDF, moments, and parameter estimators; generalize it to N-dimensions using spherical distribution theory; describe methods to deal with its signature ``double-exponential'' nature; and use it to generalize growth measurement to possibly-negative variates distributing DLN. I also conduct Monte-Carlo experiments to establish some properties of the estimators and measures described.


title: Probing the Przybylski star for Deuterium

abstract: The Przybylski star spectrum has been studied in order to search for deuterium lines. Since this star is extremely enriched in the s-process elements, which are the product of interaction between free neutrons and seed nuclei, we might as well expect to detect deuterium in this star. However, no visible spectroscopic manifestation of deuterium has been detected. Perhaps, the reason of this result is the convective "destruction" of this isotope.


title: A three-state coupled Markov switching model for COVID-19 outbreaks across Quebec based on hospital admissions

abstract: Recurrent COVID-19 outbreaks have placed immense strain on the hospital system in Quebec. We develop a Bayesian three-state coupled Markov switching model to analyze COVID-19 outbreaks across Quebec based on admissions in the 30 largest hospitals. Within each catchment area, we assume the existence of three states for the disease: absence, a new state meant to account for many zeroes in some of the smaller areas, endemic and outbreak. Then we assume the disease switches between the three states in each area through a series of coupled nonhomogeneous hidden Markov chains. Unlike previous approaches, the transition probabilities may depend on covariates and the occurrence of outbreaks in neighboring areas, to account for geographical outbreak spread. Additionally, to prevent rapid switching between endemic and outbreak periods we introduce clone states into the model which enforce minimum endemic and outbreak durations. We make some interesting findings, such as that mobility in retail and recreation venues had a positive association with the development and persistence of new COVID-19 outbreaks in Quebec. Based on model comparison our contributions show promise in improving state estimation retrospectively and in real-time, especially when there are smaller areas and highly spatially synchronized outbreaks. Furthermore, our approach offers new and interesting epidemiological interpretations, such as being able to estimate the effect of covariates on disease extinction.


title: Bichromatic UV detection system for atomically-resolved imaging of ions

abstract: We present a compact and bichromatic imaging system, located outside of the vacuum chamber of a trapped ion apparatus, that collects the fluorescence of 230.6 nm and 369.5 nm photons simultaneously on a shared EMCCD camera. The system contains two lens doublets, consisting of a sphere and an asphere. It provides a numerical aperture of 0.45 and 0.40 at 230.6 nm and 369.5 nm, respectively, and enables spatially resolved state detection with a large field of view of 300 $\mu$m for long $^{115}$In$^+$/$^{172}$Yb$^+$ Coulomb crystals. Instead of diffraction limited imaging for one wavelength, the focus in this system is on simultaneous single-ion resolved imaging of both species over a large field with special attention to the deep UV wavelength (230.6 nm) and the low scattering rate of In$^+$ ions. The introduced concept is applicable to other dual-species applications.


title: A Secure Dual-Function Radar Communication System via Time-Modulated Arrays

abstract: Dual-function radar-communication (DFRC) systems offer high spectral, hardware and power efficiency, as such are prime candidates for 6G wireless systems. DFRC systems use the same waveform for simultaneously probing the surroundings and communicating with other equipment. By exposing the communication information to potential targets, DFRC systems are vulnerable to eavesdropping. In this work, we propose to mitigate the problem by leveraging directional modulation (DM) enabled by a time-modulated array (TMA) that transmits OFDM waveforms. DM can scramble the signal in all directions except the directions of the legitimate user. However, the signal reflected by the targets is also scrambled, thus complicating the extraction of target parameters. We propose a novel, low-complexity target estimation method that estimates the target parameters based on the scrambled received symbols. We also propose a novel method to refine the obtained target estimates at the cost of increased complexity. With the proposed refinement algorithm, the proposed DFRC system can securely communicate with users while having high-precision sensing functionality.


title: Time-loops to spot torsion on bidimensional Dirac materials with dislocations

abstract: Assuming that, with some care, dislocations could be meaningfully described by torsion, we propose here a scenario based on a previously unexplored role of time in the low-energy Dirac field theory description of two-space-dimensional Dirac materials. Our approach is based on the realization of an exotic time-loop that could be realized by oscillating particle-hole pairs, overcoming the well-known geometrical obstructions due to the lack of a third spatial dimension. General symmetry considerations allow concluding that the effects we are looking for can only be seen if we move to the nonlinear response regime.


title: A family of Spin(8) dual pairs: the case of real groups

abstract: Exceptional groups of type $E_6$ contain dual pairs where one member is $\mathrm{Spin}(8)$, and the other is $T\rtimes \mathbb Z/2\mathbb Z$, where $T$ is a two-dimensional torus and the non-trivial element in $\mathbb Z/2\mathbb Z$ acts on $T$ by the inverse involution. We describe the correspondence of representations arising by restricting the minimal representation.


title: An Online Model-Following Projection Mechanism Using Reinforcement Learning

abstract: In this paper, we propose a model-free adaptive learning solution for a model-following control problem. This approach employs policy iteration, to find an optimal adaptive control solution. It utilizes a moving finite-horizon of model-following error measurements. In addition, the control strategy is designed by using a projection mechanism that employs Lagrange dynamics. It allows for real-time tuning of derived actor-critic structures to find the optimal model-following strategy and sustain optimized adaptation performance. Finally, the efficacy of the proposed framework is emphasized through a comparison with sliding mode and high-order model-free adaptive control approaches. Keywords: Model Reference Adaptive Systems, Reinforcement Learning, adaptive critics, control system, stochastic, nonlinear system


title: Notes on the Golden Ratio: The Golden Rule of Vector Similarities in Space

abstract: In this work, we have abstractly generalized the similarity law for multidimensional vectors. Initially, the law of similarity was derived for one-dimensional vectors. Although it operated with such values of the ratio of parts of the whole, it meant linear dimensions (a line is one-dimensionality). The concept of the general golden ratio (GGR) for the vectors in the multidimensional space is described in detail with equations and solutions. It shown that the GGR depends on the angles. Main properties of the GGR are given with illustrative examples. We introduce and discuss the concept of the similar vectors and set of similarities for a given vector. Also, we present our vision on the theory of the golden ratio for triangles and describe with examples the similar triangles.


title: X-ray induced electron and ion fragmentation dynamics in IBr

abstract: Characterization of the inner-shell decay processes in molecules containing heavy elements is key to understanding x-ray damage of molecules and materials and for medical applications with Auger-electron-emitting radionuclides. The 1s hole states of heavy atoms can be produced by absorption of tunable x-rays and the resulting vacancy decays characterized by recording emitted photons, electrons, and ions. The 1s hole states in heavy elements have large x-ray fluorescence yields that transfer the hole to intermediate electron shells that then decay by sequential Auger-electron transitions that increase the ion's charge state until the final state is reached. In molecules the charge is spread across the atomic sites, resulting in dissociation to energetic atomic ions. We have used x-ray/ion coincidence spectroscopy to measure charge states and energies of I$^{q+}$ and Br$^{q'+}$ atomic ions following 1s ionization at the I and Br \textit{K}-edges of IBr. We present the charge states and kinetic energies of the two correlated fragment ions associated with core-excited states produced during the various steps of the cascades. To understand the dynamics leading to the ion data, we develop a computational model that combines Monte-Carlo/Molecular Dynamics simulations with a classical over-the-barrier model to track inner-shell cascades and redistribution of electrons in valence orbitals and nuclear motion of fragments.


title: Autoencoding Galaxy Spectra II: Redshift Invariance and Outlier Detection

abstract: We present an unsupervised outlier detection method for galaxy spectra based on the spectrum autoencoder architecture spender, which reliably captures spectral features and provides highly realistic reconstructions for SDSS galaxy spectra. We interpret the sample density in the autoencoder latent space as a probability distribution, and identify outliers as low-probability objects with a normalizing flow. However, we found that the latent-space position is not, as expected from the architecture, redshift invariant, which introduces stochasticity into the latent space and the outlier detection method. We solve this problem by adding two novel loss terms during training, which explicitly link latent-space distances to data-space distances, preserving locality in the autoencoding process. Minimizing the additional losses leads to a redshift-invariant, non-degenerate latent space distribution with clear separations between common and anomalous data. We inspect the spectra with the lowest probability and find them to include blends with foreground stars, extremely reddened galaxies, galaxy pairs and triples, and stars that are misclassified as galaxies. We release the newly trained spender model and the latent-space probability for the entire SDSS-I galaxy sample to aid further investigations.


title: High-dimensional Location Estimation via Norm Concentration for Subgamma Vectors

abstract: In location estimation, we are given $n$ samples from a known distribution $f$ shifted by an unknown translation $\lambda$, and want to estimate $\lambda$ as precisely as possible. Asymptotically, the maximum likelihood estimate achieves the Cram\'er-Rao bound of error $\mathcal N(0, \frac{1}{n\mathcal I})$, where $\mathcal I$ is the Fisher information of $f$. However, the $n$ required for convergence depends on $f$, and may be arbitrarily large. We build on the theory using \emph{smoothed} estimators to bound the error for finite $n$ in terms of $\mathcal I_r$, the Fisher information of the $r$-smoothed distribution. As $n \to \infty$, $r \to 0$ at an explicit rate and this converges to the Cram\'er-Rao bound. We (1) improve the prior work for 1-dimensional $f$ to converge for constant failure probability in addition to high probability, and (2) extend the theory to high-dimensional distributions. In the process, we prove a new bound on the norm of a high-dimensional random variable whose 1-dimensional projections are subgamma, which may be of independent interest.

categories: math.ST cs.IT cs.LG math.IT math.PR stat.ML stat.TH


title: Multiuser Offloading with Cloud Server Data

abstract: Computation offloading becomes useful for users of limited computing power and mobile edge computing (MEC) can help mobile users perform their tasks more effectively. In this paper, we consider MEC when users perform tasks with local data as well as data at cloud storage servers, since users can often keep their data at cloud storage servers or have tasks that need to use public datasets. An optimization problem to minimize the total consumed energy of users as well as a base station (BS) is formulated with a total transmission time constraint, which is solved by converting into multiple binary integer linear programming problems.


title: Handwriting and Drawing for Depression Detection: A Preliminary Study

abstract: The events of the past 2 years related to the pandemic have shown that it is increasingly important to find new tools to help mental health experts in diagnosing mood disorders. Leaving aside the longcovid cognitive (e.g., difficulty in concentration) and bodily (e.g., loss of smell) effects, the short-term covid effects on mental health were a significant increase in anxiety and depressive symptoms. The aim of this study is to use a new tool, the online handwriting and drawing analysis, to discriminate between healthy individuals and depressed patients. To this aim, patients with clinical depression (n = 14), individuals with high sub-clinical (diagnosed by a test rather than a doctor) depressive traits (n = 15) and healthy individuals (n = 20) were recruited and asked to perform four online drawing /handwriting tasks using a digitizing tablet and a special writing device. From the raw collected online data, seventeen drawing/writing features (categorized into five categories) were extracted, and compared among the three groups of the involved participants, through ANOVA repeated measures analyses. Results shows that Time features are more effective in discriminating between healthy and participants with sub-clinical depressive characteristics. On the other hand, Ductus and Pressure features are more effective in discriminating between clinical depressed and healthy participants.


title: TempEL: Linking Dynamically Evolving and Newly Emerging Entities

abstract: In our continuously evolving world, entities change over time and new, previously non-existing or unknown, entities appear. We study how this evolutionary scenario impacts the performance on a well established entity linking (EL) task. For that study, we introduce TempEL, an entity linking dataset that consists of time-stratified English Wikipedia snapshots from 2013 to 2022, from which we collect both anchor mentions of entities, and these target entities' descriptions. By capturing such temporal aspects, our newly introduced TempEL resource contrasts with currently existing entity linking datasets, which are composed of fixed mentions linked to a single static version of a target Knowledge Base (e.g., Wikipedia 2010 for CoNLL-AIDA). Indeed, for each of our collected temporal snapshots, TempEL contains links to entities that are continual, i.e., occur in all of the years, as well as completely new entities that appear for the first time at some point. Thus, we enable to quantify the performance of current state-of-the-art EL models for: (i) entities that are subject to changes over time in their Knowledge Base descriptions as well as their mentions' contexts, and (ii) newly created entities that were previously non-existing (e.g., at the time the EL model was trained). Our experimental results show that in terms of temporal performance degradation, (i) continual entities suffer a decrease of up to 3.1% EL accuracy, while (ii) for new entities this accuracy drop is up to 17.9%. This highlights the challenge of the introduced TempEL dataset and opens new research prospects in the area of time-evolving entity disambiguation.


title: Timed Partial Order Inference Algorithm

abstract: In this work, we propose the model of timed partial orders (TPOs) for specifying workflow schedules, especially for modeling manufacturing processes. TPOs integrate partial orders over events in a workflow, specifying ``happens-before'' relations, with timing constraints specified using guards and resets on clocks -- an idea borrowed from timed-automata specifications. TPOs naturally allow us to capture event ordering, along with a restricted but useful class of timing relationships. Next, we consider the problem of mining TPO schedules from workflow logs, which include events along with their time stamps. We demonstrate a relationship between formulating TPOs and the graph-coloring problem, and present an algorithm for learning TPOs with correctness guarantees. We demonstrate our approach on synthetic datasets, including two datasets inspired by real-life applications of aircraft turnaround and gameplay videos of the Overcooked computer game. Our TPO mining algorithm can infer TPOs involving hundreds of events from thousands of data-points within a few seconds. We show that the resulting TPOs provide useful insights into the dependencies and timing constraints for workflows.


title: Rethinking Robust Contrastive Learning from the Adversarial Perspective

abstract: To advance the understanding of robust deep learning, we delve into the effects of adversarial training on self-supervised and supervised contrastive learning alongside supervised learning. Our analysis uncovers significant disparities between adversarial and clean representations in standard-trained networks across various learning algorithms. Remarkably, adversarial training mitigates these disparities and fosters the convergence of representations toward a universal set, regardless of the learning scheme used. Additionally, increasing the similarity between adversarial and clean representations, particularly near the end of the network, enhances network robustness. These findings offer valuable insights for designing and training effective and robust deep learning networks. Our code is released at \textcolor{magenta}{\url{https://github.com/softsys4ai/CL-Robustness}}.


title: Leaving Reality to Imagination: Robust Classification via Generated Datasets

abstract: Recent research on robustness has revealed significant performance gaps between neural image classifiers trained on datasets that are similar to the test set, and those that are from a naturally shifted distribution, such as sketches, paintings, and animations of the object categories observed during training. Prior work focuses on reducing this gap by designing engineered augmentations of training data or through unsupervised pretraining of a single large model on massive in-the-wild training datasets scraped from the Internet. However, the notion of a dataset is also undergoing a paradigm shift in recent years. With drastic improvements in the quality, ease-of-use, and access to modern generative models, generated data is pervading the web. In this light, we study the question: How do these generated datasets influence the natural robustness of image classifiers? We find that Imagenet classifiers trained on real data augmented with generated data achieve higher accuracy and effective robustness than standard training and popular augmentation strategies in the presence of natural distribution shifts. We analyze various factors influencing these results, including the choice of conditioning strategies and the amount of generated data. Additionally, we find that the standard ImageNet classifiers suffer a performance degradation of upto 20\% on the generated data, indicating their fragility at accurately classifying the objects under novel variations. Lastly, we demonstrate that the image classifiers, which have been trained on real data augmented with generated data from the base generative model, exhibit greater resilience to natural distribution shifts compared to the classifiers trained on real data augmented with generated data from the finetuned generative model on the real data. The code, models, and datasets are available at https://github.com/Hritikbansal/generative-robustness.


title: Reconstruction-driven motion estimation for motion-compensated MR CINE imaging

abstract: In cardiac CINE, motion-compensated MR reconstruction (MCMR) is an effective approach to address highly undersampled acquisitions by incorporating motion information between frames. In this work, we propose a deep learning-based framework to address the MCMR problem efficiently. Contrary to state-of-the-art (SOTA) MCMR methods which break the original problem into two sub-optimization problems, i.e. motion estimation and reconstruction, we formulate this problem as a single entity with one single optimization. We discard the canonical motion-warping loss (similarity measurement between motion-warped images and target images) to estimate the motion, but drive the motion estimation process directly by the final reconstruction performance. The higher reconstruction quality is achieved without using any smoothness loss terms and without iterative processing between motion estimation and reconstruction. Therefore, we avoid non-trivial loss weighting factors tuning and time-consuming iterative processing. Experiments on 43 in-house acquired 2D CINE datasets indicate that the proposed MCMR framework can deliver artifact-free motion estimation and high-quality MR images even for imaging accelerations up to 20x. The proposed framework is compared to SOTA non-MCMR and MCMR methods and outperforms these methods qualitatively and quantitatively in all applied metrics across all experiments with different acceleration rates.


title: A bijection between strongly stable and totally symmetric partitions

abstract: Artinian monomial ideals in $d$ variables correspond to $d$-dimensional partitions. We define $d$-dimensional strongly stable partitions and show that they correspond to strongly stable ideals in $d$ variables. We show a bijection between strongly stable partitions and totally symmetric partitions which preserves the side length of the minimal bounding box.


title: Generating Dispatching Rules for the Interrupting Swap-Allowed Blocking Job Shop Problem Using Graph Neural Network and Reinforcement Learning

abstract: The interrupting swap-allowed blocking job shop problem (ISBJSSP) is a complex scheduling problem that is able to model many manufacturing planning and logistics applications realistically by addressing both the lack of storage capacity and unforeseen production interruptions. Subjected to random disruptions due to machine malfunction or maintenance, industry production settings often choose to adopt dispatching rules to enable adaptive, real-time re-scheduling, rather than traditional methods that require costly re-computation on the new configuration every time the problem condition changes dynamically. To generate dispatching rules for the ISBJSSP problem, we introduce a dynamic disjunctive graph formulation characterized by nodes and edges subjected to continuous deletions and additions. This formulation enables the training of an adaptive scheduler utilizing graph neural networks and reinforcement learning. Furthermore, a simulator is developed to simulate interruption, swapping, and blocking in the ISBJSSP setting. Employing a set of reported benchmark instances, we conduct a detailed experimental study on ISBJSSP instances with a range of machine shutdown probabilities to show that the scheduling policies generated can outperform or are at least as competitive as existing dispatching rules with predetermined priority. This study shows that the ISBJSSP, which requires real-time adaptive solutions, can be scheduled efficiently with the proposed method when production interruptions occur with random machine shutdowns.


title: Secret sharing scheme based on hashing

abstract: We propose an adaptive threshold multi secret sharing scheme based solely on cryptographically secure hash functions. We show that the proposed scheme is also: perfect, ideal, verifiable, and proactive. Moreover the proposed scheme has a low computational complexity comparing to the most common schemes operating over finite fields.


title: Jointly Optimal Routing and Caching with Bounded Link Capacities

abstract: We study a cache network in which intermediate nodes equipped with caches can serve requests. We model the problem of jointly optimizing caching and routing decisions with link capacity constraints over an arbitrary network topology. This problem can be formulated as a continuous diminishing-returns (DR) submodular maximization problem under multiple continuous DR-supermodular constraints, and is NP-hard. We propose a poly-time alternating primal-dual heuristic algorithm, in which primal steps produce solutions within $1-\frac{1}{e}$ approximation factor from the optimal. Through extensive experiments, we demonstrate that our proposed algorithm significantly outperforms competitors.


title: Approximate reconstructability of quantum states and noisy quantum secret sharing schemes

abstract: We introduce and analyse approximate quantum secret sharing in a formal cryptographic setting, wherein a dealer encodes and distributes a quantum secret to players such that authorized structures (sets of subsets of players) can approximately reconstruct the quantum secret and omnipotent adversarial agents controlling non-authorized subsets of players are approximately denied the quantum secret. In particular, viewing the map encoding the quantum secret to shares for players in an authorized structure as a quantum channel, we show that approximate reconstructability of the quantum secret by these players is possible if and only if the information leakage, given in terms of a certain entanglement-assisted capacity of the complementary quantum channel to the players outside the structure and the environment, is small.


title: Characteristic Topological Invariants

abstract: The higher characteristics w_m(G) for a finite abstract simplicial complex G are topological invariants that satisfy k-point Green function identities and can be computed in terms of Euler characteristic in the case of closed manifolds, where we give a new proof of w_m(G)=w_1(G). Also the sphere formula generalizes: for any simplicial complex, the total higher characteristics of unit spheres at even dimensional simplices is equal to the total higher characteristic of unit spheres at odd dimensional simplices.


title: An explicit formula for high-order sideband polarization by extreme tailoring of Feynman path integrals

abstract: High-order sideband generation (HSG), as an analogue of the interband processes in high-harmonic generation (HHG) in solids, is a nonperturbative nonlinear optical phenomenon in semiconductors that are simultaneously driven by a relatively weak near-infrared (NIR) laser and a sufficiently strong terahertz (THz) field. We derive an explicit formula for sideband polarization vectors in a prototypical two-band model based on the saddle-point method. Our formula connects the sideband amplitudes with the laser-field parameters, electronic structures, and nonequilibrium dephasing rates in a highly nontrivial manner. Our results indicate the possibility of extracting information on band structures and dephasing rates from high-order sideband generation experiments with simple algebraic calculations. We also expect our approach to be useful on the quantitative understanding of the interband HHG.


title: Mean Curvature Flows of Two-Convex Lagrangians

abstract: We prove regularity, global existence, and convergence of Lagrangian mean curvature flows in the two-convex case. Such results were previously only known in the convex case, of which the current work represents a significant improvement. The proof relies on a newly discovered monotone quantity that controls two-convexity. Through a unitary transformation, same result for the mean curvature flow of area-decreasing Lagrangian submanifolds were established.


title: Connectivity Enhanced Safe Neural Network Planner for Lane Changing in Mixed Traffic

abstract: Connectivity technology has shown great potentials in improving the safety and efficiency of transportation systems by providing information beyond the perception and prediction capabilities of individual vehicles. However, it is expected that human-driven and autonomous vehicles, and connected and non-connected vehicles need to share the transportation network during the transition period to fully connected and automated transportation systems. Such mixed traffic scenarios significantly increase the complexity in analyzing system behavior and quantifying uncertainty for highly interactive scenarios, e.g., lane changing. It is even harder to ensure system safety when neural network based planners are leveraged to further improve efficiency. In this work, we propose a connectivity-enhanced neural network based lane changing planner. By cooperating with surrounding connected vehicles in dynamic environment, our proposed planner will adapt its planned trajectory according to the analysis of a safe evasion trajectory. We demonstrate the strength of our planner design in improving efficiency and ensuring safety in various mixed traffic scenarios with extensive simulations. We also analyze the system robustness when the communication or coordination is not perfect.


title: Curves with few bad primes over cyclotomic $\mathbb{Z}_\ell$-extensions

abstract: Let $K$ be a number field, and $S$ a finite set of non-archimedean places of $K$, and write $\mathcal{O}_S^\times$ for the group of $S$-units of $K$. A famous theorem of Siegel asserts that the $S$-unit equation $\varepsilon+\delta=1$, with $\varepsilon$, $\delta \in \mathcal{O}_S^\times$, has only finitely many solutions. A famous theorem of Shafarevich asserts that there are only finitely many isomorphism classes of elliptic curves over $K$ with good reduction outside $S$. Now instead of a number field, let $K=\mathbb{Q}_{\infty,\ell}$ which denotes the $\mathbb{Z}_\ell$-cyclotomic extension of $\mathbb{Q}$. We show that the $S$-unit equation $\varepsilon+\delta=1$, with $\varepsilon$, $\delta \in \mathcal{O}_S^\times$, has infinitely many solutions for $\ell \in \{2,3,5,7\}$, where $S$ consists only of the totally ramified prime above $\ell$. Moreover, for every prime $\ell$, we construct infinitely many elliptic or hyperelliptic curves defined over $K$ with good reduction away from $2$ and $\ell$. For certain primes $\ell$ we show that the Jacobians of these curves in fact belong to infinitely many distinct isogeny classes.


title: Deep Learning for Time Series Classification and Extrinsic Regression: A Current Survey

abstract: Time Series Classification and Extrinsic Regression are important and challenging machine learning tasks. Deep learning has revolutionized natural language processing and computer vision and holds great promise in other fields such as time series analysis where the relevant features must often be abstracted from the raw data but are not known a priori. This paper surveys the current state of the art in the fast-moving field of deep learning for time series classification and extrinsic regression. We review different network architectures and training methods used for these tasks and discuss the challenges and opportunities when applying deep learning to time series data. We also summarize two critical applications of time series classification and extrinsic regression, human activity recognition and satellite earth observation.


title: Improved bounds for cross-Sperner systems

abstract: A collection of families $(\mathcal{F}_{1}, \mathcal{F}_{2} , \cdots , \mathcal{F}_{k}) \in \mathcal{P}([n])^k$ is cross-Sperner if there is no pair $i \not= j$ for which some $F_i \in \mathcal{F}_i$ is comparable to some $F_j \in \mathcal{F}_j$. Two natural measures of the `size' of such a family are the sum $\sum_{i = 1}^k |\mathcal{F}_i|$ and the product $\prod_{i = 1}^k |\mathcal{F}_i|$. We prove new upper and lower bounds on both of these measures for general $n$ and $k \ge 2$ which improve considerably on the previous best bounds. In particular, we construct a rich family of counterexamples to a conjecture of Gerbner, Lemons, Palmer, Patk\'{o}s, and Sz\'{e}csi from 2011.


title: Syzygies of adjoint linear series on projective varieties

abstract: Let X be a smooth complex projective variety of dimension n and let A be an ample and basepoint free divisor. We prove $K_X+mA$ satisfies property $N_p$ for $m\geqslant n+1+p$. We also show the graded ring of sections $R(X, K_X+mA)$ is Koszul for $m\geqslant n+2$.


title: Searching for doubly charmed tetraquark candidates $T_{cc}$ and $T_{cc\bar{s}}$ in $B_c$ decays

abstract: In this work, we propose to search for the exotic doubly charmed meson $T_{cc}^+$ and its analog $T_{cc\bar{s}}^+$ in $B_c^+$ decays, which provide a good environment for the formation of the exotic state containing double charm quarks. Within the molecular scheme, the production of $T_{cc}^+$ and $T_{cc\bar{s}}^+$ through various rescattering processes with different intermediate states are investigated. For the moderate values of model parameters, the branching ratios of $B_c^+$ decaying into $T_{cc}^+ \bar{D}^{0}$, $T_{cc}^+ \bar{D}^{*0}$, $T_{cc\bar{s}}^+ \bar{D}^{0}$ and $T_{cc\bar{s}}^+ \bar{D}^{*0}$ are estimated to be of the order of $10^{-7}$, $10^{-5}$, $10^{-6}$ and $10^{-4}$, respectively, which may be tested by future experiments.


title: RDFNet: Regional Dynamic FISTA-Net for Spectral Snapshot Compressive Imaging

abstract: Deep convolutional neural networks have recently shown promising results in compressive spectral reconstruction. Previous methods, however, usually adopt a single mapping function for sparse representation. Considering that different regions have distinct characteristics, it is desirable to apply various mapping functions to adjust different regions' transformations dynamically. With this in mind, we first introduce a regional dynamic way of using Fast Iterative Shrinkage-Thresholding Algorithm (FISTA) to exploit regional characteristics and derive dynamic sparse representations. Then, we propose to unfold the process into a hierarchical dynamic deep network, dubbed RDFNet. The network comprises multiple regional dynamic blocks and corresponding pixel-wise adaptive soft-thresholding modules, respectively in charge of region-based dynamic mapping and pixel-wise soft-thresholding selection. The regional dynamic block guides the network to adjust the transformation domain for different regions. Equipped with the adaptive soft-thresholding, our proposed regional dynamic architecture can also learn appropriate shrinkage scale in a pixel-wise manner. Extensive experiments on both simulated and real data demonstrate that our method outperforms prior state-of-the-arts.


title: PGCN: Pyramidal Graph Convolutional Network for EEG Emotion Recognition

abstract: Emotion recognition is essential in the diagnosis and rehabilitation of various mental diseases. In the last decade, electroencephalogram (EEG)-based emotion recognition has been intensively investigated due to its prominative accuracy and reliability, and graph convolutional network (GCN) has become a mainstream model to decode emotions from EEG signals. However, the electrode relationship, especially long-range electrode dependencies across the scalp, may be underutilized by GCNs, although such relationships have been proven to be important in emotion recognition. The small receptive field makes shallow GCNs only aggregate local nodes. On the other hand, stacking too many layers leads to over-smoothing. To solve these problems, we propose the pyramidal graph convolutional network (PGCN), which aggregates features at three levels: local, mesoscopic, and global. First, we construct a vanilla GCN based on the 3D topological relationships of electrodes, which is used to integrate two-order local features; Second, we construct several mesoscopic brain regions based on priori knowledge and employ mesoscopic attention to sequentially calculate the virtual mesoscopic centers to focus on the functional connections of mesoscopic brain regions; Finally, we fuse the node features and their 3D positions to construct a numerical relationship adjacency matrix to integrate structural and functional connections from the global perspective. Experimental results on three public datasets indicate that PGCN enhances the relationship modelling across the scalp and achieves state-of-the-art performance in both subject-dependent and subject-independent scenarios. Meanwhile, PGCN makes an effective trade-off between enhancing network depth and receptive fields while suppressing the ensuing over-smoothing. Our codes are publicly accessible at https://github.com/Jinminbox/PGCN.


title: Exploiting Partial Common Information Microstructure for Multi-Modal Brain Tumor Segmentation

abstract: Learning with multiple modalities is crucial for automated brain tumor segmentation from magnetic resonance imaging data. Explicitly optimizing the common information shared among all modalities (e.g., by maximizing the total correlation) has been shown to achieve better feature representations and thus enhance the segmentation performance. However, existing approaches are oblivious to partial common information shared by subsets of the modalities. In this paper, we show that identifying such partial common information can significantly boost the discriminative power of image segmentation models. In particular, we introduce a novel concept of partial common information mask (PCI-mask) to provide a fine-grained characterization of what partial common information is shared by which subsets of the modalities. By solving a masked correlation maximization and simultaneously learning an optimal PCI-mask, we identify the latent microstructure of partial common information and leverage it in a self-attention module to selectively weight different feature representations in multi-modal data. We implement our proposed framework on the standard U-Net. Our experimental results on the Multi-modal Brain Tumor Segmentation Challenge (BraTS) datasets outperform those of state-of-the-art segmentation baselines, with validation Dice similarity coefficients of 0.920, 0.897, 0.837 for the whole tumor, tumor core, and enhancing tumor on BraTS-2020.


title: Prior Density Learning in Variational Bayesian Phylogenetic Parameters Inference

abstract: The advances in variational inference are providing promising paths in Bayesian estimation problems. These advances make variational phylogenetic inference an alternative approach to Markov Chain Monte Carlo methods for approximating the phylogenetic posterior. However, one of the main drawbacks of such approaches is modelling the prior through fixed distributions, which could bias the posterior approximation if they are distant from the current data distribution. In this paper, we propose an approach and an implementation framework to relax the rigidity of the prior densities by learning their parameters using a gradient-based method and a neural network-based parameterization. We applied this approach for branch lengths and evolutionary parameters estimation under several Markov chain substitution models. The results of performed simulations show that the approach is powerful in estimating branch lengths and evolutionary model parameters. They also show that a flexible prior model could provide better results than a predefined prior model. Finally, the results highlight that using neural networks improves the initialization of the optimization of the prior density parameters.


title: Principle of learning sign rules by neural networks in qubit lattice models

abstract: A neural network is a powerful tool that can uncover hidden laws beyond human intuition. However, it often appears as a black box due to its complicated nonlinear structures. By drawing upon the Gutzwiller mean-field theory, we can showcase a principle of sign rules for ordered states in qubit lattice models. We introduce a shallow feed-forward neural network with a single hidden neuron to present these sign rules. We conduct systematical benchmarks in various models, including the generalized Ising, spin-$1/2$ XY, (frustrated) Heisenberg rings, triangular XY antiferromagnet on a torus, and the Fermi-Hubbard ring at an arbitrary filling. These benchmarks show that all the leading-order sign rule characteristics can be visualized in classical forms, such as pitch angles. Besides, quantum fluctuations can result in an imperfect accuracy rate quantitatively.


title: Novel Fundus Image Preprocessing for Retcam Images to Improve Deep Learning Classification of Retinopathy of Prematurity

abstract: Retinopathy of Prematurity (ROP) is a potentially blinding eye disorder because of damage to the eye's retina which can affect babies born prematurely. Screening of ROP is essential for early detection and treatment. This is a laborious and manual process which requires trained physician performing dilated ophthalmological examination which can be subjective resulting in lower diagnosis success for clinically significant disease. Automated diagnostic methods can assist ophthalmologists increase diagnosis accuracy using deep learning. Several research groups have highlighted various approaches. Captured ROP Retcam images suffer from poor quality. This paper proposes the use of improved novel fundus preprocessing methods using pretrained transfer learning frameworks to create hybrid models to give higher diagnosis accuracy. Once trained and validated, the evaluations showed that these novel methods in comparison to traditional imaging processing contribute to better and in many aspects higher accuracy in classifying Plus disease, Stages of ROP and Zones in comparison to peer papers.


title: Privacy concerns from variances in spatial navigability in VR

abstract: Current Virtual Reality (VR) input devices make it possible to navigate a virtual environment and record immersive, personalized data regarding the user's movement and specific behavioral habits, which brings the question of the user's privacy concern to the forefront. In this article, the authors propose to investigate Machine Learning driven learning algorithms that try to learn with human users co-operatively and can be used to countermand existing privacy concerns in VR but could also be extended to Augmented Reality (AR) platforms.


title: On Private and Robust Bandits

abstract: We study private and robust multi-armed bandits (MABs), where the agent receives Huber's contaminated heavy-tailed rewards and meanwhile needs to ensure differential privacy. We first present its minimax lower bound, characterizing the information-theoretic limit of regret with respect to privacy budget, contamination level and heavy-tailedness. Then, we propose a meta-algorithm that builds on a private and robust mean estimation sub-routine \texttt{PRM} that essentially relies on reward truncation and the Laplace mechanism only. For two different heavy-tailed settings, we give specific schemes of \texttt{PRM}, which enable us to achieve nearly-optimal regret. As by-products of our main results, we also give the first minimax lower bound for private heavy-tailed MABs (i.e., without contamination). Moreover, our two proposed truncation-based \texttt{PRM} achieve the optimal trade-off between estimation accuracy, privacy and robustness. Finally, we support our theoretical results with experimental studies.


title: On bipartite circle graphs and Khovanov homology

abstract: We prove that independence complex of a bipartite circle graph is homotopy equivalent to a wedge of spheres, resolving a conjecture posed by Przytycki and Silvero. As a corollary, we obtain that extreme Khovanov spectrum, $\mathcal{X}_{j_{extreme}}$ is homotopy equivalent to a wedge of spheres. In particular, the extreme Khovanov homology has no torsion.


title: Personalized Interpretable Classification

abstract: How to interpret a data mining model has received much attention recently, because people may distrust a black-box predictive model if they do not understand how the model works. Hence, it will be trustworthy if a model can provide transparent illustrations on how to make the decision. Although many rule-based interpretable classification algorithms have been proposed, all these existing solutions cannot directly construct an interpretable model to provide personalized prediction for each individual test sample. In this paper, we make a first step towards formally introducing personalized interpretable classification as a new data mining problem to the literature. In addition to the problem formulation on this new issue, we present a greedy algorithm called PIC (Personalized Interpretable Classifier) to identify a personalized rule for each individual test sample. To demonstrate the necessity, feasibility and advantages of such a personalized interpretable classification method, we conduct a series of empirical studies on real data sets. The experimental results show that: (1) The new problem formulation enables us to find interesting rules for test samples that may be missed by existing non-personalized classifiers. (2) Our algorithm can achieve the same-level predictive accuracy as those state-of-the-art (SOTA) interpretable classifiers. (3) On a real data set for predicting breast cancer metastasis, such a personalized interpretable classifier can outperform SOTA methods in terms of both accuracy and interpretability.


title: Learning Control-Oriented Dynamical Structure from Data

abstract: Even for known nonlinear dynamical systems, feedback controller synthesis is a difficult problem that often requires leveraging the particular structure of the dynamics to induce a stable closed-loop system. For general nonlinear models, including those fit to data, there may not be enough known structure to reliably synthesize a stabilizing feedback controller. In this paper, we discuss a state-dependent nonlinear tracking controller formulation based on a state-dependent Riccati equation for general nonlinear control-affine systems. This formulation depends on a nonlinear factorization of the system of vector fields defining the control-affine dynamics, which always exists under mild smoothness assumptions. We propose a method for learning this factorization from a finite set of data. On a variety of simulated nonlinear dynamical systems, we empirically demonstrate the efficacy of learned versions of this controller in stable trajectory tracking. Alongside our learning method, we evaluate recent ideas in jointly learning a controller and stabilizability certificate for known dynamical systems; we show experimentally that such methods can be frail in comparison.


title: A Stability Analysis for the Reaction Torque Observer-based Sensorless Force Control Systems

abstract: This paper proposes a new stability analysis for the Reaction Torque Observer (RTOb) based robust force control systems in the discrete-time domain. The robust force controller is implemented by employing a Disturbance Observer (DOb) to suppress disturbances, such as friction and hysteresis, in an inner-loop and another disturbance observer, viz RTOb, to estimate contact forces without using a force sensor. Since the RTOb-based robust force controllers are always implemented using computers and/or microcontrollers, this paper proposes a stability analysis in the discrete-time domain. It is shown that the bandwidth of the DOb is limited not only by the noise of velocity measurement but also by the waterbed effect. It is also shown that the stability of the robust force controller may significantly deteriorate when the design parameters of the RTOb are not properly tuned. For example, the robust force controller may have a non-minimum phase zero(s) as the design parameter of the identified inertia (torque coefficient) of the RTOb is increased (decreased). This may lead to poor stability and performance in force control applications. The proposed stability analysis conducted in the discrete-time domain is verified by simulations and experiments.


title: Cross-Fusion Rule for Personalized Federated Learning

abstract: Data scarcity and heterogeneity pose significant performance challenges for personalized federated learning, and these challenges are mainly reflected in overfitting and low precision in existing methods. To overcome these challenges, a multi-layer multi-fusion strategy framework is proposed in this paper, i.e., the server adopts the network layer parameters of each client upload model as the basic unit of fusion for information-sharing calculation. Then, a new fusion strategy combining personalized and generic is purposefully proposed, and the network layer number fusion threshold of each fusion strategy is designed according to the network layer function. Under this mechanism, the L2-Norm negative exponential similarity metric is employed to calculate the fusion weights of the corresponding feature extraction layer parameters for each client, thus improving the efficiency of heterogeneous data personalized collaboration. Meanwhile, the federated global optimal model approximation fusion strategy is adopted in the network full-connect layer, and this generic fusion strategy alleviates the overfitting introduced by forceful personalized. Finally, the experimental results show that the proposed method is superior to the state-of-the-art methods.


title: Tight complexes are Golod

abstract: The Golodness of a simplicial complex is defined algebraically in terms of the Stanley-Reisner ring, and it has been a long-standing problem to find its combinatorial characterization. The tightness of a simplicial complex is a combinatorial analogue of a tight embedding of a manifold into the Euclidean space, and has been studied in connection to minimal manifold triangulations. In this paper, we prove that tight complexes are Golod, and as a corollary, we obtain that for triangulations of closed connected orientable manifolds, the Golodness and the tightness are equivalent.


title: Linking Datasets on Organizations Using Half A Billion Open Collaborated Records

abstract: Scholars studying organizations often work with multiple datasets lacking shared unique identifiers or covariates. In such situations, researchers may turn to approximate string matching methods to combine datasets. String matching, although useful, faces fundamental challenges. Even when two strings appear similar to humans, fuzzy matching often does not work because it fails to adapt to the informativeness of the character combinations presented. Worse, many entities have multiple names that are dissimilar (e.g., "Fannie Mae" and "Federal National Mortgage Association"), a case where string matching has little hope of succeeding. This paper introduces data from a prominent employment-related networking site (LinkedIn) as a tool to address these problems. We propose interconnected approaches to leveraging the massive amount of information from LinkedIn regarding organizational name-to-name links. The first approach builds a machine learning model for predicting matches from character strings, treating the trillions of user-contributed organizational name pairs as a training corpus: this approach constructs a string matching metric that explicitly maximizes match probabilities. A second approach identifies relationships between organization names using network representations of the LinkedIn data. A third approach combines the first and second. We document substantial improvements over fuzzy matching in applications, making all methods accessible in open-source software ("LinkOrgs").


title: Variable Stiffness Improves Safety and Performance in Soft Robotics

abstract: This paper proposes a new variable stiffness soft gripper that enables high-performance grasping tasks in industrial applications. The design of the proposed monolithic soft gripper includes a middle bellow and two side bellows (i.e., fingers). The positions of the fingers are regulated by adjusting the negative pressure in the middle bellow actuator via an on-off controller. The stiffness of the soft gripper is modulated by controlling the positive pressure in the fingers through the use of a proportional air-pressure regulator. It is experimentally shown that the proposed soft gripper can modulate its stiffness by 125% within 250ms. It is also shown that the variable stiffness soft gripper can help improve the safety and performance of grasping tasks in industrial applications.


title: PaRot: Patch-Wise Rotation-Invariant Network via Feature Disentanglement and Pose Restoration

abstract: Recent interest in point cloud analysis has led rapid progress in designing deep learning methods for 3D models. However, state-of-the-art models are not robust to rotations, which remains an unknown prior to real applications and harms the model performance. In this work, we introduce a novel Patch-wise Rotation-invariant network (PaRot), which achieves rotation invariance via feature disentanglement and produces consistent predictions for samples with arbitrary rotations. Specifically, we design a siamese training module which disentangles rotation invariance and equivariance from patches defined over different scales, e.g., the local geometry and global shape, via a pair of rotations. However, our disentangled invariant feature loses the intrinsic pose information of each patch. To solve this problem, we propose a rotation-invariant geometric relation to restore the relative pose with equivariant information for patches defined over different scales. Utilising the pose information, we propose a hierarchical module which implements intra-scale and inter-scale feature aggregation for 3D shape learning. Moreover, we introduce a pose-aware feature propagation process with the rotation-invariant relative pose information embedded. Experiments show that our disentanglement module extracts high-quality rotation-robust features and the proposed lightweight model achieves competitive results in rotated 3D object classification and part segmentation tasks. Our project page is released at: https://patchrot.github.io/.


title: Switch Updating in SPSA Algorithm for Stochastic Optimization with Inequality Constraints

abstract: Simultaneous perturbation stochastic approximation (SPSA) is widely used in stochastic optimization due to its high efficiency, asymptotic stability, and reduced number of required loss function measurements. However, the standard SPSA algorithm needs to be modified to deal with constrained problems. In recent years, sequential quadratic programming (SQP)-based projection ideas and penalty ideas have been analyzed. Both ideas have convergence results and a potentially wide range of applications, but with some limitations in practical consideration, such as computation time, complexity, and feasibility guarantee. We propose an SPSA-based switch updating algorithm, which updates based on the loss function or the inequality constraints, depending on current feasibility in each iteration. We show convergence results for the algorithm, and analyze its properties relative to other methods. We also numerically compare the switch updating algorithm with the penalty function approach for two constrained examples.


title: Spectral comparison of compound cocycles generated by delay equations in Hilbert spaces

abstract: We study linear cocycles generated by nonautonomous delay equations in a proper Hilbert space and their extensions (compound cocycles) to exterior powers. Armed with the recently developed version of the Frequency Theorem, we develop analytic perturbation techniques for comparison of spectral properties (e.g., uniform exponential dichotomies) between such cocycles and cocycles generated by stationary equations. In the basis, there lies an interplay between regularity and structure in PDEs associated with delay equations. In particular, the developed machinery results in effective robust criteria for the absence of closed invariant contours on global attractors arising in nonlinear problems.


title: Recent Advances in Vehicle Routing with Stochastic Demands: Bayesian Learning for Correlated Demands and Elementary Branch-Price-and-Cut

abstract: We consider the vehicle routing problem with stochastic demands (VRPSD), a stochastic variant of the well-known VRP in which demands are only revealed upon arrival of the vehicle at each customer. Motivated by the significant recent progress on VRPSD research, we begin this paper by summarizing the key new results and methods for solving the problem. In doing so, we discuss the main challenges associated with solving the VRPSD under the chance-constraint and the restocking-based perspectives. Once we cover the current state-of-the-art, we introduce two major methodological contributions. First, we present a branch-price-and-cut (BP&C) algorithm for the VRPSD under optimal restocking. The method, which is based on the pricing of elementary routes, compares favorably with previous algorithms and allows the solution of several open benchmark instances. Second, we develop a demand model for dealing with correlated customer demands. The central concept in this model is the "external factor", which represents unknown covariates that affect all demands. We present a Bayesian-based, iterated learning procedure to refine our knowledge about the external factor as customer demands are revealed. This updated knowledge is then used to prescribe optimal replenishment decisions under demand correlation. Computational results demonstrate the efficiency of the new BP&C method and show that cost savings above 10% may be achieved when restocking decisions take account of demand correlation. Lastly, we motivate a few research perspectives that, as we believe, should shape future research on the VRPSD.


title: Three-$\alpha$ configurations of the second $J^\pi=2^+$ state in $^{12}$C

abstract: We investigate geometric configurations of $\alpha$ ($^4$He nucleus) clusters in the second $J^\pi=2^+$ state of $^{12}$C, which has been discussed as a rotational band member of the second $0^+$ state, the Hoyle state. The ground and excited $0^+$ and $2^+$ states are described by a three-$\alpha$ cluster model. The three-body Schr\"odinger equation with orthogonality conditions is accurately solved by the stochastic variational method with correlated Gaussian basis functions. To analyse the structure of these resonant states in a convenient form, we introduce a confining potential. The two-body density distributions together with the spectroscopic information clarify the structure of these states. We find that main configurations of both the second $0^+$ and $2^+$ states are acute-angled triangle shapes originating from the $^8$Be($0^+$)$+\alpha$ configuration. However, the $^8$Be$+\alpha$ components in the second $2^+$ state become approximately 2/3 because the 8Be subsystem is hard to excite, indicating that the state is not an ideal rigid rotational band member of the Hoyle state.


title: Linear programming bounds for hyperbolic surfaces

abstract: We adapt linear programming methods from sphere packings to closed hyperbolic surfaces and obtain new upper bounds on their systole, their kissing number, the first positive eigenvalue of their Laplacian, the multiplicity of their first eigenvalue, and their number of small eigenvalues. Apart from a few exceptions, the resulting bounds are the current best known both in low genus and as the genus tends to infinity. Our methods also provide lower bounds on the systole (achieved in genus $2$ to $7$, $14$, and $17$) that are sufficient for surfaces to have a spectral gap larger than $1/4$.


title: A transcendental approach to non-Archimedean metrics of pseudoeffective classes

abstract: We introduce the concept of non-Archimedean metrics attached to a transcendental pseudoeffective cohomology class on a compact K\"ahler manifold. This is obtained via extending the Ross-Witt Nystr\"om correspondence to the relative case, and we point out that our construction agrees with that of Boucksom-Jonsson when the class is induced by a pseudoeffective $\mathbb Q$-line bundle. We introduce the notion of a flag configuration attached to a transcendental big class, recovering the notion of a test configuration in the ample case. We show that non-Archimedean finite energy metrics are approximable by flag configurations, and very general versions of the radial Ding energy are continuous, a novel result even in the ample case. As applications, we characterize the delta invariant as the Ding semistability threshold of flag configurations and filtrations and prove a YTD type existence theorem in terms of flag configurations.


title: Heat flow for VT harmonic map from compact manifold

abstract: In this paper, we obtain the existence of Dirichlet problem for VT harmonic map from compact Riemannian manifold with or without boundary into compact manifold via the heat flow method. We also obtain the existence of V T geodesics uncer certain conditions on T.


title: Geometric structures in $Sol_3$

abstract: In this paper, we conclude the geometric structures in $Sol_3$ with the Levi-Civita connection and the semi-symmetric non-metric connection. We discuss two special cases to study the geometric structures in $Sol_3$ with the semi-symmetric non-metric connection, namely $\widehat{P}=a(X_3)\partial_3$ and $\widehat{P}=b(X_3)\partial_1$, also get relatively complete conclusions respectively. As a special case, we investigate the geometric structures in $Sol_3$ with the Levi-Civita connection.


title: Sequential change detection via backward confidence sequences

abstract: We present a simple reduction from sequential estimation to sequential changepoint detection (SCD). In short, suppose we are interested in detecting changepoints in some parameter or functional $\theta$ of the underlying distribution. We demonstrate that if we can construct a confidence sequence (CS) for $\theta$, then we can also successfully perform SCD for $\theta$. This is accomplished by checking if two CSs -- one forwards and the other backwards -- ever fail to intersect. Since the literature on CSs has been rapidly evolving recently, the reduction provided in this paper immediately solves several old and new change detection problems. Further, our "backward CS", constructed by reversing time, is new and potentially of independent interest. We provide strong nonasymptotic guarantees on the frequency of false alarms and detection delay, and demonstrate numerical effectiveness on several problems.

categories: math.ST cs.IT cs.LG math.IT stat.ME stat.ML stat.TH


title: Local and global measures of the shear moduli of jammed disk packings

abstract: Strain-controlled isotropic compression gives rise to jammed packings of repulsive, frictionless disks with either positive or negative global shear moduli. We carry out computational studies to understand the contributions of the negative shear moduli to the mechanical response of jammed disk packings. We first decompose the ensemble-averaged, global shear modulus as $\langle G\rangle = (1-{\cal F}_-) \langle G_+ \rangle + {\cal F}_- \langle G_-\rangle$, where ${\cal F}_-$ is the fraction of jammed packings with negative shear moduli and $\langle G_+\rangle$ and $\langle G_-\rangle$ are the average values from packings with positive and negative moduli, respectively. We show that $\langle G_+\rangle$ and $\langle|G_-|\rangle$ obey different power-law scaling relations above and below $pN^2 \sim 1$. We then calculate analytically that ${\cal P}(G)$ is a Gamma distribution in the $pN^2 \ll 1$ limit. As $pN^2$ increases, the skewness of ${\cal P}(G)$ decreases and ${\cal P}(G)$ becomes a skew-normal distribution with negative skewness in the $pN^2 \gg 1$ limit. We also partition jammed disk packings into subsystems using Delanunay triangulation of the disk centers to calculate local shear moduli. We show that the local shear moduli defined from groups of adjacent triangles can be negative even when $G > 0$. The spatial correlation function of local shear moduli $C({\vec r})$ displays weak correlations for $pn_{\rm sub}^2 < 10^{-2}$, where $n_{\rm sub}$ is the number of particles within each subsystem. However, $C({\vec r})$ begins to develop long-ranged spatial correlations with four-fold angular symmetry for $pn_{\rm sub}^2 \gtrsim 10^{-2}$.


title: Schwarz Lemma for VT harmonic map

abstract: In this paper, we obtained Schwarz Lemma of $ VT $ harmonic map including distance decreasing property and volume decreasing property under some conditions about the eigenvalue of $ du^{+} \circ du $, $ T $ and the lower bound of $ Ric_f^N $ or $ Ric_V^N $. We generalized Schwarz lemma of $ V $ harmonic map.


title: A Quantum Neural Network Regression for Modeling Lithium-ion Battery Capacity Degradation

abstract: Given the high power density low discharge rate and decreasing cost rechargeable lithium-ion batteries LiBs have found a wide range of applications such as power grid level storage systems electric vehicles and mobile devices. Developing a framework to accurately model the nonlinear degradation process of LiBs which is indeed a supervised learning problem becomes an important research topic. This paper presents a classical-quantum hybrid machine learning approach to capture the LiB degradation model that assesses battery cell life loss from operating profiles. Our work is motivated by recent advances in quantum computers as well as the similarity between neural networks and quantum circuits. Similar to adjusting weight parameters in conventional neural networks the parameters of the quantum circuit namely the qubits degree of freedom can be tuned to learn a nonlinear function in a supervised learning fashion. As a proof of concept paper our obtained numerical results with the battery dataset provided by NASA demonstrate the ability of the quantum neural networks in modeling the nonlinear relationship between the degraded capacity and the operating cycles. We also discuss the potential advantage of the quantum approach compared to conventional neural networks in classical computers in dealing with massive data especially in the context of future penetration of EVs and energy storage.


title: Learning Trees of $\ell_0$-Minimization Problems

abstract: The problem of computing minimally sparse solutions of under-determined linear systems is $NP$ hard in general. Subsets with extra properties, may allow efficient algorithms, most notably problems with the restricted isometry property (RIP) can be solved by convex $\ell_1$-minimization. While these classes have been very successful, they leave out many practical applications. In this paper, we consider adaptable classes that are tractable after training on a curriculum of increasingly difficult samples. The setup is intended as a candidate model for a human mathematician, who may not be able to tackle an arbitrary proof right away, but may be successful in relatively flexible subclasses, or areas of expertise, after training on a suitable curriculum.


title: A function-field analogue of the Goldbach counting function and the associated Dirichlet series

abstract: We consider a function-field analogue of Dirichlet series associated with the Goldbach counting function, and prove that it can, or cannot, be continued meromorphically to the whole plane. When it cannot, we further prove the existence of the natural boundary of it.


title: Domain Re-Modulation for Few-Shot Generative Domain Adaptation

abstract: In this study, we delve into the task of few-shot Generative Domain Adaptation (GDA), which involves transferring a pre-trained generator from one domain to a new domain using only a few reference images. Inspired by the way human brains acquire knowledge in new domains, we present an innovative generator structure called Domain Re-Modulation (DoRM). DoRM not only meets the criteria of high quality, large synthesis diversity, and cross-domain consistency, which were achieved by previous research in GDA, but also incorporates memory and domain association, akin to how human brains operate. Specifically, DoRM freezes the source generator and introduces new mapping and affine modules (M&A modules) to capture the attributes of the target domain during GDA. This process resembles the formation of new synapses in human brains. Consequently, a linearly combinable domain shift occurs in the style space. By incorporating multiple new M&A modules, the generator gains the capability to perform high-fidelity multi-domain and hybrid-domain generation. Moreover, to maintain cross-domain consistency more effectively, we introduce a similarity-based structure loss. This loss aligns the auto-correlation map of the target image with its corresponding auto-correlation map of the source image during training. Through extensive experiments, we demonstrate the superior performance of our DoRM and similarity-based structure loss in few-shot GDA, both quantitatively and qualitatively. The code will be available at https://github.com/wuyi2020/DoRM.


title: CHiLS: Zero-Shot Image Classification with Hierarchical Label Sets

abstract: Open vocabulary models (e.g. CLIP) have shown strong performance on zero-shot classification through their ability generate embeddings for each class based on their (natural language) names. Prior work has focused on improving the accuracy of these models through prompt engineering or by incorporating a small amount of labeled downstream data (via finetuning). However, there has been little focus on improving the richness of the class names themselves, which can pose issues when class labels are coarsely-defined and are uninformative. We propose Classification with Hierarchical Label Sets (or CHiLS), an alternative strategy for zero-shot classification specifically designed for datasets with implicit semantic hierarchies. CHiLS proceeds in three steps: (i) for each class, produce a set of subclasses, using either existing label hierarchies or by querying GPT-3; (ii) perform the standard zero-shot CLIP procedure as though these subclasses were the labels of interest; (iii) map the predicted subclass back to its parent to produce the final prediction. Across numerous datasets with underlying hierarchical structure, CHiLS leads to improved accuracy in situations both with and without ground-truth hierarchical information. CHiLS is simple to implement within existing zero-shot pipelines and requires no additional training cost. Code is available at: https://github.com/acmi-lab/CHILS.


title: Adapting to Continuous Covariate Shift via Online Density Ratio Estimation

abstract: Dealing with distribution shifts is one of the central challenges for modern machine learning. One fundamental situation is the covariate shift, where the input distributions of data change from training to testing stages while the input-conditional output distribution remains unchanged. In this paper, we initiate the study of a more challenging scenario -- continuous covariate shift -- in which the test data appear sequentially, and their distributions can shift continuously. Our goal is to adaptively train the predictor such that its prediction risk accumulated over time can be minimized. Starting with the importance-weighted learning, we show the method works effectively if the time-varying density ratios of test and train inputs can be accurately estimated. However, existing density ratio estimation methods would fail due to data scarcity at each time step. To this end, we propose an online method that can appropriately reuse historical information. Our density ratio estimation method is proven to perform well by enjoying a dynamic regret bound, which finally leads to an excess risk guarantee for the predictor. Empirical results also validate the effectiveness.


title: A Correction-Based Dynamic Enhancement Framework towards Underwater Detection

abstract: To assist underwater object detection for better performance, image enhancement technology is often used as a pre-processing step. However, most of the existing enhancement methods tend to pursue the visual quality of an image, instead of providing effective help for detection tasks. In fact, image enhancement algorithms should be optimized with the goal of utility improvement. In this paper, to adapt to the underwater detection tasks, we proposed a lightweight dynamic enhancement algorithm using a contribution dictionary to guide low-level corrections. Dynamic solutions are designed to capture differences in detection preferences. In addition, it can also balance the inconsistency between the contribution of correction operations and their time complexity. Experimental results in real underwater object detection tasks show the superiority of our proposed method in both generalization and real-time performance.


title: Anisotropic Lattice Expansion of Monolayer WSe2 Revealed by Ultrafast Electron Diffraction

abstract: Bulk layered MX2 transition metal chalcogenides (M = Mo, W and X = S, Se) are known to exhibit an indirect to direct band gap transition as the number of layers is reduced. Previous time-resolved work has principally focused on the investigation of the transient evolution of the band structure after photo-excitation, but additional information on the dynamics of the concomitant lattice rearrangement is needed to fully understand this phenomenon. Here, ultrafast electron diffraction is used to probe the atomic motion and bond dilation in monolayer WSe2 with femtosecond temporal resolution. The change in the intensity of the Bragg diffraction spots is characterized by single-exponential dynamics, consistent with a collective response of the lattice during electron-phonon and phonon-phonon equilibration that is repeatable over many hours of illumination with ultrafast pulses. Moreover, a transient and highly anisotropic lattice expansion is observed. A possible explanation for this behavior is axial strain induced by the laser excitation that breaks the degeneracy of the in-plane phonon modes, and that strongly influences the electronic band structure. Such degeneracy-breaking induced by distortions in the lattice are well characterized in static strain measurements, and the results presented here provide valuable insights into the nature and time scales of the structural rearrangement that occurs following optical photo-excitation in monolayer tungsten diselenide.


title: Proposing Novel Extrapolative Compounds by Nested Variational Autoencoders

abstract: Materials informatics (MI), which uses artificial intelligence and data analysis techniques to improve the efficiency of materials development, is attracting increasing interest from industry. One of its main applications is the rapid development of new high-performance compounds. Recently, several deep generative models have been proposed to suggest candidate compounds that are expected to satisfy the desired performance. However, they usually have the problem of requiring a large amount of experimental datasets for training to achieve sufficient accuracy. In actual cases, it is often possible to accumulate only about 1000 experimental data at most. Therefore, the authors proposed a deep generative model with nested two variational autoencoders (VAEs). The outer VAE learns the structural features of compounds using large-scale public data, while the inner VAE learns the relationship between the latent variables of the outer VAE and the properties from small-scale experimental data. To generate high performance compounds beyond the range of the training data, the authors also proposed a loss function that amplifies the correlation between a component of latent variables of the inner VAE and material properties. The results indicated that this loss function contributes to improve the probability of generating high-performance candidates. Furthermore, as a result of verification test with an actual customer in chemical industry, it was confirmed that the proposed method is effective in reducing the number of experiments to $1/4$ compared to a conventional method.


title: Global solutions of the Landau--Lifshitz--Baryakhtar equation

abstract: The Landau--Lifshitz--Baryakhtar (LLBar) equation is a generalisation of the Landau--Lifshitz--Gilbert and the Landau--Lifshitz--Bloch equations which takes into account contributions from nonlocal damping and is valid at moderate temperature below the Curie temperature. Therefore, it is used to explain some discrepancies between the experimental observations and the known theories in various problems on magnonics and magnetic domain-wall dynamics. In this paper, the existence and uniqueness of global weak, strong, and regular solutions to LLBar equation are proven. H\"older continuity of the solution is also discussed.


title: Fast Direct Localization for Millimeter Wave MIMO Systems via Deep ADMM Unfolding

abstract: Massive arrays deployed in millimeter-wave systems enable high angular resolution performance, which in turn facilitates sub-meter localization services. Albeit suboptimal, up to now the most popular localization approach has been based on a so-called two-step procedure, where triangulation is applied upon aggregation of the angle-of-arrival (AoA) measurements from the collaborative base stations. This is mainly due to the prohibitive computational cost of the existing direct localization approaches in large-scale systems. To address this issue, we propose a deep unfolding based fast direct localization solver. First, the direct localization is formulated as a joint $l_1$-$l_{2,1}$ norm sparse recovery problem, which is then solved by using alternating direction method of multipliers (ADMM). Next, we develop a deep ADMM unfolding network (DAUN) to learn the ADMM parameter settings from the training data and a position refinement algorithm is proposed for DAUN. Finally, simulation results showcase the superiority of the proposed DAUN over the baseline solvers in terms of better localization accuracy, faster convergence and significantly lower computational complexity.


title: A second order constitutive theory for polyatomic gases: theory and applications

abstract: In the classical irreversible thermodynamics (CIT) framework, the Navier Stokes Fourier (NSF) constitutive equations are obtained so as they satisfy the entropy inequality, by and large assuming that the entropy flux is equal to the heat flux over the temperature. This article is focused on the derivation of second-order constitutive equations for polyatomic gases; it takes the basis of CIT, but most importantly, allowing up to quadratic nonlinearities in the entropy flux.


title: Cosmography via Gaussian Process with Gamma Ray Bursts

abstract: In this paper, we firstly calibrate the Amati relation (the $E_{\rm p}-E_{\rm iso}$ correlation) of gamma ray bursts (GRBs) at low redshifts ($z<0.8$) via Gaussian process by using the type Ia supernovae samples from Pantheon+ under the philosophy that objects at the same redshift should have the same luminosity distance in any cosmology. As a result, this calibration derives the distance moduli of GRBs at high redshifts ($z>0.8$). For an application of these derived distance modulus of GRBs to cosmology, via Gaussian process again, a series of cosmography parameters, which describe kinematics of our Universe, up to the fifth oder and the redshift $z\sim 5$, i.e. the Hubble parameter $H(z)$, the deceleration parameter $q(z)$, the jerk parameter $j(z)$, the snap parameter $s(z)$ and the lerk parameter $l(z)$, are reconstructed from the cosmic observations. The reconstructed cosmography parameters show a transition singularity at $z\sim 6$, it may resort to two possible explanations: one is that the GRBs data points at high redshift $z>5$ are still reliable, it means that new physics beyond the $\Lambda$CDM model happens; another one is that the quality and quantity of GRBs data points at high redshift $z>5$ are not good enough to give any viable prediction of the kinematics of our Universe. To pin down this problem, more high redshifts $z>5$ cosmic observational are still needed.


title: Causal Estimation of Exposure Shifts with Neural Networks: Evaluating the Health Benefits of Stricter Air Quality Standards in the US

abstract: In policy research, one of the most critical analytic tasks is to estimate the causal effect of a policy-relevant shift to the distribution of a continuous exposure/treatment on an outcome of interest. We call this problem shift-response function (SRF) estimation. Existing neural network methods involving robust causal-effect estimators lack theoretical guarantees and practical implementations for SRF estimation. Motivated by a key policy-relevant question in public health, we develop a neural network method and its theoretical underpinnings to estimate SRFs with robustness and efficiency guarantees. We then apply our method to data consisting of 68 million individuals and 27 million deaths across the U.S. to estimate the causal effect from revising the US National Ambient Air Quality Standards (NAAQS) for PM 2.5 from 12 $\mu g/m^3$ to 9 $\mu g/m^3$. This change has been recently proposed by the US Environmental Protection Agency (EPA). Our goal is to estimate, for the first time, the reduction in deaths that would result from this anticipated revision using causal methods for SRFs. Our proposed method, called {T}argeted {R}egularization for {E}xposure {S}hifts with Neural {Net}works (TRESNET), contributes to the neural network literature for causal inference in two ways: first, it proposes a targeted regularization loss with theoretical properties that ensure double robustness and achieves asymptotic efficiency specific for SRF estimation; second, it enables loss functions from the exponential family of distributions to accommodate non-continuous outcome distributions (such as hospitalization or mortality counts). We complement our application with benchmark experiments that demonstrate TRESNET's broad applicability and competitiveness.


title: Domain-Indexing Variational Bayes: Interpretable Domain Index for Domain Adaptation

abstract: Previous studies have shown that leveraging domain index can significantly boost domain adaptation performance (arXiv:2007.01807, arXiv:2202.03628). However, such domain indices are not always available. To address this challenge, we first provide a formal definition of domain index from the probabilistic perspective, and then propose an adversarial variational Bayesian framework that infers domain indices from multi-domain data, thereby providing additional insight on domain relations and improving domain adaptation performance. Our theoretical analysis shows that our adversarial variational Bayesian framework finds the optimal domain index at equilibrium. Empirical results on both synthetic and real data verify that our model can produce interpretable domain indices which enable us to achieve superior performance compared to state-of-the-art domain adaptation methods. Code is available at https://github.com/Wang-ML-Lab/VDI.


title: Local rigidity of Julia sets

abstract: We find criteria ensuring that a local (holomorphic, real analytic, $C^1$) homeomorphism between the Julia sets of two given rational functions comes from an algebraic correspondence. For example, we show that if there is a local $C^1$-symmetry between the maximal entropy measures of two rational functions, then probably up to a complex conjugation, the two rational functions are dynamically related by an algebraic correspondence. The holomorphic case of our criterion will play an important role in the authors' upcoming proof of the Dynamical Andr\'e-Oort conjecture for curves.


title: Stochastic Gradient Descent-Induced Drift of Representation in a Two-Layer Neural Network

abstract: Representational drift refers to over-time changes in neural activation accompanied by a stable task performance. Despite being observed in the brain and in artificial networks, the mechanisms of drift and its implications are not fully understood. Motivated by recent experimental findings of stimulus-dependent drift in the piriform cortex, we use theory and simulations to study this phenomenon in a two-layer linear feedforward network. Specifically, in a continual online learning scenario, we study the drift induced by the noise inherent in the Stochastic Gradient Descent (SGD). By decomposing the learning dynamics into the normal and tangent spaces of the minimum-loss manifold, we show the former corresponds to a finite variance fluctuation, while the latter could be considered as an effective diffusion process on the manifold. We analytically compute the fluctuation and the diffusion coefficients for the stimuli representations in the hidden layer as functions of network parameters and input distribution. Further, consistent with experiments, we show that the drift rate is slower for a more frequently presented stimulus. Overall, our analysis yields a theoretical framework for better understanding of the drift phenomenon in biological and artificial neural networks.


title: Accelerated Dynamic Magnetic Resonance Imaging from Spatial-Subspace Reconstructions (SPARS)

abstract: Dynamic contrast-enhanced (DCE) magnetic resonance imaging (MRI) ideally requires a high spatial and high temporal resolution, but hardware limitations prevent acquisitions from simultaneously achieving both. Existing image reconstruction techniques can artificially create spatial resolution at a given temporal resolution by estimating data that is not acquired, but, ultimately, spatial details are sacrificed at very high acceleration rates. The purpose of this paper is to introduce the concept of spatial subspace reconstructions (SPARS) and demonstrate its ability to reconstruct high spatial resolution dynamic images from as few as one acquired radial spoke per dynamic frame. Briefly, a low-temporal-high-spatial resolution organization of the acquired raw data is used to estimate a spatial subspace in which the high-temporal-high-spatial ground truth data resides. This subspace is then used to estimate entire images from single k-space spokes. In both simulated and human in-vivo data, the proposed SPARS reconstruction method outperformed standard GRASP and GRASP-Pro reconstruction, providing a shorter reconstruction time and yielding higher accuracy from both a spatial and temporal perspective.