title: Experimental Confirmation of the Universal Law for the Vibrational Density of States of Liquids

abstract: An analytical model describing the vibrational phonon density of states (VDOS) of liquids has long been elusive, mainly due to the difficulty in dealing with the imaginary modes dominant in the low-energy region, as described by the instantaneous normal mode (INM) approach. Nevertheless, Zaccone and Baggioli have recently developed such a model based on overdamped Langevin liquid dynamics. The model was proposed to be the universal law for the vibrational density of states of liquids. Distinct from the Debye law, g({\omega}) ~ {\omega}2, for solids, the universal law for liquids reveals a linear relationship, g({\omega}) ~ {\omega}, in the low-energy region. The universal law has been successfully verified with computer simulated VDOS for Lennard-Jones liquids. We further confirm this universal law with experimental VDOS measured by inelastic neutron scattering on real liquid systems including water, liquid metal, and polymer liquids. We have applied this model and extracted the effective relaxation rate for the short time dynamics for each liquid. The model has been further evaluated in the predication of the specific heat. The results have been compared with the existing experimental data as well as with values obtained by different approaches.


title: The fine line between dead neurons and sparsity in binarized spiking neural networks

abstract: Spiking neural networks can compensate for quantization error by encoding information either in the temporal domain, or by processing discretized quantities in hidden states of higher precision. In theory, a wide dynamic range state-space enables multiple binarized inputs to be accumulated together, thus improving the representational capacity of individual neurons. This may be achieved by increasing the firing threshold, but make it too high and sparse spike activity turns into no spike emission. In this paper, we propose the use of `threshold annealing' as a warm-up method for firing thresholds. We show it enables the propagation of spikes across multiple layers where neurons would otherwise cease to fire, and in doing so, achieve highly competitive results on four diverse datasets, despite using binarized weights. Source code is available at https://github.com/jeshraghian/snn-tha/


title: Constraint-based Formation of Drone Swarms

abstract: Drone swarms are required for the simultaneous delivery of multiple packages. We demonstrate a multi-stop drone swarm-based delivery in a smart city. We leverage formation flying to conserve energy and increase the flight range of a drone swarm. An adaptive formation is presented in which a swarm adjusts to extrinsic constraints and changes the formation pattern in-flight. We utilize the existing building rooftops in a city and build a line-of-sight skyway network to safely operate the swarms. We use a heuristic-based A* algorithm to route a drone swarm in a skyway network.


title: Task-Aware Network Coding Over Butterfly Network

abstract: Network coding allows distributed information sources such as sensors to efficiently compress and transmit data to distributed receivers across a bandwidth-limited network. Classical network coding is largely task-agnostic -- the coding schemes mainly aim to faithfully reconstruct data at the receivers, regardless of what ultimate task the received data is used for. In this paper, we analyze a new task-driven network coding problem, where distributed receivers pass transmitted data through machine learning (ML) tasks, which provides an opportunity to improve efficiency by transmitting salient task-relevant data representations. Specifically, we formulate a task-aware network coding problem over a butterfly network in real-coordinate space, where lossy analog compression through principal component analysis (PCA) can be applied. A lower bound for the total loss function for the formulated problem is given, and necessary and sufficient conditions for achieving this lower bound are also provided. We introduce ML algorithms to solve the problem in the general case, and our evaluation demonstrates the effectiveness of task-aware network coding.


title: The $(q,t)$-Cartan matrix specialized at $q=1$

abstract: The $(q,t)$-Cartan matrix specialized at $t=1$, usually called the quantum Cartan matrix, has deep connections with (i) the representation theory of its untwisted quantum affine algebra, and (ii) quantum unipotent coordinate algebra, root system and quantum cluster algebra of kew-symmetric type. In this paper, we study the $(q,t)$-Cartan matrix specialized at $q=1$, called the $t$-quantized Cartan matrix, and investigate the relations with (ii') its corresponding quantum unipotent coordinate algebra, root system and quantum cluster algebra of skew-symmetrizable type.


title: Peculiar disk behaviors of the black hole candidate MAXI J1348-630 in the hard state observed by Insight-HXMT and Swift

abstract: We present a spectral study of the black hole candidate MAXI J1348-630 during its 2019 outburst, based on monitoring observations with Insight-HXMT and Swift. Throughout the outburst, the spectra are well fitted with power-law plus disk-blackbody components. In the soft-intermediate and soft states, we observed the canonical relation L ~ T_in^4 between disk luminosity L and peak colour temperature T_in, with a constant inner radius R_in (traditionally identified with the innermost stable circular orbit). At other stages of the outburst cycle, the behaviour is more unusual, inconsistent with the canonical outburst evolution of black hole transients. In particular, during the hard rise, the apparent inner radius is smaller than in the soft state (and increasing), and the peak colour temperature is higher (and decreasing). This anomalous behaviour is found even when we model the spectra with self-consistent Comptonization models, which take into account the up-scattering of photons from the disk component into the power-law component. To explain both those anomalous trends at the same time, we suggest that the hardening factor for the inner disk emission was larger than the canonical value of ~1.7 at the beginning of the outburst. A more physical trend of radii and temperature evolution requires a hardening factor evolving from ~3.5 at the beginning of the hard state to ~1.7 in the hard intermediate state. This could be evidence that the inner disk was in the process of condensing from the hot, optically thin medium and had not yet reached a sufficiently high optical depth for its emission spectrum to be described by the standard optically-thick disk solution.


title: Percolation probability and critical exponents for site percolation on the UIPT

abstract: We derive three critical exponents for Bernoulli site percolation on the on the Uniform Infinite Planar Triangulation (UIPT). First we compute explicitly the probability that the root cluster is infinite. As a consequence, we show that the off-critical exponent for site percolation on the UIPT is $\beta = 1/2$. Then we establish an integral formula for the generating function of the number of vertices in the root cluster. We use this formula to prove that, at criticality, the probability that the root cluster has at least $n$ vertices decays like $n^{-1/7}$. Finally, we also derive an expression for the law of the perimeter of the root cluster and use it to establish that, at criticality, the probability that the perimeter of the root cluster is equal to $n$ decays like $n^{-4/3}$. Among these three exponents, only the last one was previously known. Our main tools are the so-called gasket decomposition of percolation clusters, generic properties of random Boltzmann maps, as well as analytic combinatorics.


title: Adaptive Best-of-Both-Worlds Algorithm for Heavy-Tailed Multi-Armed Bandits

abstract: In this paper, we generalize the concept of heavy-tailed multi-armed bandits to adversarial environments, and develop robust best-of-both-worlds algorithms for heavy-tailed multi-armed bandits (MAB), where losses have $\alpha$-th ($1<\alpha\le 2$) moments bounded by $\sigma^\alpha$, while the variances may not exist. Specifically, we design an algorithm \texttt{HTINF}, when the heavy-tail parameters $\alpha$ and $\sigma$ are known to the agent, \texttt{HTINF} simultaneously achieves the optimal regret for both stochastic and adversarial environments, without knowing the actual environment type a-priori. When $\alpha,\sigma$ are unknown, \texttt{HTINF} achieves a $\log T$-style instance-dependent regret in stochastic cases and $o(T)$ no-regret guarantee in adversarial cases. We further develop an algorithm \texttt{AdaTINF}, achieving $\mathcal O(\sigma K^{1-\nicefrac 1\alpha}T^{\nicefrac{1}{\alpha}})$ minimax optimal regret even in adversarial settings, without prior knowledge on $\alpha$ and $\sigma$. This result matches the known regret lower-bound (Bubeck et al., 2013), which assumed a stochastic environment and $\alpha$ and $\sigma$ are both known. To our knowledge, the proposed \texttt{HTINF} algorithm is the first to enjoy a best-of-both-worlds regret guarantee, and \texttt{AdaTINF} is the first algorithm that can adapt to both $\alpha$ and $\sigma$ to achieve optimal gap-indepedent regret bound in classical heavy-tailed stochastic MAB setting and our novel adversarial formulation.


title: Geometric properties of spin clusters in random triangulations coupled with an Ising Model

abstract: We investigate the geometry of a typical spin cluster in random triangulations sampled with a probability proportional to the energy of an Ising configuration on their vertices, both in the finite and infinite volume settings. This model is known to undergo a combinatorial phase transition at an explicit critical temperature, for which its partition function has a different asymptotic behavior than uniform maps. The purpose of this work is to give geometric evidence of this phase transition. In the infinite volume setting, called the Infinite Ising Planar Triangulation, we exhibit a phase transition for the existence of an infinite spin cluster: for critical and supercritical temperatures, the root spin cluster is finite almost surely, while it is infinite with positive probability for subcritical temperatures. Remarkably, we are able to obtain an explicit parametric expression for this probability, which allows to prove that the percolation critical exponent is $\beta=1/4$. We also derive critical exponents for the tail distribution of the perimeter and of the volume of the root spin cluster, both in the finite and infinite volume settings. Finally, we establish the scaling limit of the interface of the root spin cluster seen as a looptree. In particular in the whole supercritical temperature regime, we prove that the critical exponents and the looptree limit are the same as for critical Bernoulli site percolation. Our proofs mix combinatorial and probabilistic arguments. The starting point is the gasket decomposition, which makes full use of the spatial Markov property of our model. This decomposition enables us to characterize the root spin cluster as a Boltzmann planar map in the finite volume setting. We then combine precise combinatorial results obtained through analytic combinatorics and universal features of Boltzmann maps to establish our results.


title: Quantum teleportation using Ising anyons

abstract: Anyons have been extensively investigated as information carriers in topological quantum computation. However, how to characterize the information flow in quantum networks composed of anyons is less understood, which motivates us to study quantum communication protocols in anyonic systems. Here we propose a general topologically protected protocol for quantum teleportation based on the Ising anyon model and prove that with our protocol an unknown anyonic state of any number of Ising anyons can be teleported from Alice to Bob. Our protocol naturally generalizes quantum state teleportation from systems of locally distinguishable particles to systems of Ising anyons, which may promote our understandings of anyonic quantum entanglement as a quantum resource. In addition, our protocol is expected to be realized with the Majorana zero modes, one of the possible physical realizations for the Ising anyon in experiments.


title: Close the Optical Sensing Domain Gap by Physics-Grounded Active Stereo Sensor Simulation

abstract: In this paper, we focus on the simulation of active stereovision depth sensors, which are popular in both academic and industry communities. Inspired by the underlying mechanism of the sensors, we designed a fully physics-grounded simulation pipeline that includes material acquisition, ray-tracing-based infrared (IR) image rendering, IR noise simulation, and depth estimation. The pipeline is able to generate depth maps with material-dependent error patterns similar to a real depth sensor in real time. We conduct real experiments to show that perception algorithms and reinforcement learning policies trained in our simulation platform could transfer well to the real-world test cases without any fine-tuning. Furthermore, due to the high degree of realism of this simulation, our depth sensor simulator can be used as a convenient testbed to evaluate the algorithm performance in the real world, which will largely reduce the human effort in developing robotic algorithms. The entire pipeline has been integrated into the SAPIEN simulator and is open-sourced to promote the research of vision and robotics communities.


title: POLYLLA: Polygonal meshing algorithm based on terminal-edge regions

abstract: This paper presents an algorithm to generate a new kind of polygonal mesh obtained from triangulations. Each polygon is built from a terminal-edge region surrounded by edges that are not the longest-edge of any of the two triangles that share them. The algorithm is termed Polylla and is divided into three phases. The first phase consists of labeling each edge of the input triangulation according to its size; the second phase builds polygons (simple or not) from terminal-edges regions using the label system; and the third phase transforms each non simple polygon into simple ones. The final mesh contains polygons with convex and non convex shape. Since Voronoi based meshes are currently the most used polygonal meshes, we compare some geometric properties of our meshes against constrained Voronoi meshes. Several experiments were run to compare the shape and size of polygons, the number of final mesh points and polygons. For the same input, Polylla meshes contain less polygons than Voronoi meshes, and the algorithm is simpler and faster than the algorithm to generate constrained Voronoi meshes. Finally, we have validated Polylla meshes by solving the Laplace equation on an L-shaped domain using the Virtual Element Method (VEM). We show that the numerical performance of the VEM using Polylla meshes and Voronoi meshes is similar.


title: Simplifying deflation for non-convex optimization with applications in Bayesian inference and topology optimization

abstract: Non-convex optimization problems have multiple local optimal solutions. Non-convex optimization problems are commonly found in numerous applications. One of the methods recently proposed to efficiently explore multiple local optimal solutions without random re-initialization relies on the concept of deflation. In this paper, different ways to use deflation in non-convex optimization and nonlinear system solving are discussed. A simple, general and novel deflation constraint is proposed to enable the use of deflation together with existing nonlinear programming solvers or nonlinear system solvers. The connection between the proposed deflation constraint and a minimum distance constraint is presented. Additionally, a number of variations of deflation constraints and their limitations are discussed. Finally, a number of applications of the proposed methodology in the fields of approximate Bayesian inference and topology optimization are presented.


title: Constrained Variational Policy Optimization for Safe Reinforcement Learning

abstract: Safe reinforcement learning (RL) aims to learn policies that satisfy certain constraints before deploying them to safety-critical applications. Previous primal-dual style approaches suffer from instability issues and lack optimality guarantees. This paper overcomes the issues from the perspective of probabilistic inference. We introduce a novel Expectation-Maximization approach to naturally incorporate constraints during the policy learning: 1) a provable optimal non-parametric variational distribution could be computed in closed form after a convex optimization (E-step); 2) the policy parameter is improved within the trust region based on the optimal variational distribution (M-step). The proposed algorithm decomposes the safe RL problem into a convex optimization phase and a supervised learning phase, which yields a more stable training performance. A wide range of experiments on continuous robotic tasks shows that the proposed method achieves significantly better constraint satisfaction performance and better sample efficiency than baselines. The code is available at https://github.com/liuzuxin/cvpo-safe-rl.


title: Quadruped Capturability and Push Recovery via a Switched-Systems Characterization of Dynamic Balance

abstract: This paper studies capturability and push recovery for quadrupedal locomotion. Despite the rich literature on capturability analysis and push recovery control for legged robots, existing tools are developed mainly for bipeds or humanoids. Distinct quadrupedal features such as point contacts and multiple swinging legs prevent direct application of these methods. To address this gap, we propose a switched systems model for quadruped dynamics, and instantiate the abstract viability concept for quadrupedal locomotion with a time-based gait. Capturability is characterized through a novel specification of dynamically balanced states that addresses the time-varying nature of quadrupedal locomotion and balance. A linear inverted pendulum (LIP) model is adopted to demonstrate the theory and show how the newly developed quadrupedal capturability can be used in motion planning for quadrupedal push recovery. We formulate and solve an explicit model predictive control (EMPC) problem whose optimal solution fully characterizes quadrupedal capturability with the LIP. Given this analysis, an optimization-based planning scheme is devised for determining footsteps and center of mass references during push recovery. To validate the effectiveness of the overall framework, we conduct numerous simulation and hardware experiments. Simulation results illustrate the necessity of considering dynamic balance for quadrupedal capturability, and the significant improvement in disturbance rejection with the proposed strategy. Experimental validations on a replica of the Mini Cheetah quadruped demonstrate an up to 100% improvement as compared with state-of-the-art.


title: Positive Rate Binary Interactive Error Correcting Codes Resilient to $>\frac12$ Adversarial Erasures

abstract: An interactive error correcting code ($\mathsf{iECC}$) is an interactive protocol with the guarantee that the receiver can correctly determine the sender's message, even in the presence of noise. This generalizes the concept of an error correcting code ($\mathsf{ECC}$), which is a non-interactive $\mathsf{iECC}$ that is known to have erasure resilience capped at $\frac12$. The work of \cite{GuptaTZ21} constructed the first $\mathsf{iECC}$ resilient to $> \frac12$ adversarial erasures. However, their $\mathsf{iECC}$ has communication complexity quadratic in the message size. In our work, we construct the first positive rate $\mathsf{iECC}$ resilient to $> \frac12$ adversarial erasures. For any $\epsilon > 0$, our $\mathsf{iECC}$ is resilient to $\frac6{11} - \epsilon$ adversarial erasures and has size $O_\epsilon(n)$.


title: Distribution of money on connected graphs with multiple banks

abstract: This paper studies an interacting particle system of interest in econophysics inspired from a model introduced in the physics literature. The original model consists of the customers of a single bank characterized by their capital, and the discrete-time dynamics consists of monetary transactions in which a random individual $x$ gives one coin to another random individual $y$, the transaction being canceled when $x$ is in debt and there is no more coins to borrow from the bank. Using a combination of numerical simulations and heuristic arguments, physicists conjectured that the distribution of money (the distribution of the number of coins owned by a given individual) at equilibrium converges to an asymmetric Laplace distribution in the large population/temperature limit. In this paper, we prove and extend this conjecture to a more general model including multiple banks and interactions among customers across banks. More importantly, our model assumes that customers are located on a general undirected connected graph (as opposed to the complete graph in the original model) where neighbors are interpreted as business partners, and transactions occur along the edges, thus modeling the flow of money across a social network. We show the convergence to the asymmetric Laplace distribution in the large population/temperature limit for any graph, thus proving and extending the conjecture from the physicists, and derive an exact expression of the distribution of money for all population sizes and money temperatures.


title: Fast Interpretable Greedy-Tree Sums

abstract: Modern machine learning has achieved impressive prediction performance, but often sacrifices interpretability, a critical consideration in high-stakes domains such as medicine. In such settings, practitioners often use highly interpretable decision tree models, but these suffer from inductive bias against additive structure. To overcome this bias, we propose Fast Interpretable Greedy-Tree Sums (FIGS), which generalizes the CART algorithm to simultaneously grow a flexible number of trees in summation. By combining logical rules with addition, FIGS is able to adapt to additive structure while remaining highly interpretable. Extensive experiments on real-world datasets show that FIGS achieves state-of-the-art prediction performance. To demonstrate the usefulness of FIGS in high-stakes domains, we adapt FIGS to learn clinical decision instruments (CDIs), which are tools for guiding clinical decision-making. Specifically, we introduce a variant of FIGS known as G-FIGS that accounts for the heterogeneity in medical data. G-FIGS derives CDIs that reflect domain knowledge and enjoy improved specificity (by up to 20% over CART) without sacrificing sensitivity or interpretability. To provide further insight into FIGS, we prove that FIGS learns components of additive models, a property we refer to as disentanglement. Further, we show (under oracle conditions) that unconstrained tree-sum models leverage disentanglement to generalize more efficiently than single decision tree models when fitted to additive regression functions. Finally, to avoid overfitting with an unconstrained number of splits, we develop Bagging-FIGS, an ensemble version of FIGS that borrows the variance reduction techniques of random forests. Bagging-FIGS enjoys competitive performance with random forests and XGBoost on real-world datasets.


title: Deep Generative Model for Periodic Graphs

abstract: Periodic graphs are graphs consisting of repetitive local structures, such as crystal nets and polygon mesh. Their generative modeling has great potential in real-world applications such as material design and graphics synthesis. Classical models either rely on domain-specific predefined generation principles (e.g., in crystal net design), or follow geometry-based prescribed rules. Recently, deep generative models has shown great promise in automatically generating general graphs. However, their advancement into periodic graphs have not been well explored due to several key challenges in 1) maintaining graph periodicity; 2) disentangling local and global patterns; and 3) efficiency in learning repetitive patterns. To address them, this paper proposes Periodical-Graph Disentangled Variational Auto-encoder (PGD-VAE), a new deep generative models for periodic graphs that can automatically learn, disentangle, and generate local and global graph patterns. Specifically, we develop a new periodic graph encoder consisting of global-pattern encoder and local-pattern encoder that ensures to disentangle the representation into global and local semantics. We then propose a new periodic graph decoder consisting of local structure decoder, neighborhood decoder, and global structure decoder, as well as the assembler of their outputs that guarantees periodicity. Moreover, we design a new model learning objective that helps ensure the invariance of local-semantic representations for the graphs with the same local structure. Comprehensive experimental evaluations have been conducted to demonstrate the effectiveness of the proposed method. The code of proposed PGD-VAE is availabe at https://github.com/shi-yu-wang/PGD-VAE.


title: The Magnetic Field in the Milky Way Filamentary Bone G47

abstract: Star formation primarily occurs in filaments where magnetic fields are expected to be dynamically important. The largest and densest filaments trace spiral structure within galaxies. Over a dozen of these dense ($\sim$10$^4$\,cm$^{-3}$) and long ($>$10\,pc) filaments have been found within the Milky Way, and they are often referred to as "bones." Until now, none of these bones have had their magnetic field resolved and mapped in their entirety. We introduce the SOFIA legacy project FIELDMAPS which has begun mapping $\sim$10 of these Milky Way bones using the HAWC+ instrument at 214\,$\mu$m and 18$\farcs$2 resolution. Here we present a first result from this survey on the $\sim$60\,pc long bone G47. Contrary to some studies of dense filaments in the Galactic plane, we find that the magnetic field is often not perpendicular to the spine (i.e., the center-line of the bone). Fields tend to be perpendicular in the densest areas of active star formation and more parallel or random in other areas. The average field is neither parallel or perpendicular to the Galactic plane nor the bone. The magnetic field strengths along the spine typically vary from $\sim$20 to $\sim$100\,$\mu$G. Magnetic fields tend to be strong enough to suppress collapse along much of the bone, but for areas that are most active in star formation, the fields are notably less able to resist gravitational collapse.


title: A Secure and Efficient Federated Learning Framework for NLP

abstract: In this work, we consider the problem of designing secure and efficient federated learning (FL) frameworks. Existing solutions either involve a trusted aggregator or require heavyweight cryptographic primitives, which degrades performance significantly. Moreover, many existing secure FL designs work only under the restrictive assumption that none of the clients can be dropped out from the training protocol. To tackle these problems, we propose SEFL, a secure and efficient FL framework that (1) eliminates the need for the trusted entities; (2) achieves similar and even better model accuracy compared with existing FL designs; (3) is resilient to client dropouts. Through extensive experimental studies on natural language processing (NLP) tasks, we demonstrate that the SEFL achieves comparable accuracy compared to existing FL solutions, and the proposed pruning technique can improve runtime performance up to 13.7x.


title: Sequential Decoding of Convolutional Codes for Synchronization Errors

abstract: Sequential decoding, commonly applied to substitution channels, is a sub-optimal alternative to Viterbi decoding with significantly reduced memory costs. In this work, a sequential decoder for convolutional codes over channels that are prone to insertion, deletion, and substitution errors, is described and analyzed. Our decoder expands the code trellis by a new channel-state variable, called drift state, as proposed by Davey and MacKay. A suitable decoding metric on that trellis for sequential decoding is derived, generalizing the original Fano metric. The decoder is also extended to facilitate the simultaneous decoding of multiple received sequences that arise from a single transmitted sequence. Under low-noise environments, our decoding approach reduces the decoding complexity by a couple orders of magnitude in comparison to Viterbi's algorithm, albeit at slightly higher bit error rates. An analytical method to determine the computational cutoff rate is also suggested. This analysis is supported with numerical evaluations of bit error rates and computational complexity, which are compared with respect to optimal Viterbi decoding.


title: Consistent Collaborative Filtering via Tensor Decomposition

abstract: Collaborative filtering is the de facto standard for analyzing users' activities and building recommendation systems for items. In this work we develop Sliced Anti-symmetric Decomposition (SAD), a new model for collaborative filtering based on implicit feedback. In contrast to traditional techniques where a latent representation of users (user vectors) and items (item vectors) are estimated, SAD introduces one additional latent vector to each item, using a novel three-way tensor view of user-item interactions. This new vector extends user-item preferences calculated by standard dot products to general inner products, producing interactions between items when evaluating their relative preferences. SAD reduces to state-of-the-art (SOTA) collaborative filtering models when the vector collapses to 1, while in this paper we allow its value to be estimated from data. Allowing the values of the new item vector to be different from 1 has profound implications. It suggests users may have nonlinear mental models when evaluating items, allowing the existence of cycles in pairwise comparisons. We demonstrate the efficiency of SAD in both simulated and real world datasets containing over 1M user-item interactions. By comparing with seven SOTA collaborative filtering models with implicit feedbacks, SAD produces the most consistent personalized preferences, in the meanwhile maintaining top-level of accuracy in personalized recommendations. We release the model and inference algorithms in a Python library https://github.com/apple/ml-sad.


title: Stereo Matching with Cost Volume based Sparse Disparity Propagation

abstract: Stereo matching is crucial for binocular stereo vision. Existing methods mainly focus on simple disparity map fusion to improve stereo matching, which require multiple dense or sparse disparity maps. In this paper, we propose a simple yet novel scheme, termed feature disparity propagation, to improve general stereo matching based on matching cost volume and sparse matching feature points. Specifically, our scheme first calculates a reliable sparse disparity map by local feature matching, and then refines the disparity map by propagating reliable disparities to neighboring pixels in the matching cost domain. In addition, considering the gradient and multi-scale information of local disparity regions, we present a $\rho$-Census cost measure based on the well-known AD-Census, which guarantees the robustness of cost volume even without the cost aggregation step. Extensive experiments on Middlebury stereo benchmark V3 demonstrate that our scheme achieves promising performance comparable to state-of-the-art methods.


title: Topological surfaces of domain wall-decorated antiferromagnetic topological insulator MnBi$_{2n}$Te$_{3n+1}$

abstract: Antiferromagnetic topological insulators harbor topological in-gap surface states protected by an anti-unitary $S$ symmetry, which is broken by the inevitable presence of domain walls. Whether an antiferromagnetic topological insulator with domain walls is gapless and metallic on its topological surfaces remains to be elucidated. We show that a single non-statistical index characterizing the magnetic order of domain wall-decorated antiferromagnetic topological insulator, referred to as the Ising moment, determines the topological surface gap, which can be zero even when the $S$ symmetry is manifestly broken. In the thermodynamic limit, the topological surface states tend to be gapless when magnetic fluctuation is bounded. In this case, the Lyapunov exponent of the surface transfer matrix reveals a surface delocalization transition near the zero energy due to a crossover from orthogonal to chiral orthogonal symmetry class. Spectroscopic and transport measurements on the surface states will reveal the critical behavior of the transition, which in return bears on the nature of antiferromagnetic domains walls.


title: With Greater Distance Comes Worse Performance: On the Perspective of Layer Utilization and Model Generalization

abstract: Generalization of deep neural networks remains one of the main open problems in machine learning. Previous theoretical works focused on deriving tight bounds of model complexity, while empirical works revealed that neural networks exhibit double descent with respect to both training sample counts and the neural network size. In this paper, we empirically examined how different layers of neural networks contribute differently to the model; we found that early layers generally learn representations relevant to performance on both training data and testing data. Contrarily, deeper layers only minimize training risks and fail to generalize well with testing or mislabeled data. We further illustrate the distance of trained weights to its initial value of final layers has high correlation to generalization errors and can serve as an indicator of an overfit of model. Moreover, we show evidence to support post-training regularization by re-initializing weights of final layers. Our findings provide an efficient method to estimate the generalization capability of neural networks, and the insight of those quantitative results may inspire derivation to better generalization bounds that take the internal structure of neural networks into consideration.


title: Wassersplines for Neural Vector Field--Controlled Animation

abstract: Much of computer-generated animation is created by manipulating meshes with rigs. While this approach works well for animating articulated objects like animals, it has limited flexibility for animating less structured free-form objects. We introduce Wassersplines, a novel trajectory inference method for animating unstructured densities based on recent advances in continuous normalizing flows and optimal transport. The key idea is to train a neurally-parameterized velocity field that represents the motion between keyframes. Trajectories are then computed by advecting keyframes through the velocity field. We solve an additional Wasserstein barycenter interpolation problem to guarantee strict adherence to keyframes. Our tool can stylize trajectories through a variety of PDE-based regularizers to create different visual effects. We demonstrate our tool on various keyframe interpolation problems to produce temporally-coherent animations without meshing or rigging.


title: Unifying Pairwise Interactions in Complex Dynamics

abstract: Scientists have developed hundreds of techniques to measure the interactions between pairs of processes in complex systems. But these computational methods, from correlation coefficients to causal inference, rely on distinct quantitative theories that remain largely disconnected. Here we introduce a library of 237 statistics of pairwise interactions and assess their behavior on 1053 multivariate time series from a wide range of real-world and model-generated systems. Our analysis highlights new commonalities between different mathematical formulations, providing a unified picture of a rich interdisciplinary literature. Using three real-world case studies, we then show that simultaneously leveraging diverse methods from across science can uncover those most suitable for addressing a given problem, yielding interpretable understanding of the conceptual formulations of pairwise dependence that drive successful performance. Our framework is provided in extendable open software, enabling comprehensive data-driven analysis by integrating decades of methodological advances.


title: The Microstate Physics of JT Gravity and Supergravity

abstract: It is proposed that a complete understanding of two-dimensional quantum gravity and its emergence in random matrix models requires fully embracing {\it both} Wigner (statistics) and 't Hooft (geometry). Using non-perturbative definitions of random matrix models that yield various JT gravity and JT supergravity models on Euclidean surfaces of arbitrary topology, Fredholm determinants are used to extract precise information about the spectra of discrete microstates that underlie the physics. A core result of the computations is that in each case, the (super) Schwarzian spectrum seen at leading order is only an approximation to a new kind of spectrum that is fundamentally discrete. It is further argued that the matrix models point to a {\it single} distinguished copy of the discrete spectrum that characterizes the holographic dual of the Lorentzian (super) gravity theory. These facts suggest that the factorization puzzle is entirely resolved since the discrete spectrum underlying the Schwarzian can have a sensible quantum mechanical origin in a single theory, without an appeal to an ensemble. It is argued that more generally, double-scaled matrix models contain information about both the Lorentzian and Euclidean approaches to quantum gravity. The former comes from the Wignerian approach while the latter from the 't Hooftian 1/N topological expansion.


title: Intrinsic magnetism in superconducting infinite-layer nickelates

abstract: The discovery of superconductivity in Nd$_{0.8}$Sr$_{0.2}$NiO$_2$ [1] introduced a new family of layered nickelate superconductors that has now been extended to include a range of Sr-doping [2, 3], Pr or La in place of Nd [4-6], and the 5-layer Nd$_6$Ni$_5$O$_{12}$ [7]. A number of studies indicate that electron correlations are strong in these materials [8-14], and hence a central question is whether or not magnetism is present as a consequence of these interactions. Here we report muon spin rotation/relaxation studies of a series of superconducting infinite-layer nickelates. In all cases we observe an intrinsic magnetic ground state, regardless of the rare earth ion or doping, arising from local moments on the nickel sublattice. The coexistence of magnetism - which is likely to be antiferromagnetic and short-range ordered - with superconductivity is reminiscent of some iron pnictides [15] and heavy fermion compounds [16], and qualitatively distinct from the doped cuprates [17].


title: DICP: Doppler Iterative Closest Point Algorithm

abstract: In this paper, we present a novel algorithm for point cloud registration for range sensors capable of measuring per-return instantaneous radial velocity: Doppler ICP. Existing variants of ICP that solely rely on geometry or other features generally fail to estimate the motion of the sensor correctly in scenarios that have non-distinctive features and/or repetitive geometric structures such as hallways, tunnels, highways, and bridges. We propose a new Doppler velocity objective function that exploits the compatibility of each point's Doppler measurement and the sensor's current motion estimate. We jointly optimize the Doppler velocity objective function and the geometric objective function which sufficiently constrains the point cloud alignment problem even in feature-denied environments. Furthermore, the correspondence matches used for the alignment are improved by pruning away the points from dynamic targets which generally degrade the ICP solution. We evaluate our method on data collected from real sensors and from simulation. Our results show that with the added Doppler velocity residual terms, our method achieves a significant improvement in registration accuracy along with faster convergence, on average, when compared to classical point-to-plane ICP that solely relies on geometric residuals.


title: Learning Proximal Operators to Discover Multiple Optima

abstract: Finding multiple solutions of non-convex optimization problems is a ubiquitous yet challenging task. Most past algorithms either apply single-solution optimization methods from multiple random initial guesses or search in the vicinity of found solutions using ad hoc heuristics. We present an end-to-end method to learn the proximal operator of a family of training problems so that multiple local minima can be quickly obtained from initial guesses by iterating the learned operator, emulating the proximal-point algorithm that has fast convergence. The learned proximal operator can be further generalized to recover multiple optima for unseen problems at test time, enabling applications such as object detection. The key ingredient in our formulation is a proximal regularization term, which elevates the convexity of our training loss: by applying recent theoretical results, we show that for weakly-convex objectives with Lipschitz gradients, training of the proximal operator converges globally with a practical degree of over-parameterization. We further present an exhaustive benchmark for multi-solution optimization to demonstrate the effectiveness of our method.


title: On an approximation by Vaughan in restricted sets of arithmetic progressions

abstract: We investigate the approximation to the number of primes in arithmetic progressions given by Vaughan. Instead of averaging the expected error term over all residue classes to modules in a given range, here we only consider subsets of arithmetic progressions that satisfy additional congruence conditions and provide asymptotic approximations.


title: Elliptic Harnack Inequality for ${\mathbb{Z}}^d$

abstract: We prove the scale invariant Elliptic Harnack Inequality (EHI) for non-negative harmonic functions on ${\mathbb{Z}}^d$. The purpose of this note is to provide a simplified self-contained probabilistic proof of EHI in ${\mathbb{Z}}^d$ that is accessible at the undergraduate level. We use the Local Central Limit Theorem for simple symmetric random walks on ${\mathbb{Z}}^d$ to establish Gaussian bounds for the $n$-step probability function. The uniform Green inequality and the classical Balayage formula then imply the EHI.


title: Covariate-Adjusted Log-Rank Test: Guaranteed Efficiency Gain and Universal Applicability

abstract: Nonparametric covariate adjustment is considered for log-rank type tests of treatment effect with right-censored time-to-event data from clinical trials applying covariate-adaptive randomization. Our proposed covariate-adjusted log-rank test has a simple explicit formula and a guaranteed efficiency gain over the unadjusted test. We also show that our proposed test achieves universal applicability in the sense that the same formula of test can be universally applied to simple randomization and all commonly used covariate-adaptive randomization schemes such as the stratified permuted block and Pocock and Simon's minimization, which is not a property enjoyed by the unadjusted log-rank test. Our method is supported by novel asymptotic theory and empirical results for type I error and power of tests.


title: Higher Order Correlation Analysis for Multi-View Learning

abstract: Multi-view learning is frequently used in data science. The pairwise correlation maximization is a classical approach for exploring the consensus of multiple views. Since the pairwise correlation is inherent for two views, the extensions to more views can be diversified and the intrinsic interconnections among views are generally lost. To address this issue, we propose to maximize higher order correlations. This can be formulated as a low rank approximation problem with the higher order correlation tensor of multi-view data. We use the generating polynomial method to solve the low rank approximation problem. Numerical results on real multi-view data demonstrate that this method consistently outperforms prior existing methods.


title: Time-Series Anomaly Detection with Implicit Neural Representation

abstract: Detecting anomalies in multivariate time-series data is essential in many real-world applications. Recently, various deep learning-based approaches have shown considerable improvements in time-series anomaly detection. However, existing methods still have several limitations, such as long training time due to their complex model designs or costly tuning procedures to find optimal hyperparameters (e.g., sliding window length) for a given dataset. In our paper, we propose a novel method called Implicit Neural Representation-based Anomaly Detection (INRAD). Specifically, we train a simple multi-layer perceptron that takes time as input and outputs corresponding values at that time. Then we utilize the representation error as an anomaly score for detecting anomalies. Experiments on five real-world datasets demonstrate that our proposed method outperforms other state-of-the-art methods in performance, training speed, and robustness.


title: Non-Stationary Time Series Model for Station Based Subway Ridership During Covid-19 Pandemic (Case Study: New York City)

abstract: The COVID-19 pandemic in 2020 has caused sudden shocks in transportation systems, specifically the subway ridership patterns in New York City. Understanding the temporal pattern of subway ridership through statistical models is crucial during such shocks. However, many existing statistical frameworks may not be a good fit to analyze the ridership data sets during the pandemic since some of the modeling assumption might be violated during this time. In this paper, utilizing change point detection procedures, we propose a piece-wise stationary time series model to capture the nonstationary structure of subway ridership. Specifically, the model consists of several independent station based autoregressive integrated moving average (ARIMA) models concatenated together at certain time points. Further, data-driven algorithms are utilized to detect the changes of ridership patterns as well as to estimate the model parameters before and during the COVID-19 pandemic. The data sets of focus are daily ridership of subway stations in New York City for randomly selected stations. Fitting the proposed model to these data sets enhances our understanding of ridership changes during external shocks, both in terms of mean (average) changes as well as the temporal correlations.


title: Data-Driven Modeling of Aggregate Flexibility under Uncertain and Non-Convex Load Models

abstract: Bundling a large number of distributed energy resources through a load aggregator has been advocated as an effective means to integrate such resources into whole-sale energy markets. To ease market clearing, system operators allow aggregators to submit bidding models of simple prespecified polytopic shapes. Aggregators need to carefully design and commit to a polytope that best captures their energy flexibility along a day-ahead scheduling horizon. This work puts forth a model-informed data-based optimal flexibility design for aggregators, which deals with the time-coupled, uncertain, and non-convex models of individual loads. The proposed solution first generates efficiently a labeled dataset of (non)-disaggregatable schedules. The feasible set of the aggregator is then approximated by an ellipsoid upon training a convex quadratic classifier using the labeled dataset. The ellipsoid is subsequently inner approximated by a polytope. Using Farkas lemma, the obtained polytope is finally inner approximated by the polytopic shape dictated by the market. Numerical tests show the effectiveness of the proposed flexibility design framework for designing the feasible sets of small- and large-sized aggregators coordinating solar photovoltaics, thermostatically-controlled loads, batteries, and electric vehicles. The tests further demonstrate that it is crucial for the aggregator to consider time-coupling and uncertainties in optimal flexibility design.


title: Entangling metropolitan-distance separated quantum memories

abstract: Quantum internet gives the promise of getting all quantum resources connected, and it will enable applications far beyond a localized scenario. A prototype is a network of quantum memories that are entangled and well separated. Previous realizations are limited in the distance. In this paper, we report the establishment of remote entanglement between two atomic quantum memories physically separated by 12.5 km directly in a metropolitan area. We create atom-photon entanglement in one node and send the photon to a second node for storage. We harness low-loss transmission through a field-deployed fiber of 20.5 km by making use of frequency down-conversion and up-conversion. The final memory-memory entanglement is verified to have a fidelity of 90% via retrieving to photons. Our experiment paves the way to study quantum network applications in a practical scenario.


title: Sharp Threshold for the Frechet Mean (or Median) of Inhomogeneous Erdos-Renyi Random Graphs

abstract: We address the following foundational question: what is the population, and sample, Frechet mean (or median) graph of an ensemble of inhomogeneous Erdos-Renyi random graphs? We prove that if we use the Hamming distance to compute distances between graphs, then the Frechet mean (or median) graph of an ensemble of inhomogeneous random graphs is obtained by thresholding the expected adjacency matrix of the ensemble. We show that the result also holds for the sample mean (or median) when the population expected adjacency matrix is replaced with the sample mean adjacency matrix. Consequently, the Frechet mean (or median) graph of inhomogeneous Erdos-Renyi random graphs exhibits a sharp threshold: it is either the empty graph, or the complete graph. This novel theoretical result has some significant practical consequences; for instance, the Frechet mean of an ensemble of sparse inhomogeneous random graphs is always the empty graph.

categories: math.PR cs.LG cs.SI physics.data-an stat.ML


title: Openness of various loci over Noetherian rings

abstract: In this paper, we consider the openness of the P-locus of a finitely generated module over a commutative noetherian ring in the case where P is each of the properties FID, Gor, CM, MCM, (S_n), and (T_n). One of the main results asserts that FID-loci over an acceptable ring are open. We give a module version of the Nagata criterion, and prove that it holds for all of the aforementioned properties.


title: Observation and modelling of bound-free transitions to the $X^1\Sigma^+$ and $a^3\Sigma^+$ states of KCs

abstract: The oscillation continuum in laser-induced fluorescence spectra of bound-free $c^3\Sigma^+ \to a^3\Sigma^+$ and (4)$^1\Sigma^+ \to X^1\Sigma^+$ transitions of the KCs molecule were recorded by Fourier-transform spectrometer and modelled under the adiabatic approximation. The required interatomic potentials for ground $a^3\Sigma^+$ and $X^1\Sigma^+$ states were reconstructed in an analytical Chebishev-polynomial-expansion form in the framework of the regularization direct-potential-fit procedure based on the simultaneous consideration of experimental line positions from [R. Ferber et al, Phys. Rev. A, \textbf{80}, 062501 (2009)] and the present \emph{ab initio} calculation of short-range repulsive potential data. It was proved that the repulsive part over dissociation limit of the derived $a^3\Sigma^+$ potential reproduces the experiment better than the potentials reported in literature. It is also shown that all empirical and semi-empirical potentials available for the $X^1\Sigma^+$ state reproduce the bound-free (4)$^1\Sigma^+ \to X^1\Sigma^+$ spectrum with equal quality in the range of observations.


title: Global-Reasoned Multi-Task Learning Model for Surgical Scene Understanding

abstract: Global and local relational reasoning enable scene understanding models to perform human-like scene analysis and understanding. Scene understanding enables better semantic segmentation and object-to-object interaction detection. In the medical domain, a robust surgical scene understanding model allows the automation of surgical skill evaluation, real-time monitoring of surgeon's performance and post-surgical analysis. This paper introduces a globally-reasoned multi-task surgical scene understanding model capable of performing instrument segmentation and tool-tissue interaction detection. Here, we incorporate global relational reasoning in the latent interaction space and introduce multi-scale local (neighborhood) reasoning in the coordinate space to improve segmentation. Utilizing the multi-task model setup, the performance of the visual-semantic graph attention network in interaction detection is further enhanced through global reasoning. The global interaction space features from the segmentation module are introduced into the graph network, allowing it to detect interactions based on both node-to-node and global interaction reasoning. Our model reduces the computation cost compared to running two independent single-task models by sharing common modules, which is indispensable for practical applications. Using a sequential optimization technique, the proposed multi-task model outperforms other state-of-the-art single-task models on the MICCAI endoscopic vision challenge 2018 dataset. Additionally, we also observe the performance of the multi-task model when trained using the knowledge distillation technique. The official code implementation is made available in GitHub.


title: On maximum Wiener index of directed grids

abstract: This paper is devoted to Wiener index of directed graphs, more precisely of directed grids. The grid $G_{m,n}$ is the Cartesian product $P_m\Box P_n$ of paths on $m$ and $n$ vertices, and in a particular case when $m=2$, it is a called the ladder graph $L_n$. Kraner \v{S}umenjak et al. proved that the maximum Wiener index of a digraph, which is obtained by orienting the edges of $L_n$, is obtained when all layers isomorphic to one factor are directed paths directed in the same way except one (corresponding to an endvertex of the other factor) which is a directed path directed in the opposite way. Then they conjectured that the natural generalization of this orientation to $G_{m,n}$ will attain the maximum Wiener index among all orientations of $G_{m,n}$. In this paper we disprove the conjecture by showing that a comb-like orientation of $G_{m,n}$ has significiantly bigger Wiener index.


title: Monolithically integrated waveguide-coupled single-frequency microlaser on erbium-doped thin film lithium niobate

abstract: We overcome the difficulty in realizing a monolithic waveguide-coupled microring laser integrated on erbium-doped thin film lithium niobate (Er: TFLN) using photolithography assisted chemo-mechanical etching (PLACE) technique. We demonstrate an integrated single-frequency microring laser operating around 1531 nm wavelength. The PLACE technique, enabling integrated Er: TFLN photonics with low propagation loss, can thus be used to realize low cost mass production of monolithic on-chip microlasers with applications ranging from optical communication and photonic integrated circuit (PIC) to precision metrology and large-scale sensing.


title: Optimum ratio between two bases in Bennett-Brassard 1984 protocol with second order analysis

abstract: Bennet-Brassard 1984 (BB84) protocol, we optimize the ratio of the choice of two bases, the bit basis and the phase basis by using the second order expansion for the length of the generation keys under the coherent attack. This optimization addresses the trade-off between the loss of transmitted bits due to the disagreement of their bases and the estimation error of the error rate in the phase basis. Then, we derive the optimum ratio and the optimum length of the generation keys with the second order asymptotics. Surprisingly, the second order has the order $n^{3/4}$, which is much larger than the second order $n^{1/2}$ in the conventional setting when $n$ is the number of quantum communication. This fact shows that our setting has much larger importance for the second order analysis than the conventional problem. To illustrate this importance, we numerically plot the effect of the second order correction.


title: Chromospheric emission from nanoflare heating in RADYN simulations

abstract: Heating signatures from small-scale magnetic reconnection events in the solar atmosphere have proven to be difficult to detect through observations. Numerical models that reproduce flaring conditions are essential in the understanding of how nanoflares may act as a heating mechanism of the corona. We study the effects of non-thermal electrons in synthetic spectra from 1D hydrodynamic RADYN simulations of nanoflare heated loops to investigate the diagnostic potential of chromospheric emission from small-scale events. The Mg II h and k, Ca II H and K, Ca II 854.2 nm, H-alpha and H-beta chromospheric lines were synthesised from various RADYN models of coronal loops subject to electron beams of nanoflare energies. The contribution function to the line intensity was computed to better understand how the atmospheric response to the non-thermal electrons affects the formation of spectral lines and the detailed shape of their spectral profiles. The spectral line signatures arising from the electron beams highly depend on the density of the loop and the lower cutoff energy of the electrons. Low-energy (5 keV) electrons deposit their energy in the corona and transition region, producing strong plasma flows that cause both redshifts and blueshifts of the chromospheric spectra. Higher-energy (10 and 15 keV) electrons deposit their energy in the lower transition region and chromosphere, resulting in increased emission from local heating. Our results indicate that effects from small-scale events can be observed with ground-based telescopes, expanding the list of possible diagnostics for the presence and properties of nanoflares.


title: Risk-Sensitive Optimal Execution via a Conditional Value-at-Risk Objective

abstract: We consider a liquidation problem in which a risk-averse trader tries to liquidate a fixed quantity of an asset in the presence of market impact and random price fluctuations. The trader encounters a trade-off between the transaction costs incurred due to market impact and the volatility risk of holding the position. Our formulation begins with a continuous-time and infinite horizon variation of the seminal model of Almgren and Chriss (2000), but we define as the objective the conditional value-at-risk (CVaR) of the implementation shortfall, and allow for dynamic (adaptive) trading strategies. In this setting, we are able to derive closed-form expressions for the optimal liquidation strategy and its value function. Our results yield a number of important practical insights. We are able to quantify the benefit of adaptive policies over optimized static policies. The relevant improvement depends only on the level of risk aversion: for moderate levels of risk aversion, the optimal dynamic policy outperforms the optimal static policy by 5-15%, and outperforms the optimal volume weighted average price (VWAP) policy by 15-25%. This improvement is achieved through dynamic policies that exhibit "aggressiveness-in-the-money": trading is accelerated when price movements are favorable, and is slowed when price movements are unfavorable. From a mathematical perspective, our analysis exploits the dual representation of CVaR to convert the problem to a continuous-time, zero-sum game. We leverage the idea of the state-space augmentation, and obtain a partial differential equation describing the optimal value function, which is separable and a special instance of the Emden-Fowler equation. This leads to a closed-form solution. As our problem is a special case of a linear-quadratic-Gaussian control problem with a CVaR objective, these results may be interesting in broader settings.


title: Shuffle Augmentation of Features from Unlabeled Data for Unsupervised Domain Adaptation

abstract: Unsupervised Domain Adaptation (UDA), a branch of transfer learning where labels for target samples are unavailable, has been widely researched and developed in recent years with the help of adversarially trained models. Although existing UDA algorithms are able to guide neural networks to extract transferable and discriminative features, classifiers are merely trained under the supervision of labeled source data. Given the inevitable discrepancy between source and target domains, the classifiers can hardly be aware of the target classification boundaries. In this paper, Shuffle Augmentation of Features (SAF), a novel UDA framework, is proposed to address the problem by providing the classifier with supervisory signals from target feature representations. SAF learns from the target samples, adaptively distills class-aware target features, and implicitly guides the classifier to find comprehensive class borders. Demonstrated by extensive experiments, the SAF module can be integrated into any existing adversarial UDA models to achieve performance improvements.


title: Dynamic Temporal Reconciliation by Reinforcement learning

abstract: Planning based on long and short term time series forecasts is a common practice across many industries. In this context, temporal aggregation and reconciliation techniques have been useful in improving forecasts, reducing model uncertainty, and providing a coherent forecast across different time horizons. However, an underlying assumption spanning all these techniques is the complete availability of data across all levels of the temporal hierarchy, while this offers mathematical convenience but most of the time low frequency data is partially completed and it is not available while forecasting. On the other hand, high frequency data can significantly change in a scenario like the COVID pandemic and this change can be used to improve forecasts that will otherwise significantly diverge from long term actuals. We propose a dynamic reconciliation method whereby we formulate the problem of informing low frequency forecasts based on high frequency actuals as a Markov Decision Process (MDP) allowing for the fact that we do not have complete information about the dynamics of the process. This allows us to have the best long term estimates based on the most recent data available even if the low frequency cycles have only been partially completed. The MDP has been solved using a Time Differenced Reinforcement learning (TDRL) approach with customizable actions and improves the long terms forecasts dramatically as compared to relying solely on historical low frequency data. The result also underscores the fact that while low frequency forecasts can improve the high frequency forecasts as mentioned in the temporal reconciliation literature (based on the assumption that low frequency forecasts have lower noise to signal ratio) the high frequency forecasts can also be used to inform the low frequency forecasts.


title: Provably Efficient Primal-Dual Reinforcement Learning for CMDPs with Non-stationary Objectives and Constraints

abstract: We consider primal-dual-based reinforcement learning (RL) in episodic constrained Markov decision processes (CMDPs) with non-stationary objectives and constraints, which plays a central role in ensuring the safety of RL in time-varying environments. In this problem, the reward/utility functions and the state transition functions are both allowed to vary arbitrarily over time as long as their cumulative variations do not exceed certain known variation budgets. Designing safe RL algorithms in time-varying environments is particularly challenging because of the need to integrate the constraint violation reduction, safe exploration, and adaptation to the non-stationarity. To this end, we identify two alternative conditions on the time-varying constraints under which we can guarantee the safety in the long run. We also propose the \underline{P}eriodically \underline{R}estarted \underline{O}ptimistic \underline{P}rimal-\underline{D}ual \underline{P}roximal \underline{P}olicy \underline{O}ptimization (PROPD-PPO) algorithm that can coordinate with both two conditions. Furthermore, a dynamic regret bound and a constraint violation bound are established for the proposed algorithm in both the linear kernel CMDP function approximation setting and the tabular CMDP setting under two alternative conditions. This paper provides the first provably efficient algorithm for non-stationary CMDPs with safe exploration.


title: The effect of B-site alloying on the electronic and opto-electronic properties of RbPbI3: A DFT study

abstract: Divalent cations mixed lead halide perovskites with enhanced performances, high stabilities, and reduced toxicity are requisite to make persistent progress in perovskite solar cells. However, the mixing strategy is not reported extensively in search of a lead reduced structure. Herein, we report the structural, electronic and optical properties of RbPb{1-x}MxI3 (where, M={Sn,Ge} and x={0.25, 0.50, 0.75}) by alloying the B-site with Sn and Ge, using the density functional theory. The formation enthalpy is estimated for all RbPb{1-x}MxI3 (with x= 0.25, 0.50, 0.75), which confirms stability for all the structures. The energy bandgap and density of states (DOS) have been thoroughly investigated. The energy bandgap decreases with the increasing Sn/Ge contents, the lowest bandgap of 1.850 eV is observed at x = 0.50 in the case of RbPb{1-x}GexI3 systems. Further, the effective masses and the binding energy of excitons and spectroscopic limited maximum efficiency (SLME) are also estimated for all the mixed systems. The exciton type is observed to change from Mott-Wannier to Frenkel type with increasing the contents of both Sn and Ge at the B-site. The maximum efficiency of 23% is achieved using an active layer containing an equal admixture of Sn/Ge and Pb. The estimated parameters of both the mixed systems are consistent with the available literature of similar types.


title: Pseudo-Differential Neural Operator: Generalized Fourier Neural Operator for Learning Solution Operators of Partial Differential Equations

abstract: Learning the mapping between two function spaces has garnered considerable research attention. However, learning the solution operator of partial differential equations (PDEs) remains a challenge in scientific computing. Fourier neural operator (FNO) was recently proposed to learn solution operators, and it achieved an excellent performance. In this study, we propose a novel \textit{pseudo-differential integral operator} (PDIO) to analyze and generalize the Fourier integral operator in FNO. PDIO is inspired by a pseudo-differential operator, which is a generalized differential operator characterized by a certain symbol. We parameterize this symbol using a neural network and demonstrate that the neural network-based symbol is contained in a smooth symbol class. Subsequently, we verify that the PDIO is a bounded linear operator, and thus is continuous in the Sobolev space. We combine the PDIO with the neural operator to develop a \textit{pseudo-differential neural operator} (PDNO) and learn the nonlinear solution operator of PDEs. We experimentally validate the effectiveness of the proposed model by utilizing Darcy flow and the Navier-Stokes equation. The obtained results indicate that the proposed PDNO outperforms the existing neural operator approaches in most experiments.


title: Training invariances and the low-rank phenomenon: beyond linear networks

abstract: The implicit bias induced by the training of neural networks has become a topic of rigorous study. In the limit of gradient flow and gradient descent with appropriate step size, it has been shown that when one trains a deep linear network with logistic or exponential loss on linearly separable data, the weights converge to rank-1 matrices. In this paper, we extend this theoretical result to the last few linear layers of the much wider class of nonlinear ReLU-activated feedforward networks containing fully-connected layers and skip connections. Similar to the linear case, the proof relies on specific local training invariances, sometimes referred to as alignment, which we show to hold for submatrices where neurons are stably-activated in all training examples, and it reflects empirical results in the literature. We also show this is not true in general for the full matrix of ReLU fully-connected layers. Our proof relies on a specific decomposition of the network into a multilinear function and another ReLU network whose weights are constant under a certain parameter directional convergence.


title: Approximately Equivariant Networks for Imperfectly Symmetric Dynamics

abstract: Incorporating symmetry as an inductive bias into neural network architecture has led to improvements in generalization, data efficiency, and physical consistency in dynamics modeling. Methods such as CNNs or equivariant neural networks use weight tying to enforce symmetries such as shift invariance or rotational equivariance. However, despite the fact that physical laws obey many symmetries, real-world dynamical data rarely conforms to strict mathematical symmetry either due to noisy or incomplete data or to symmetry breaking features in the underlying dynamical system. We explore approximately equivariant networks which are biased towards preserving symmetry but are not strictly constrained to do so. By relaxing equivariance constraints, we find that our models can outperform both baselines with no symmetry bias and baselines with overly strict symmetry in both simulated turbulence domains and real-world multi-stream jet flow.


title: Random walks on complex networks under node-dependent stochastic resetting

abstract: In the present work, we study random walks on complex networks subject to stochastic resetting when the resetting probability is node-dependent. Using a renewal approach, we derive the exact expressions of the stationary occupation probabilities of the walker on each node and the mean first passage time between arbitrary two nodes. Finally, we demonstrate our theoretical results on three networks with two different resetting protocols, validated by numerical simulations as well. We find that under a delicate setting it is advantageous to optimize the efficiency of a global search on such networks by the node-dependent resetting probability.


title: The Coleman-Oort conjecture: reduction to three key cases

abstract: We show that the Coleman-Oort conjecture can be reduced to three particular cases. As an application we extend a result of Lu and Zuo, to the effect that for g at least 8 the Coleman-Oort conjecture is true on the hyperelliptic locus.


title: DiffGAN-TTS: High-Fidelity and Efficient Text-to-Speech with Denoising Diffusion GANs

abstract: Denoising diffusion probabilistic models (DDPMs) are expressive generative models that have been used to solve a variety of speech synthesis problems. However, because of their high sampling costs, DDPMs are difficult to use in real-time speech processing applications. In this paper, we introduce DiffGAN-TTS, a novel DDPM-based text-to-speech (TTS) model achieving high-fidelity and efficient speech synthesis. DiffGAN-TTS is based on denoising diffusion generative adversarial networks (GANs), which adopt an adversarially-trained expressive model to approximate the denoising distribution. We show with multi-speaker TTS experiments that DiffGAN-TTS can generate high-fidelity speech samples within only 4 denoising steps. We present an active shallow diffusion mechanism to further speed up inference. A two-stage training scheme is proposed, with a basic TTS acoustic model trained at stage one providing valuable prior information for a DDPM trained at stage two. Our experiments show that DiffGAN-TTS can achieve high synthesis performance with only 1 denoising step.


title: R-factor analysis of data generated by a combination of R- and Q-factors leads to biased loading estimates

abstract: Effects of performing R-factor analysis of observed variables based on population models comprising R- and Q-factors were investigated. It was noted that estimating a model comprising R- and Q-factors has to face loading indeterminacy beyond rotational indeterminacy. Although R-factor analysis of data based on a population model comprising R- and Q-factors is nevertheless possible, this may lead to model error. Accordingly, even in the population, the resulting R-factor loadings are not necessarily close estimates of the original population R-factor loadings. It was shown in a simulation study that large Q-factor variance induces an increase of the variation of R-factor loading estimates beyond chance level. The results indicate that performing R-factor analysis with data based on a population model comprising R- and Q-factors may result in substantial loading bias. Tests of the multivariate kurtosis of observed variables are proposed as an indicator of possible Q-factor variance in observed variables as a prerequisite for R-factor analysis.


title: Bialgebras in cointeraction, the antipode and the eulerian idempotent

abstract: We give here a review of results about double bialgebras, that is to say bialgebras with two coproducts, the first one being a comodule morphism for the coaction induced by the second one. An accent is put on the case of connected bialgebras. The subjects of these results are the monoid of characters and their actions, polynomial invariants, the antipode and the eulerian idempotent. As examples, they are applied on a double bialgebra of graphs and on quasishuffle bialgebras. This includes a new proof of a combinatorial interpretation of the coefficients of the chromatic polynomial due to Greene and Zaslavsky.


title: Generalized Visual Quality Assessment of GAN-Generated Face Images

abstract: Recent years have witnessed the dramatically increased interest in face generation with generative adversarial networks (GANs). A number of successful GAN algorithms have been developed to produce vivid face images towards different application scenarios. However, little work has been dedicated to automatic quality assessment of such GAN-generated face images (GFIs), even less have been devoted to generalized and robust quality assessment of GFIs generated with unseen GAN model. Herein, we make the first attempt to study the subjective and objective quality towards generalized quality assessment of GFIs. More specifically, we establish a large-scale database consisting of GFIs from four GAN algorithms, the pseudo labels from image quality assessment (IQA) measures, as well as the human opinion scores via subjective testing. Subsequently, we develop a quality assessment model that is able to deliver accurate quality predictions for GFIs from both available and unseen GAN algorithms based on meta-learning. In particular, to learn shared knowledge from GFIs pairs that are born of limited GAN algorithms, we develop the convolutional block attention (CBA) and facial attributes-based analysis (ABA) modules, ensuring that the learned knowledge tends to be consistent with human visual perception. Extensive experiments exhibit that the proposed model achieves better performance compared with the state-of-the-art IQA models, and is capable of retaining the effectiveness when evaluating GFIs from the unseen GAN algorithms.


title: Learning to Simulate Unseen Physical Systems with Graph Neural Networks

abstract: Simulation of the dynamics of physical systems is essential to the development of both science and engineering. Recently there is an increasing interest in learning to simulate the dynamics of physical systems using neural networks. However, existing approaches fail to generalize to physical substances not in the training set, such as liquids with different viscosities or elastomers with different elasticities. Here we present a machine learning method embedded with physical priors and material parameters, which we term as "Graph-based Physics Engine" (GPE), to efficiently model the physical dynamics of different substances in a wide variety of scenarios. We demonstrate that GPE can generalize to materials with different properties not seen in the training set and perform well from single-step predictions to multi-step roll-out simulations. In addition, introducing the law of momentum conservation in the model significantly improves the efficiency and stability of learning, allowing convergence to better models with fewer training steps.


title: On some new results on anisotropic singular perturbations of second order elliptic operators

abstract: In this article, we deal with some problems involving a class of singularly perturbed elliptic operator. We prove the asymptotic preserving of a general Galerkin method associated to a semilinear problem. We use a particular Galerkin approximation to estimate the convergence rate on the whole domain, for the linear problem. Finally, we study the asymptotic behavior of the semigroup generated.


title: Testable Array Multipliers for a Better Utilization of C-Testability and Bijectivity

abstract: This paper presents a design for test (DFT)architecture for fast and scalable testing of array multipliers (MULTs). Regardless of the MULT size, our proposed testable architecture, without major changes in the original architecture, requires only five test vectors. Test pattern generation (TPG) is done by combining C-testability, bijectivity and deterministic TPG methods. Experimental results show 100% fault coverage for single stuck-at faults. The proposed method requires minor testability hardware insertion into the multiplier with extra delay and area overhead of less than 0.5% for a 64-bit multiplier.


title: Using hyper-optimized tensor networks and first-principles electronic structure to simulate experimental properties of the giant {Mn84} torus

abstract: The single-molecule magnet {Mn84} is a challenge to theory due to its high nuclearity. Building on our prior work which characterized the structure of the spectrum of this magnet, we directly compute two experimentally accessible observables, the field-dependent magnetization up to 75 T and the temperature-dependent heat capacity, using parameter free theory. In particular, we use first principles calculations to derive short- and long-range exchange interactions, while we compute the exact partition function of the resulting classical Potts and Ising spin models for all 84 Mn $S=2$ spins to obtain the observables. The latter computation is possible because of a simulation methodology that uses hyper-optimized tensor network contraction, borrowing from recent techniques developed to simulate quantum supremacy circuits. We also synthesize the magnet and measure its heat capacity and field-dependent magnetization. We observe good qualitative agreement between theory and experiment, identifying an unusual peak in the heat capacity in both, as well as a plateau in the magnetization. Our work also identifies some limitations of current theoretical modeling in large magnets, such as the sensitivity to small, long-range, exchange couplings.


title: Differential Privacy Guarantees for Stochastic Gradient Langevin Dynamics

abstract: We analyse the privacy leakage of noisy stochastic gradient descent by modeling R\'enyi divergence dynamics with Langevin diffusions. Inspired by recent work on non-stochastic algorithms, we derive similar desirable properties in the stochastic setting. In particular, we prove that the privacy loss converges exponentially fast for smooth and strongly convex objectives under constant step size, which is a significant improvement over previous DP-SGD analyses. We also extend our analysis to arbitrary sequences of varying step sizes and derive new utility bounds. Last, we propose an implementation and our experiments show the practical utility of our approach compared to classical DP-SGD libraries.


title: Transfering Hierarchical Structure with Dual Meta Imitation Learning

abstract: Hierarchical Imitation Learning (HIL) is an effective way for robots to learn sub-skills from long-horizon unsegmented demonstrations. However, the learned hierarchical structure lacks the mechanism to transfer across multi-tasks or to new tasks, which makes them have to learn from scratch when facing a new situation. Transferring and reorganizing modular sub-skills require fast adaptation ability of the whole hierarchical structure. In this work, we propose Dual Meta Imitation Learning (DMIL), a hierarchical meta imitation learning method where the high-level network and sub-skills are iteratively meta-learned with model-agnostic meta-learning. DMIL uses the likelihood of state-action pairs from each sub-skill as the supervision for the high-level network adaptation, and use the adapted high-level network to determine different data set for each sub-skill adaptation. We theoretically prove the convergence of the iterative training process of DMIL and establish the connection between DMIL and Expectation-Maximization algorithm. Empirically, we achieve state-of-the-art few-shot imitation learning performance on the Meta-world \cite{metaworld} benchmark and competitive results on long-horizon tasks of Kitchen environments.


title: Hydrodynamic behavior of the 2-TASEP

abstract: We address the question of the large scale or hydrodynamic behavior of a 2-species generalization of TASEP (2-TASEP), consisting of two kinds of particles, moving in opposite directions and swapping their positions. We compute the rarefaction and shock solutions of the hydrodynamic equations of the model, showing that these equations form a Temple class system. We solve completely the Riemann problem and compare the theoretical prediction to Monte Carlo simulations.


title: Inertial Navigation Using an Inertial Sensor Array

abstract: We present a comprehensive framework for fusing measurements from multiple and generally placed accelerometers and gyroscopes to perform inertial navigation. Using the angular acceleration provided by the accelerometer array, we show that the numerical integration of the orientation can be done with second-order accuracy, which is more accurate compared to the traditional first-order accuracy that can be achieved when only using the gyroscopes. Since orientation errors are the most significant error source in inertial navigation, improving the orientation estimation reduces the overall navigation error. The practical performance benefit depends on prior knowledge of the inertial sensor array, and therefore we present four different state-space models using different underlying assumptions regarding the orientation modeling. The models are evaluated using a Lie Group Extended Kalman filter through simulations and real-world experiments. We also show how individual accelerometer biases are unobservable and can be replaced by a six-dimensional bias term whose dimension is fixed and independent of the number of accelerometers.


title: The need for and feasibility of alternative ground robots to traverse sandy and rocky extraterrestrial terrain

abstract: Robotic spacecraft have helped expand our reach for many planetary exploration missions. Most ground mobile planetary exploration robots use wheeled or modified wheeled platforms. Although extraordinarily successful at completing intended mission goals, because of the limitations of wheeled locomotion, they have been largely limited to benign, solid terrain and avoided extreme terrain with loose soil/sand and large rocks. Unfortunately, such challenging terrain is often scientifically interesting for planetary geology. Although many animals traverse such terrain at ease, robots have not matched their performance and robustness. This is in major part due to a lack of fundamental understanding of how effective locomotion can be generated from controlled interaction with complex terrain on the same level of flight aerodynamics and underwater vehicle hydrodynamics. Early fundamental understanding of legged and limbless locomotor-ground interaction has already enabled stable and efficient bio-inspired robot locomotion on relatively flat ground with small obstacles. Recent progress in the new field of terradynamics of locomotor-terrain interaction begins to reveal the principles of bio-inspired locomotion on loose soil/sand and over large obstacles. Multi-legged and limbless platforms using terradynamics insights hold the promise for serving as robust alternative platforms for traversing extreme extraterrestrial terrain and expanding our reach in planetary exploration.


title: On nonexistence of solutions to some time-space fractional evolution equations with transformed space argument

abstract: Some results on nonexistence of nontrivial solutions to some time and space fractional differential evolution equations with transformed space argument are obtained via the nonlinear capacity method. The analysis is then used for a $2\times 2$ system of equations with transformed space arguments.


title: Gradient Masked Averaging for Federated Learning

abstract: Federated learning (FL) is an emerging paradigm that permits a large number of clients with heterogeneous data to coordinate learning of a unified global model without the need to share data amongst each other. A major challenge in federated learning is the heterogeneity of data across client, which can degrade the performance of standard FL algorithms. Standard FL algorithms involve averaging of model parameters or gradient updates to approximate the global model at the server. However, we argue that in heterogeneous settings, averaging can result in information loss and lead to poor generalization due to the bias induced by dominant client gradients. We hypothesize that to generalize better across non-i.i.d datasets, the algorithms should focus on learning the invariant mechanism that is constant while ignoring spurious mechanisms that differ across clients. Inspired from recent works in Out-of-Distribution generalization, we propose a gradient masked averaging approach for FL as an alternative to the standard averaging of client updates. This aggregation technique for client updates can be adapted as a drop-in replacement in most existing federated algorithms. We perform extensive experiments on multiple FL algorithms with in-distribution, real-world, feature-skewed out-of-distribution, and quantity imbalanced datasets and show that it provides consistent improvements, particularly in the case of heterogeneous clients.


title: Computer-aided Recognition and Assessment of a Porous Bioelastomer on Ultrasound Images for Regenerative Medicine Applications

abstract: Biodegradable elastic scaffolds have attracted more and more attention in the field of soft tissue repair and tissue engineering. These scaffolds made of porous bioelastomers support tissue ingrowth along with their own degradation. It is necessary to develop a computer-aided analyzing method based on ultrasound images to identify the degradation performance of the scaffold, not only to obviate the need to do destructive testing, but also to monitor the scaffold's degradation and tissue ingrowth over time. It is difficult using a single traditional image processing algorithm to extract continuous and accurate contour of a porous bioelastomer. This paper proposes a joint algorithm for the bioelastomer's contour detection and a texture feature extraction method for monitoring the degradation behavior of the bioelastomer. Mean-shift clustering method is used to obtain the bioelastomer's and native tissue's clustering feature information. Then the OTSU image binarization method automatically selects the optimal threshold value to convert the grayscale ultrasound image into a binary image. The Canny edge detector is used to extract the complete bioelastomer's contour. The first-order and second-order statistical features of texture are extracted. The proposed joint algorithm not only achieves the ideal extraction of the bioelastomer's contours in ultrasound images, but also gives valuable feedback of the degradation behavior of the bioelastomer at the implant site based on the changes of texture characteristics and contour area. The preliminary results of this study suggest that the proposed computer-aided image processing techniques have values and potentials in the non-invasive analysis of tissue scaffolds in vivo based on ultrasound images and may help tissue engineers evaluate the tissue scaffold's degradation and cellular ingrowth progress and improve the scaffold designs.


title: Symmetry and monotonicity results for solutions of semilinear PDEs in sector-like domains

abstract: In this manuscript we consider semilinear PDEs, with a convex nonlinearity, in a sector-like domain. Using cylindrical coordinates $(r, \theta, z)$, we investigate the shape of solutions whose derivative in $\theta$ vanishes at the boundary. We prove that any solution with Morse index less than two must be either independent of $\theta$ or strictly monotone with respect to $\theta$. In the special case of a planar domain, the result holds in a circular sector as well as in an annular, and it can also be extended to a rectangular domain. The corresponding problem in higher dimensions is also considered, as well as an extension to unbounded domains. The proof is based on a rotating-plane argument: a convenient manifold is introduced in order to avoid overlapping the domain with its reflected image in the case when its opening is larger than $\pi$.


title: Existence and Estimation of Critical Batch Size for Training Generative Adversarial Networks with Two Time-Scale Update Rule

abstract: Previous results have shown that a two time-scale update rule (TTUR) using different learning rates, such as different constant rates or different decaying rates, is useful for training generative adversarial networks (GANs) in theory and in practice. Moreover, not only the learning rate but also the batch size is important for training GANs with TTURs and they both affect the number of steps needed for training. This paper studies the relationship between batch size and the number of steps needed for training GANs with TTURs based on constant learning rates. We theoretically show that, for a TTUR with constant learning rates, the number of steps needed to find stationary points of the loss functions of both the discriminator and generator decreases as the batch size increases and that there exists a critical batch size minimizing the stochastic first-order oracle (SFO) complexity. Then, we use the Fr'echet inception distance (FID) as the performance measure for training and provide numerical results indicating that the number of steps needed to achieve a low FID score decreases as the batch size increases and that the SFO complexity increases once the batch size exceeds the measured critical batch size. Moreover, we show that measured critical batch sizes are close to the sizes estimated from our theoretical results.


title: Using DeepSpeed and Megatron to Train Megatron-Turing NLG 530B, A Large-Scale Generative Language Model

abstract: Pretrained general-purpose language models can achieve state-of-the-art accuracies in various natural language processing domains by adapting to downstream tasks via zero-shot, few-shot and fine-tuning techniques. Because of their success, the size of these models has increased rapidly, requiring high-performance hardware, software, and algorithmic techniques to enable training such large models. As the result of a joint effort between Microsoft and NVIDIA, we present details on the training of the largest monolithic transformer based language model, Megatron-Turing NLG 530B (MT-NLG), with 530 billion parameters. In this paper, we first focus on the infrastructure as well as the 3D parallelism methodology used to train this model using DeepSpeed and Megatron. Next, we detail the training process, the design of our training corpus, and our data curation techniques, which we believe is a key ingredient to the success of the model. Finally, we discuss various evaluation results, as well as other interesting observations and new properties exhibited by MT-NLG. We demonstrate that MT-NLG achieves superior zero-, one-, and few-shot learning accuracies on several NLP benchmarks and establishes new state-of-the-art results. We believe that our contributions will help further the development of large-scale training infrastructures, large-scale language models, and natural language generations.


title: A Universal Machine Learning Model for Elemental Grain Boundary Energies

abstract: The grain boundary (GB) energy has a profound influence on the grain growth and properties of polycrystalline metals. Here, we show that the energy of a GB, normalized by the bulk cohesive energy, can be described purely by four geometric features. By machine learning on a large computed database of 361 small $\Sigma$ ($\Sigma < 10$) GBs of more than 50 metals, we develop a model that can predict the grain boundary energies to within a mean absolute error of 0.13 J m$^{-2}$. More importantly, this universal GB energy model can be extrapolated to the energies of high $\Sigma$ GBs without loss in accuracy. These results highlight the importance of capturing fundamental scaling physics and domain knowledge in the design of interpretable, extrapolatable machine learning models for materials science.


title: Half-space depth of log-concave probability measures

abstract: Given a probability measure $\mu $ on ${\mathbb R}^n$, Tukey's half-space depth is defined for any $x\in {\mathbb R}^n$ by $\varphi_{\mu }(x)=\inf\{\mu (H):H\in {\cal H}(x)\}$, where ${\cal H}(x)$ is the set of all half-spaces $H$ of ${\mathbb R}^n$ containing $x$. We show that if $\mu $ is log-concave then $$e^{-c_1n}\leq \int_{\mathbb{R}^n}\varphi_{\mu }(x)\,d\mu(x) \leq e^{-c_2n/L_{\mu}^2}$$ where $L_{\mu }$ is the isotropic constant of $\mu $ and $c_1,c_2>0$ are absolute constants. The proofs combine large deviations techniques with a number of facts from the theory of $L_q$-centroid bodies of log-concave probability measures. The same ideas lead to general estimates for the expected measure of random polytopes whose vertices have a log-concave distribution.


title: Adaptive Nonlinear Optimization of District Heating Networks Based on Model and Discretization Catalogs

abstract: We propose an adaptive optimization algorithm for operating district heating networks in a stationary regime. The behavior of hot water flow in the pipe network is modeled using the incompressible Euler equations and a suitably chosen energy equation. By applying different simplifications to these equations, we derive a catalog of models. Our algorithm is based on this catalog and adaptively controls where in the network which model is used. Moreover, the granularity of the applied discretization is controlled in a similar adaptive manner. By doing so, we are able to obtain optimal solutions at low computational costs that satisfy a prescribed tolerance w.r.t. the most accurate modeling level. To adaptively control the switching between different levels and the adaptation of the discretization grids, we derive error measure formulas and a posteriori error measure estimators. Under reasonable assumptions we prove that the adaptive algorithm terminates after finitely many iterations. Our numerical results show that the algorithm is able to produce solutions for problem instances that have not been solvable before.


title: FCMNet: Full Communication Memory Net for Team-Level Cooperation in Multi-Agent Systems

abstract: Decentralized cooperation in partially-observable multi-agent systems requires effective communications among agents. To support this effort, this work focuses on the class of problems where global communications are available but may be unreliable, thus precluding differentiable communication learning methods. We introduce FCMNet, a reinforcement learning based approach that allows agents to simultaneously learn a) an effective multi-hop communications protocol and b) a common, decentralized policy that enables team-level decision-making. Specifically, our proposed method utilizes the hidden states of multiple directional recurrent neural networks as communication messages among agents. Using a simple multi-hop topology, we endow each agent with the ability to receive information sequentially encoded by every other agent at each time step, leading to improved global cooperation. We demonstrate FCMNet on a challenging set of StarCraft II micromanagement tasks with shared rewards, as well as a collaborative multi-agent pathfinding task with individual rewards. There, our comparison results show that FCMNet outperforms state-of-the-art communication-based reinforcement learning methods in all StarCraft II micromanagement tasks, and value decomposition methods in certain tasks. We further investigate the robustness of FCMNet under realistic communication disturbances, such as random message loss or binarized messages (i.e., non-differentiable communication channels), to showcase FMCNet's potential applicability to robotic tasks under a variety of real-world conditions.


title: Hybrid Contrastive Learning with Cluster Ensemble for Unsupervised Person Re-identification

abstract: Unsupervised person re-identification (ReID) aims to match a query image of a pedestrian to the images in gallery set without supervision labels. The most popular approaches to tackle unsupervised person ReID are usually performing a clustering algorithm to yield pseudo labels at first and then exploit the pseudo labels to train a deep neural network. However, the pseudo labels are noisy and sensitive to the hyper-parameter(s) in clustering algorithm. In this paper, we propose a Hybrid Contrastive Learning (HCL) approach for unsupervised person ReID, which is based on a hybrid between instance-level and cluster-level contrastive loss functions. Moreover, we present a Multi-Granularity Clustering Ensemble based Hybrid Contrastive Learning (MGCE-HCL) approach, which adopts a multi-granularity clustering ensemble strategy to mine priority information among the pseudo positive sample pairs and defines a priority-weighted hybrid contrastive loss for better tolerating the noises in the pseudo positive samples. We conduct extensive experiments on two benchmark datasets Market-1501 and DukeMTMC-reID. Experimental results validate the effectiveness of our proposals.