title: Low Curvature Activations Reduce Overfitting in Adversarial Training

abstract: Adversarial training is one of the most effective defenses against adversarial attacks. Previous works suggest that overfitting is a dominant phenomenon in adversarial training leading to a large generalization gap between test and train accuracy in neural networks. In this work, we show that the observed generalization gap is closely related to the choice of the activation function. In particular, we show that using activation functions with low (exact or approximate) curvature values has a regularization effect that significantly reduces both the standard and robust generalization gaps in adversarial training. We observe this effect for both differentiable/smooth activations such as SiLU as well as non-differentiable/non-smooth activations such as LeakyReLU. In the latter case, the "approximate" curvature of the activation is low. Finally, we show that for activation functions with low curvature, the double descent phenomenon for adversarially trained models does not occur.


title: Unified Shapley Framework to Explain Prediction Drift

abstract: Predictions are the currency of a machine learning model, and to understand the model's behavior over segments of a dataset, or over time, is an important problem in machine learning research and practice. There currently is no systematic framework to understand this drift in prediction distributions over time or between two semantically meaningful slices of data, in terms of the input features and points. We propose GroupShapley and GroupIG (Integrated Gradients), as axiomatically justified methods to tackle this problem. In doing so, we re-frame all current feature/data importance measures based on the Shapley value as essentially problems of distributional comparisons, and unify them under a common umbrella. We axiomatize certain desirable properties of distributional difference, and study the implications of choosing them empirically.


title: Relations between growth of entire functions and behavior of its Taylor coefficients

abstract: We derive in the closed and unimprovable form the bilateral non-asymptotic relations between growth of entire functions and decay rate at infinity of its Taylor coefficients. We investigate the functions of one as well as of several complex variables. We will apply the convex analysis: Young-Fenchel (Legendre) transform, Young inequality, saddle-point method etc.


title: Browselite: A Private Data Saving Solution for the Web

abstract: The median webpage has increased in size by more than 80% in the last 4 years. This extra complexity allows for a rich browsing experience, but it hurts the majority of mobile users which still pay for their traffic. This has motivated several data-saving solutions, which aim at reducing the complexity of webpages by transforming their content. Despite each method being unique, they either reduce user privacy by further centralizing web traffic through data-saving middleboxes or introduce web compatibility (Webcompat) issues by removing content that breaks pages in unpredictable ways. In this paper, we argue that data-saving is still possible without impacting either users privacy or Webcompat. Our main observation is that Web images make up a large portion of Web traffic and have negligible impact on Webcompat. To this end we make two main contributions. First, we quantify the potential savings that image manipulation, such as dimension resizing, quality compression, and transcoding, enables at large scale: 300 landing and 880 internal pages. Next, we design and build Browselite, an entirely client-side tool that achieves such data savings through opportunistically instrumenting existing server-side tooling to perform image compression, while simultaneously reducing the total amount of image data fetched. The effect of Browselite on the user experience is quantified using standard page load metrics and a real user study of over 200 users across 50 optimized web pages. Browselite allows for similar savings to middlebox approaches, while offering additional security, privacy, and Webcompat guarantees.


title: Large Deviations Principle for Discrete-time Mean-field Games

abstract: In this paper, we establish a large deviations principle (LDP) for interacting particle systems that arise from state and action dynamics of discrete-time mean-field games under the equilibrium policy of the infinite-population limit. The LDP is proved under weak Feller continuity of state and action dynamics. The proof is based on transferring LDP for empirical measures of initial states and noise variables under setwise topology to the original game model via contraction principle, which was first suggested by Delarue, Lacker, and Ramanan to establish LDP for continuous-time mean-field games under common noise. We also compare our work with LDP results established in prior literature for interacting particle systems, which are in a sense uncontrolled versions of mean-field games.


title: Symbolic dynamics for the anisotropic $N$-centre problem at negative energies

abstract: The planar $N$-centre problem describes the motion of a particle moving in the plane under the action of the force fields of $N$ fixed attractive centres: \[ \ddot{x}(t)=\sum_{j=1}^N\nabla V_j(x-c_j). \] In this paper we prove symbolic dynamics at slightly negative energy for an $N$-centre problem where the potentials $V_j$ are positive, anisotropic and homogeneous of degree $-\alpha_j$: \[ V_j(x)=|x|^{-\alpha_j}V_j\left(\frac{x}{|x|}\right). \] The proof is based on a broken geodesics argument and trajectories are extremals of the Maupertuis' functional. Compared with the classical $N$-centre problem with Kepler potentials, a major difficulty arises from the lack of a regularization of the singularities. We will consider both the collisional dynamics and the non collision one. Symbols describe geometric and topological features of the associated trajectory.


title: Exponential confidence interval based on the recursive Wolverton-Wagner density estimation

abstract: We derive the exponential non improvable Grand Lebesgue Space norm decreasing estimations for tail of distribution for exact normed deviation for the famous recursive Wolverton-Wagner multivariate statistical density estimation. We consider pointwise as well as Lebesgue-Riesz norm error of statistical density of measurement.


title: GP-Tree: A Gaussian Process Classifier for Few-Shot Incremental Learning

abstract: Gaussian processes (GPs) are non-parametric, flexible, models that work well in many tasks. Combining GPs with deep learning methods via deep kernel learning (DKL) is especially compelling due to the strong representational power induced by the network. However, inference in GPs, whether with or without DKL, can be computationally challenging on large datasets. Here, we propose GP-Tree, a novel method for multi-class classification with Gaussian processes and DKL. We develop a tree-based hierarchical model in which each internal node of the tree fits a GP to the data using the P\'olya Gamma augmentation scheme. As a result, our method scales well with both the number of classes and data size. We demonstrate the effectiveness of our method against other Gaussian process training baselines, and we show how our general GP approach achieves improved accuracy on standard incremental few-shot learning benchmarks.


title: Technical Report -- Expected Exploitability: Predicting the Development of Functional Vulnerability Exploits

abstract: Assessing the exploitability of software vulnerabilities at the time of disclosure is difficult and error-prone, as features extracted via technical analysis by existing metrics are poor predictors for exploit development. Moreover, exploitability assessments suffer from a class bias because "not exploitable" labels could be inaccurate. To overcome these challenges, we propose a new metric, called Expected Exploitability (EE), which reflects, over time, the likelihood that functional exploits will be developed. Key to our solution is a time-varying view of exploitability, a departure from existing metrics. This allows us to learn EE using data-driven techniques from artifacts published after disclosure, such as technical write-ups and proof-of-concept exploits, for which we design novel feature sets. This view also allows us to investigate the effect of the label biases on the classifiers. We characterize the noise-generating process for exploit prediction, showing that our problem is subject to the most challenging type of label noise, and propose techniques to learn EE in the presence of noise. On a dataset of 103,137 vulnerabilities, we show that EE increases precision from 49% to 86% over existing metrics, including two state-of-the-art exploit classifiers, while its precision substantially improves over time. We also highlight the practical utility of EE for predicting imminent exploits and prioritizing critical vulnerabilities. We develop EE into an online platform which is publicly available at https://exploitability.app/.


title: Momentum Residual Neural Networks

abstract: The training of deep residual neural networks (ResNets) with backpropagation has a memory cost that increases linearly with respect to the depth of the network. A way to circumvent this issue is to use reversible architectures. In this paper, we propose to change the forward rule of a ResNet by adding a momentum term. The resulting networks, momentum residual neural networks (Momentum ResNets), are invertible. Unlike previous invertible architectures, they can be used as a drop-in replacement for any existing ResNet block. We show that Momentum ResNets can be interpreted in the infinitesimal step size regime as second-order ordinary differential equations (ODEs) and exactly characterize how adding momentum progressively increases the representation capabilities of Momentum ResNets. Our analysis reveals that Momentum ResNets can learn any linear mapping up to a multiplicative factor, while ResNets cannot. In a learning to optimize setting, where convergence to a fixed point is required, we show theoretically and empirically that our method succeeds while existing invertible architectures fail. We show on CIFAR and ImageNet that Momentum ResNets have the same accuracy as ResNets, while having a much smaller memory footprint, and show that pre-trained Momentum ResNets are promising for fine-tuning models.


title: `Oumuamua is not Artificial

abstract: I summarize evidence against the hypothesis that `Oumuamua is the artificial creation of an advanced civilization. An appendix discusses the flaws and inconsistencies of the "Breakthrough" proposal for laser acceleration of spacecraft to semi-relativistic speeds. Reality is much more challenging, and interesting.


title: Chaos and subdiffusion in the infinite-range coupled quantum kicked rotors

abstract: We map the infinite-range coupled quantum kicked rotors over an infinite-range coupled interacting bosonic model. In this way we can apply exact diagonalization up to quite large system sizes and confirm that the system tends to ergodicity in the large-size limit. In the thermodynamic limit the system is described by a set of coupled Gross-Pitaevskij equations equivalent to an effective nonlinear single-rotor Hamiltonian. These equations give rise to a power-law increase in time of the energy with exponent $\gamma\sim 2/3$ in a wide range of parameters. We explain this finding by means of a master-equation approach based on the noisy behaviour of the effective nonlinear single-rotor Hamiltonian and on the Anderson localization of the single-rotor Floquet states. Furthermore, we study chaos by means of the largest Lyapunov exponent and find that it decreases towards zero for portions of the phase space with increasing momentum. Finally, we show that some stroboscopic Floquet integrals of motion of the noninteracting dynamics deviate from their initial values over a time scale related to the interaction strength according to the Nekhoroshev theorem.


title: Eigenvalue bounds for the Paneitz operator and its associated third-order boundary operator on locally conformally flat manifolds

abstract: In this paper we study bounds for the first eigenvalue of the Paneitz operator $P$ and its associated third-order boundary operator $B^3$ on four-manifolds. We restrict to orientable, simply connected, locally confomally flat manifolds that have at most two umbilic boundary components. The proof is based on showing that under the hypotheses of the main theorems, the considered manifolds are confomally equivalent to canonical models. This equivalence is proved by showing the injectivity of suitable developing maps. Then the bounds on the eigenvalues are obtained through explicit computations on the canonical models and its connections with the classes of manifolds that we are considering. The fact that $P$ and $B^3$ are conformal in four dimensions is key in the proof.


title: Sharp Grand Lebesgue Spaces norm estimation for infimal convolution

abstract: We derive the non-improvable Grand Lebesgue Space norm estimations for multivariate and multidimensional operator of infimal convolution.


title: Tracking the Source of Solar Type II Bursts through Comparisons of Simulations and Radio Data

abstract: The most intense solar energetic particle events are produced by coronal mass ejections (CMEs) accompanied by intense type II radio bursts below 15 MHz. Understanding where these type II bursts are generated relative to an erupting CME would reveal important details of particle acceleration near the Sun, but the emission cannot be imaged on Earth due to distortion from its ionosphere. Here, a technique is introduced to identify the likely source location of the emission by comparing the observed dynamic spectrum observed from a single spacecraft against synthetic spectra made from hypothesized emitting regions within a magnetohydrodynamic (MHD) numerical simulation of the recreated CME. The radio-loud 2005 May 13 CME was chosen as a test case, with Wind/WAVES radio data used to frame the inverse problem of finding the most likely progression of burst locations. An MHD recreation is used to create synthetic spectra for various hypothesized burst locations. A framework is developed to score these synthetic spectra by their similarity to the type II frequency profile derived from Wind/WAVES data. Simulated areas with 4x enhanced entropy and elevated de Hoffmann Teller velocities are found to produce synthetic spectra similar to spacecraft observations. A geometrical analysis suggests that the eastern edge of the entropy derived shock around (-30, 0) degrees in heliocentric coordinates was emitting in the first hour of the event before ceasing emission, and that the western/southwestern edge of the shock centered around (6, -12) degrees was a dominant area of radio emission for the 2 hours of simulation data out to 20 solar radii.


title: Approximating viscosity solutions of the Euler system

abstract: Applying the concept of S-convergence, based on averaging in the spirit of Strong Law of Large Numbers, the vanishing viscosity solutions of the Euler system are studied. We show how to efficiently compute a viscosity solution of the Euler system as the S-limit of numerical solutions obtained by the Viscosity Finite Volume method. Theoretical results are illustrated by numerical simulations of the Kelvin--Helmholtz instability problem.


title: Investigating and Recommending Co-Changed Entities for JavaScript Programs

abstract: JavaScript (JS) is one of the most popular programming languages due to its flexibility and versatility, but maintaining JS code is tedious and error-prone. In our research, we conducted an empirical study to characterize the relationship between co-changed software entities (e.g., functions and variables), and built a machine learning (ML)-based approach to recommend additional entity to edit given developers' code changes. Specifically, we first crawled 14,747 commits in 10 open-source projects; for each commit, we created one or more change dependency graphs (CDGs) to model the referencer-referencee relationship between co-changed entities. Next, we extracted the common subgraphs between CDGs to locate recurring co-change patterns between entities. Finally, based on those patterns, we extracted code features from co-changed entities and trained an ML model that recommends entities-to-change given a program commit. According to our empirical investigation, (1) three recurring patterns commonly exist in all projects; (2) 80%--90% of co-changed function pairs either invoke the same function(s), access the same variable(s), or contain similar statement(s); (3) our ML-based approach CoRec recommended entity changes with high accuracy (73%--78%). CoRec complements prior work because it suggests changes based on program syntax, textual similarity, as well as software history; it achieved higher accuracy than two existing tools in our evaluation.


title: A Hidden Challenge of Link Prediction: Which Pairs to Check?

abstract: The traditional setup of link prediction in networks assumes that a test set of node pairs, which is usually balanced, is available over which to predict the presence of links. However, in practice, there is no test set: the ground-truth is not known, so the number of possible pairs to predict over is quadratic in the number of nodes in the graph. Moreover, because graphs are sparse, most of these possible pairs will not be links. Thus, link prediction methods, which often rely on proximity-preserving embeddings or heuristic notions of node similarity, face a vast search space, with many pairs that are in close proximity, but that should not be linked. To mitigate this issue, we introduce LinkWaldo, a framework for choosing from this quadratic, massively-skewed search space of node pairs, a concise set of candidate pairs that, in addition to being in close proximity, also structurally resemble the observed edges. This allows it to ignore some high-proximity but low-resemblance pairs, and also identify high-resemblance, lower-proximity pairs. Our framework is built on a model that theoretically combines Stochastic Block Models (SBMs) with node proximity models. The block structure of the SBM maps out where in the search space new links are expected to fall, and the proximity identifies the most plausible links within these blocks, using locality sensitive hashing to avoid expensive exhaustive search. LinkWaldo can use any node representation learning or heuristic definition of proximity, and can generate candidate pairs for any link prediction method, allowing the representation power of current and future methods to be realized for link prediction in practice. We evaluate LinkWaldo on 13 networks across multiple domains, and show that on average it returns candidate sets containing 7-33% more missing and future links than both embedding-based and heuristic baselines' sets.


title: Nebular Emission from Lanthanide-rich Ejecta of Neutron Star Merger

abstract: The nebular phase of lanthanide-rich ejecta of a neutron star merger (NSM) is studied by using a one-zone model, in which the atomic properties are represented by a single species, neodymium (Nd). Under the assumption that beta-decay of r-process nuclei is the heat and ionization source, we solve the ionization and thermal balance of the ejecta under non-local thermodynamic equilibrium. The atomic data including energy levels, radiative transition rates, collision strengths, and recombination rate coefficients, are obtained by using atomic structure codes, GRASP2K and HULLAC. We find that both permitted and forbidden lines roughly equally contribute to the cooling rate of Nd II and Nd III at the nebular temperatures. We show that the kinetic temperature and ionization degree increase with time in the early stage of the nebular phase while these quantities become approximately independent of time after the thermalization break of the heating rate because the processes relevant to the ionization and thermalization balance are attributed to two-body collision between electrons and ions at later times. As a result, in spite of the rapid decline of the luminosity, the shape of the emergent spectrum does not change significantly with time after the break. We show that the emission-line nebular spectrum of the pure Nd ejecta consists of a broad structure from $0.5\,\mu m$ to $20\,\mu m$ with two distinct peaks around $1\,\mu m$ and $10\,\mu m$.


title: PSA-Net: Deep Learning based Physician Style-Aware Segmentation Network for Post-Operative Prostate Cancer Clinical Target Volume

abstract: Automatic segmentation of medical images with DL algorithms has proven to be highly successful. With most of these algorithms, inter-observer variation is an acknowledged problem, leading to sub-optimal results. This problem is even more significant in post-operative clinical target volume (post-op CTV) segmentation due to the absence of macroscopic visual tumor in the image. This study, using post-op CTV segmentation as the test bed, tries to determine if physician styles are consistent and learnable, if there is an impact of physician styles on treatment outcome and toxicity; and how to explicitly deal with physician styles in DL algorithms to facilitate its clinical acceptance. A classifier is trained to identify which physician has contoured the CTV from just the contour and corresponding CT scan, to determine if physician styles are consistent and learnable. Next, we evaluate if adapting automatic segmentation to physician styles would be clinically feasible based on a lack of difference between outcomes. For modeling different physician styles of CTV segmentation, a concept called physician style-aware (PSA) segmentation is proposed which is an encoder-multidecoder network trained with perceptual loss. With the proposed physician style-aware network (PSA-Net), Dice similarity coefficient (DSC) accuracy increases on an average of 3.4% for all physicians from a general model that is not style adapted. We show that stylistic contouring variations also exist between institutions that follow the same segmentation guidelines and show the effectiveness of the proposed method in adapting to new institutional styles. We observed an accuracy improvement of 5% in terms of DSC when adapting to the style of a separate institution.


title: The Diverse Molecular Gas Content of Massive Galaxies Undergoing Quenching at z~1

abstract: We present a detailed study of the molecular gas content and stellar population properties of three massive galaxies at 1 < z < 1.3 that are in different stages of quenching. The galaxies were selected to have a quiescent optical/near-infrared spectral energy distribution and a relatively bright emission at 24 micron, and show remarkably diverse properties. CO emission from each of the three galaxies is detected in deep NOEMA observations, allowing us to derive molecular gas fractions Mgas/Mstar of 13-23%. We also reconstruct the star formation histories by fitting models to the observed photometry and optical spectroscopy, finding evidence for recent rejuvenation in one object, slow quenching in another, and rapid quenching in the third system. To better constrain the quenching mechanism we explore the depletion times for our sample and other similar samples at z~0.7 from the literature. We find that the depletion times are highly dependent on the method adopted to measure the star formation rate: using the UV+IR luminosity we obtain depletion times about 6 times shorter than those derived using dust-corrected [OII] emission. When adopting the star formation rates from spectral fitting, which are arguably more robust, we find that recently quenched galaxies and star-forming galaxies have similar depletion times, while older quiescent systems have longer depletion times. These results offer new, important constraints for physical models of galaxy quenching.


title: Constraining red supergiant mass-loss prescriptions through supernova radio properties

abstract: Supernova properties in radio strongly depend on their circumstellar environment and they are an important probe to investigate the mass loss of supernova progenitors. Recently, core-collapse supernova observations in radio have been assembled and the rise time and peak luminosity distribution of core-collapse supernovae at 8.4 GHz has been estimated. In this paper, we constrain the mass-loss prescriptions for red supergiants by using the rise time and peak luminosity distribution of Type II supernovae in radio. We take the de Jager and van Loon mass-loss rates for red supergiants, calculate the rise time and peak luminosity distribution based on them, and compare the results with the observed distribution. We found that the de Jager mass-loss rate explains the widely spread radio rise time and peak luminosity distribution of Type II supernovae well, while the van Loon mass-loss rate predicts a relatively narrow range for the rise time and peak luminosity. We conclude that the mass-loss prescriptions of red supergiants should have strong dependence on the luminosity as in the de Jager mass-loss rate to reproduce the widely spread distribution of the rise time and peak luminosity in radio observed in Type II supernovae.


title: Pre-demosaic Graph-based Light Field Image Compression

abstract: An unfocused plenoptic light field (LF) camera places an array of microlenses in front of an image sensor in order to separately capture different directional rays arriving at an image pixel. Using a conventional Bayer pattern, data captured at each pixel is a single color component (R, G or B).The sensed data then undergoes demosaicking (interpolation of RGB components per pixel) and conversion to an array of sub-aperture images (SAIs). In this paper, we propose a new LF image coding scheme based on graph lifting transform (GLT), where the acquired sensor data are coded in the original captured form without pre-processing. Specifically, we directly map raw sensed color data to the SAIs, resulting in sparsely distributed color pixels on 2D grids, and perform demosaicking at the receiver after decoding. To exploit spatial correlation among the sparse pixels, we propose a novel intra-prediction scheme, where the prediction kernel is determined according to the local gradient estimated from already coded neighboring pixel blocks. We then connect the pixels by forming a graph, modeling the prediction residuals statistically as a Gaussian Markov Random Field (GMRF). The optimal edge weights are computed via a graph learning method using a set of training SAIs. The residual data is encoded via low-complexity GLT. Experiments show that at high PSNRs -- important for archiving and instant storage scenarios -- our method outperformed significantly a conventional light field image coding scheme with demosaicking followed by High Efficiency Video Coding (HEVC).


title: Twister: Construction and structural relaxation of commensurate moir\'e superlattices

abstract: Introduction of a twist between layers of two-dimensional materials which leads to the formation of a moir\'e pattern is an emerging pathway to tune the electronic, vibrational and optical properties. The fascinating properties of these systems is often linked to large-scale structural reconstruction of the moir\'e pattern. Hence, an essential first step in the theoretical study of these systems is the construction and structural relaxation of the atoms in the moir\'e superlattice. We present the Twister package, a collection of tools that constructs commensurate superlattices for any combination of 2D materials and also helps perform structural relaxations of the moir\'e superlattice. Twister constructs commensurate moir\'e superlattices using the coincidence lattice method and provides an interface to perform structural relaxations using classical forcefields.


title: B-BOP, the SPICA Imaging Polarimeter

abstract: We present the B-BOP instrument, a polarimetric camera on board the future ESA-JAXA SPICA far-infrared space observatory. B-BOP will allow the study of the magnetic field in various astrophysical environments thanks to its unprecedented ability to measure the linear polarization of the submillimeter light. The maps produced by B-BOP will contain not only information on total power, but also on the degree and the angle of polarization, simultaneously in three spectral bands (70, 200 and 350 microns). The B-BOP detectors are ultra-sensitive silicon bolometers that are intrinsically sensitive to polarization. Their NEP is close to 10E-18 W/sqrt(Hz). We will present the optical and thermal architectures of the instrument, we will detail the bolometer design and we will show the expected performances of the instrument based on preliminary lab work.


title: Recent Developments in Blockchain Technology and their Impact on Energy Consumption

abstract: The enormous power consumption of Bitcoin has led to undifferentiated discussions in science and practice about the sustainability of blockchain and distributed ledger technology in general. However, blockchain technology is far from homogeneous - not only with regard to its applications, which now go far beyond cryptocurrencies and have reached businesses and the public sector, but also with regard to its technical characteristics and, in particular, its power consumption. This paper summarizes the status quo of the power consumption of various implementations of blockchain technology, with special emphasis on the recent 'Bitcoin Halving' and so-called 'zk-rollups'. We argue that although Bitcoin and other proof-of-work blockchains do indeed consume a lot of power, alternative blockchain solutions with significantly lower power consumption are already available today, and new promising concepts are being tested that could further reduce in particular the power consumption of large blockchain networks in the near future. From this we conclude that although the criticism of Bitcoin's power consumption is legitimate, it should not be used to derive an energy problem of blockchain technology in general. In many cases in which processes can be digitised or improved with the help of more energy-efficient blockchain variants, one can even expect net energy savings.


title: VA-RED$^2$: Video Adaptive Redundancy Reduction

abstract: Performing inference on deep learning models for videos remains a challenge due to the large amount of computational resources required to achieve robust recognition. An inherent property of real-world videos is the high correlation of information across frames which can translate into redundancy in either temporal or spatial feature maps of the models, or both. The type of redundant features depends on the dynamics and type of events in the video: static videos have more temporal redundancy while videos focusing on objects tend to have more channel redundancy. Here we present a redundancy reduction framework, termed VA-RED$^2$, which is input-dependent. Specifically, our VA-RED$^2$ framework uses an input-dependent policy to decide how many features need to be computed for temporal and channel dimensions. To keep the capacity of the original model, after fully computing the necessary features, we reconstruct the remaining redundant features from those using cheap linear operations. We learn the adaptive policy jointly with the network weights in a differentiable way with a shared-weight mechanism, making it highly efficient. Extensive experiments on multiple video datasets and different visual tasks show that our framework achieves $20\% - 40\%$ reduction in computation (FLOPs) when compared to state-of-the-art methods without any performance loss. Project page: http://people.csail.mit.edu/bpan/va-red/.


title: Metatheory.jl: Fast and Elegant Algebraic Computation in Julia with Extensible Equality Saturation

abstract: We introduce Metatheory.jl: a lightweight and performant general purpose symbolics and metaprogramming framework meant to simplify the act of writing complex Julia metaprograms and to significantly enhance Julia with a native term rewriting system, based on state-of-the-art equality saturation techniques, and a dynamic first class Abstract Syntax Tree (AST) pattern matching system that is dynamically composable in an algebraic fashion, taking full advantage of the language's powerful reflection capabilities. Our contribution allows to perform general purpose symbolic mathematics, manipulation, optimization, synthesis or analysis of syntactically valid Julia expressions with a clean and concise programming interface, both during compilation or execution of programs.


title: Distributionally-Constrained Policy Optimization via Unbalanced Optimal Transport

abstract: We consider constrained policy optimization in Reinforcement Learning, where the constraints are in form of marginals on state visitations and global action executions. Given these distributions, we formulate policy optimization as unbalanced optimal transport over the space of occupancy measures. We propose a general purpose RL objective based on Bregman divergence and optimize it using Dykstra's algorithm. The approach admits an actor-critic algorithm for when the state or action space is large, and only samples from the marginals are available. We discuss applications of our approach and provide demonstrations to show the effectiveness of our algorithm.


title: Data Interpolation Accuracy Comparison: Gravity Model Versus Radial Basis Function

abstract: In this paper, the accuracy of two mesh-free approximation approaches, the Gravity model and Radial Basis Function, are compared. The two schemes' convergence behaviors prove that RBF is faster and more accurate than the Gravity model. As a case study, the interpolation of temperature at different locations in Tennesse, USA, are compared. Delaunay mesh generation is used to create random points inside and on the border, which data can be incorporated in these locations. 49 MERRA weather stations as used as data sources to provide the temperature at a specific day and hour. The contours of interpolated temperatures provided in the result section assert RBF is a more accurate method than the Gravity model by showing a smoother and broader range of interpolated data.


title: Investigating the integrate and fire model as the limit of a random discharge model: a stochastic analysis perspective

abstract: In the mean field integrate-and-fire model, the dynamics of a typical neuron within a large network is modeled as a diffusion-jump stochastic process whose jump takes place once the voltage reaches a threshold. In this work, the main goal is to establish the convergence relationship between the regularized process and the original one where in the regularized process, the jump mechanism is replaced by a Poisson dynamic, and jump intensity within the classically forbidden domain goes to infinity as the regularization parameter vanishes. On the macroscopic level, the Fokker-Planck equation for the process with random discharges (i.e. Poisson jumps) are defined on the whole space, while the equation for the limit process is on the half space. However, with the iteration scheme, the difficulty due to the domain differences has been greatly mitigated and the convergence for the stochastic process and the firing rates can be established. Moreover, we find a polynomial-order convergence for the distribution by a re-normalization argument in probability theory. Finally, by numerical experiments, we quantitatively explore the rate and the asymptotic behavior of the convergence for both linear and nonlinear models.


title: Covariant Functions of Characters of Compact Subgroups

abstract: This paper presents a systematic study for abstract harmonic analysis on classical Banach spaces of covariant functions of characters of compact subgroups. Let $G$ be a locally compact group and $H$ be a compact subgroup of $G$. Suppose that $\xi:H\to\mathbb{T}$ is a continuous character, $1\le p<\infty$ and $L_\xi^p(G,H)$ is the set of all covariant functions of $\xi$ in $L^p(G)$. It is shown that $L^p_\xi(G,H)$ is isometrically isomorphic to a quotient space of $L^p(G)$. It is also proven that $L^q_\xi(G,H)$ is isometrically isomorphic to the dual space $L^p_\xi(G,H)^*$, where $q$ is the conjugate exponent of $p$. The paper is concluded by some results for the case that $G$ is compact.


title: Oriented regular representations of out-valency two for finite simple groups

abstract: In this paper, we show that every finite simple group of order at least $5$ admits an oriented regular representation of out-valency $2$.


title: The path-missing and path-free complexes of a directed graph

abstract: We study two simplicial complexes arising from a directed graph $G = (V, E)$ with two chosen vertices $s$ and $t$: the *path-free complex*, consisting of all subsets $F \subseteq E$ that contain no path from $s$ to $t$, and the *path-missing complex*, its Alexander dual. Using discrete Morse theory, we prove that both complexes have well-behaved homotopy types -- either contractible or homotopy-equivalent to spheres.


title: Higher Symplectic Capacities and the Stabilized Embedding Problem for Integral Ellipsoids

abstract: The third named author has been developing a theory of "higher" symplectic capacities. These capacities are invariant under taking products, and so are well-suited for studying the stabilized embedding problem. The aim of this note is to apply this theory, assuming its expected properties, to solve the stabilized embedding problem for integral ellipsoids, when the eccentricity of the domain has the opposite parity of the eccentricity of the target and the target is not a ball. For the other parity, the embedding we construct is definitely not always optimal; also, in the ball case, our methods recover previous results of McDuff, and of the second named author and Kerman. There is a similar story, with no condition on the eccentricity of the target, when the target is a polydisc: a special case of this implies a conjecture of the first named author, Frenkel, and Schlenk concerning the rescaled polydisc limit function. Some related aspects of the stabilized embedding problem and some open questions are also discussed.


title: A multispeaker dataset of raw and reconstructed speech production real-time MRI video and 3D volumetric images

abstract: Real-time magnetic resonance imaging (RT-MRI) of human speech production is enabling significant advances in speech science, linguistics, bio-inspired speech technology development, and clinical applications. Easy access to RT-MRI is however limited, and comprehensive datasets with broad access are needed to catalyze research across numerous domains. The imaging of the rapidly moving articulators and dynamic airway shaping during speech demands high spatio-temporal resolution and robust reconstruction methods. Further, while reconstructed images have been published, to-date there is no open dataset providing raw multi-coil RT-MRI data from an optimized speech production experimental setup. Such datasets could enable new and improved methods for dynamic image reconstruction, artifact correction, feature extraction, and direct extraction of linguistically-relevant biomarkers. The present dataset offers a unique corpus of 2D sagittal-view RT-MRI videos along with synchronized audio for 75 subjects performing linguistically motivated speech tasks, alongside the corresponding first-ever public domain raw RT-MRI data. The dataset also includes 3D volumetric vocal tract MRI during sustained speech sounds and high-resolution static anatomical T2-weighted upper airway MRI for each subject.


title: Study of $B$ and $B_s$ Decays at Belle

abstract: We report results on the search for $B_s\to\eta^{\prime}\eta$ decay, and the searches for $B^0\to\textrm{invisible}$ and $B^0\to\textrm{invisible}+\gamma$ decays. The former result is based on a data sample of $121.4~\textrm{fb}^{-1}$ recorded at the $\Upsilon(5S)$ resonance while the later results are obtained from a $711~\textrm{fb}^{-1}$ of data sample collected at $\Upsilon(4S)$ resonance with the Belle detector at the KEKB $e^+e^-$ collider. We observe no significant signal for the decays and set upper limit on their branching fractions at 90\% confidence level of $\mathcal{B}(B_s\to\eta^{\prime}\eta)<7.1\times 10^{-5}$, $\mathcal{B}(B^0\to\textrm{invisible})<7.8\times 10^{-5}$ and $\mathcal{B}(B^0\to\textrm{invisible}+\gamma)<1.6\times 10^{-5}$.


title: On the Correlation between Hot Jupiters and Stellar Clustering: High-eccentricity Migration Induced by Stellar Flybys

abstract: A recent observational study suggests that the occurrence of hot Jupiters (HJs) around solar-type stars is correlated with stellar clustering. We study a new scenario for HJ formation, called "Flyby Induced High-e Migration", that may help explain this correlation. In this scenario, stellar flybys excite the eccentricity and inclination of an outer companion (giant planet, brown dwarf, or low-mass star) at large distance (10-300 au), which then triggers high-e migration of an inner cold Jupiter (at a few astronomical units) through the combined effects of von Zeipel-Lidov-Kozai (ZLK) eccentricity oscillation and tidal dissipation. Using semianalytical calculations of the effective ZLK inclination window, together with numerical simulations of stellar flybys, we obtain the analytic estimate for the HJ occurrence rate in this formation scenario. We find that this "flyby induced high-e migration" could account for a significant fraction of the observed HJ population, although the result depends on several uncertain parameters, including the density and lifetime of birth stellar clusters, and the occurrence rate of the "cold Jupiter + outer companion" systems.


title: A Deep-Learning Approach For Direct Whole-Heart Mesh Reconstruction

abstract: Automated construction of surface geometries of cardiac structures from volumetric medical images is important for a number of clinical applications. While deep-learning-based approaches have demonstrated promising reconstruction precision, these approaches have mostly focused on voxel-wise segmentation followed by surface reconstruction and post-processing techniques. However, such approaches suffer from a number of limitations including disconnected regions or incorrect surface topology due to erroneous segmentation and stair-case artifacts due to limited segmentation resolution. We propose a novel deep-learning-based approach that directly predicts whole heart surface meshes from volumetric CT and MR image data. Our approach leverages a graph convolutional neural network to predict deformation on mesh vertices from a pre-defined mesh template to reconstruct multiple anatomical structures in a 3D image volume. Our method demonstrated promising performance of generating whole heart reconstructions with as good or better accuracy than prior deep-learning-based methods on both CT and MR data. Furthermore, by deforming a template mesh, our method can generate whole heart geometries with better anatomical consistency and produce high-resolution geometries from lower resolution input image data. Our method was also able to produce temporally consistent surface mesh predictions for heart motion from CT or MR cine sequences, and therefore can potentially be applied for efficiently constructing 4D whole heart dynamics. Our code and pre-trained networks are available at https://github.com/fkong7/MeshDeformNet


title: Engineering Education in the Age of Autonomous Machines

abstract: In the past few years, we have observed a huge supply-demand gap for autonomous driving engineers. The core problem is that autonomous driving is not one single technology but rather a complex system integrating many technologies, and no one single academic department can provide comprehensive education in this field. We advocate to create a cross-disciplinary program to expose students with technical background in computer science, computer engineering, electrical engineering, as well as mechanical engineering. On top of the cross-disciplinary technical foundation, a capstone project that provides students with hands-on experiences of working with a real autonomous vehicle is required to consolidate the technical foundation.


title: C11Tester: A Race Detector for C/C++ Atomics Technical Report

abstract: Writing correct concurrent code that uses atomics under the C/C++ memory model is extremely difficult. We present C11Tester, a race detector for the C/C++ memory model that can explore executions in a larger fragment of the C/C++ memory model than previous race detector tools. Relative to previous work, C11Tester's larger fragment includes behaviors that are exhibited by ARM processors. C11Tester uses a new constraint-based algorithm to implement modification order that is optimized to allow C11Tester to make decisions in terms of application-visible behaviors. We evaluate C11Tester on several benchmark applications, and compare C11Tester's performance to both tsan11rec, the state of the art tool that controls scheduling for C/C++; and tsan11, the state of the art tool that does not control scheduling.


title: Roman Domination of the Comet, Double Comet, and Comb Graphs

abstract: One of the well-known measurements of vulnerability in graph theory is domination. There are many kinds of dominating and relative types of sets in graphs. However, we are going to focus on Roman domination, which is a type of domination that came up with an article by Ian Stewart. The Roman domination numbers of the comet, double comet, and comb graphs are given in this paper.


title: A proof by foliation that Lawson's cones are $A_{\Phi}$-minimizing

abstract: We give a proof by foliation that the cones over $\mathbb{S}^k \times \mathbb{S}^l$ minimize parametric elliptic functionals for each $k,\,l \geq 1$. We also analyze the behavior at infinity of the leaves in the foliations. This analysis motivates conjectures related to the existence and growth rates of nonlinear entire solutions to equations of minimal surface type that arise in the study of such functionals.


title: SK-Tree: a systematic malware detection algorithm on streaming trees via the signature kernel

abstract: The development of machine learning algorithms in the cyber security domain has been impeded by the complex, hierarchical, sequential and multimodal nature of the data involved. In this paper we introduce the notion of a streaming tree as a generic data structure encompassing a large portion of real-world cyber security data. Starting from host-based event logs we represent computer processes as streaming trees that evolve in continuous time. Leveraging the properties of the signature kernel, a machine learning tool that recently emerged as a leading technology for learning with complex sequences of data, we develop the SK-Tree algorithm. SK-Tree is a supervised learning method for systematic malware detection on streaming trees that is robust to irregular sampling and high dimensionality of the underlying streams. We demonstrate the effectiveness of SK-Tree to detect malicious events on a portion of the publicly available DARPA OpTC dataset, achieving an AUROC score of 98%.


title: Generalized cell structures

abstract: Cell structures were introduced by W. Debski and E. Tymchatyn as a way to study some classes of topological spaces and their continuous functions by means of discrete approximations. In this work we weaken the notion of cell structure and prove that the resulting class of topological space admitting such a generalized cell structure includes non-regular spaces.


title: Automorphic functions as the trace of Frobenius

abstract: We prove that the trace of the Frobenius endofunctor of the category of automorphic sheaves with nilpotent singular support maps isomorphically to the space of unramified automorphic functions, settling a conjecture from [AGKRRV1]. More generally, we show that traces of Frobenius-Hecke functors produce shtuka cohomologies.


title: Moving frames and compatibility conditions for three-dimensional director fields

abstract: The geometry and topology of the region in which a director field is embedded impose limitations on the kind of supported orientational order. These limitations manifest as compatibility conditions that relate the quantities describing the director field to the geometry of the embedding space. For example, in two dimensions (2D) the splay and bend fields suffice to determine a director uniquely (up to rigid motions) and must comply with one relation linear in the Gaussian curvature of the embedding manifold. In 3D there are additional local fields describing the director, i.e. fields available to a local observer residing within the material, and a number of distinct ways to yield geometric frustration. So far it was unknown how many such local fields are required to uniquely describe a 3D director field, nor what are the compatibility relations they must satisfy. In this work, we address these questions directly. We employ the method of moving frames to show that a director field is fully determined by five local fields. These fields are shown to be related to each other and to the curvature of the embedding space through six differential relations. As an application of our method, we characterize all uniform distortion director fields, i.e., directors for which all the local characterizing fields are constant in space, in manifolds of constant curvature. The classification of such phases has been recently provided for directors in Euclidean space, where the textures correspond to foliations of space by parallel congruent helices. For non-vanishing curvature, we show that the pure twist phase is the only solution in positively curved space, while in the hyperbolic space uniform distortion fields correspond to foliations of space by (non-necessarily parallel) congruent helices. Further analysis is expected to allow to also construct of new non-uniform director fields.


title: Phase-dependent fluctuations of resonance fluorescence near the coherent population trapping condition

abstract: We study phase-dependent fluctuations of the resonance fluorescence of a single $\Lambda$-type three-level atom in the regime near coherent population trapping, i.e., alongside the two-photon detuning condition. To this end, we employ the method of conditional homodyne detection (CHD) which considers squeezing in the weak driving regime, and extends to non-Gaussian fluctuations for saturating and strong fields. In this framework, and using estimated parameter settings of the resonance fluorescence of a single trapped $^{138} \mathrm{Ba}^{+}$ ion, the light scattered from the probe transitions is found to manifest a non-classical character and conspicuous asymmetric third-order fluctuations in the amplitude-intensity correlation of CHD.


title: Dynamic symmetry breaking in chiral magnetic systems

abstract: The Dzyaloshinskii-Moriya interaction (DMI) in magnetic systems stabilizes spin textures with preferred chirality, applicable to next-generation memory and computing architectures. In perpendicularly magnetized heavy-metal/ferromagnet films, the interfacial DMI originating from structural inversion asymmetry and strong spin-orbit coupling favors chiral N\'eel-type domain walls (DWs) whose energetics and mobility remain at issue. Here, we characterize a new effect in which domains expand unidirectionally in response to a combination of out-of-plane and in-plane magnetic fields, with the growth direction controlled by the in-plane field strength. These growth directionalities and symmetries with applied fields cannot be understood from static treatments alone. We theoretically demonstrate that perpendicular field torques stabilize steady-state magnetization profiles highly asymmetric in elastic energy, resulting in a dynamic symmetry breaking consistent with the experimental findings. This phenomenon sheds light on the mechanisms governing the dynamics of N\'eel-type DWs and expands the utility of field-driven DW motion to probe and control chiral DWs.


title: Studying squark mass spectrum through gluino decay at 100 TeV future hadron colliders

abstract: We study the prospect of determining the decay properties of the gluino in the supersymmetric (SUSY) standard model at a 100 TeV future hadron collider. We consider the case where the neutral Wino is the lightest superparticle. In this case, the long-lived charged Wino can be used to eliminate standard model backgrounds, which enables us to study the details of superparticles. We show that, based on the analysis of the numbers of high $p_T$ leptons, boosted $W$-jets, and $b$-tagged jets, we may determine the gaugino species and the quark flavors in the gluino decay. With such determinations, we can obtain information about the mass spectrum of squarks even if squarks are out of the kinematical reach.


title: MITNet: GAN Enhanced Magnetic Induction Tomography Based on Complex CNN

abstract: Magnetic induction tomography (MIT) is an efficient solution for long-term brain disease monitoring, which focuses on reconstructing bio-impedance distribution inside the human brain using non-intrusive electromagnetic fields. However, high-quality brain image reconstruction remains challenging since reconstructing images from the measured weak signals is a highly non-linear and ill-conditioned problem. In this work, we propose a generative adversarial network (GAN) enhanced MIT technique, named MITNet, based on a complex convolutional neural network (CNN). The experimental results on the real-world dataset validate the performance of our technique, which outperforms the state-of-art method by 25.27%.


title: Lattice dynamics of the excitonic insulator Ta$_2$Ni(Se$_{1-x}$S$_x$)$_5$

abstract: Recently, we employed electronic polarization-resolved Raman spectroscopy to reveal the strongly correlated excitonic insulator (EI) nature of Ta2NiSe5, Volkov et al. [arXiv:2007.07344], and also showed that for Ta$_2$Ni(Se$_{1-x}$S$_x$)$_5$ alloys the critical excitonic fluctuations diminish with sulfur concentration x exposing a cooperating lattice instability that takes over for large x, Volkov et al. [arXiv:2104.07032]. Here we focus on the lattice dynamics of this EI family. We identify all Raman-active optical phonons of fully symmetric and ac-quadrupole-like symmetries and study their evolution with temperature and sulfur concentration. We demonstrate the change of selection rules at temperatures below the orthorhombic-to-monoclinic transition at Tc(x) that is related to the EI phase. We find that Tc(x) decrease monotonically from 328 K for Ta2NiSe5 to 120 K for Ta2NiS5 and that the magnitude of lattice distortion also decreases with the sulfur concentration x. For x < 0.7, the two lowest-frequency B2g phonon modes show strongly asymmetric lineshapes at high temperatures due to Fano interference with the broad excitonic continuum present in a semimetallic state. Within the framework of extended Fano model, we develop a quantitative description of the interacting exciton-phonon excitation lineshape, enabling us to derive the intrinsic phonon parameters and determine the exciton-phonon interaction strength, that affects the transition temperature Tc(x). We also observe signatures of the acoustic mode scattered assisted by the structural domain walls formed below Tc. Based on our results, we additionally present a consistent interpretation of the origin of oscillations observed in time-resolved pump-probe experiments.


title: Charge density waves and Fermi level pinning in monolayer and bilayer SnSe$_2$

abstract: Materials with reduced dimensionality often exhibit exceptional properties that are different from their bulk counterparts. Here we report the emergence of a commensurate 2 $\times$ 2 charge density wave (CDW) in monolayer and bilayer SnSe$_2$ films by scanning tunneling microscope. The visualized spatial modulation of CDW phase becomes prominent near the Fermi level, which is pinned inside the semiconductor band gap of SnSe$_2$. We show that both CDW and Fermi level pinning are intimately correlated with band bending and virtual induced gap states at the semiconductor heterointerface. Through interface engineering, the electron-density-dependent phase diagram is established in SnSe$_2$. Fermi surface nesting between symmetry inequivalent electron pockets is revealed to drive the CDW formation and to provide an alternative CDW mechanism that might work in other compounds.


title: Merohedral disorder and impurity impacts on superconductivity of fullerenes

abstract: Local quasiparticle states around impurities provide essential insight into the mechanism of unconventional superconductivity, especially when the candidate materials are proximate to an antiferromagnetic Mott-insulating phase. While such states have been reported in atom-based cuprates and iron-based compounds, they are unexplored in organic superconductors which feature tunable molecular orientation. Here we employ scanning tunneling microscopy and spectroscopy to reveal multiple forms of robustness of an exotic $s$-wave superconductivity in epitaxial Rb$_3$C$_{60}$ films against merohedral disorder, non-magnetic single impurities and step edges at the atomic scale. Also observed have been Yu-Shiba-Rusinov (YSR) states induced by deliberately incurred Fe adatoms that act as magnetic scatters. The bound states display abrupt spatial decay and vary in energy with the Fe adatom registry. Our results and the universal optimal superconductivity at half-filling point towards local electron pairing in which the multiorbital electronic correlations and intramolecular phonons together drive the high-temperature superconductivity of doped fullerenes.


title: Semiconductor-metal phase transition and emergent charge density waves in 1T-ZrX$_2$ (X = Se, Te) at the two-dimensional limit

abstract: Charge density wave (CDW) is a collective quantum phenomenon in metals and features a wave-like modulation of the conduction electron density. A microscopic understanding and experimental control of this many-body electronic state in atomically thin materials remain hot topics in materials physics. By means of material engineering, we realized a dimensionality and Zr intercalation induced semiconductor-metal phase transition in 1T-ZrX$_2$ (X = Se, Te) ultra-thin films, accompanied by a commensurate 2 $\times$ 2 CDW order. Furthermore, we observed a CDW energy gap up to 22 meV around the Fermi level. Fourier-transformed scanning tunneling microscopy and angle-resolved photoemission spectroscopy reveal that 1T-ZrX$_2$ films exhibit the simplest Fermi surface among the known CDW materials in TMDCs, consisting only of Zr 4d-derived elliptical electron conduction band at the corners of the Brillouin zone.


title: Few-Shot Graph Learning for Molecular Property Prediction

abstract: The recent success of graph neural networks has significantly boosted molecular property prediction, advancing activities such as drug discovery. The existing deep neural network methods usually require large training dataset for each property, impairing their performances in cases (especially for new molecular properties) with a limited amount of experimental data, which are common in real situations. To this end, we propose Meta-MGNN, a novel model for few-shot molecular property prediction. Meta-MGNN applies molecular graph neural network to learn molecular representation and builds a meta-learning framework for model optimization. To exploit unlabeled molecular information and address task heterogeneity of different molecular properties, Meta-MGNN further incorporates molecular structure, attribute based self-supervised modules and self-attentive task weights into the former framework, strengthening the whole learning model. Extensive experiments on two public multi-property datasets demonstrate that Meta-MGNN outperforms a variety of state-of-the-art methods.


title: Information Ranking Using Optimum-Path Forest

abstract: The task of learning to rank has been widely studied by the machine learning community, mainly due to its use and great importance in information retrieval, data mining, and natural language processing. Therefore, ranking accurately and learning to rank are crucial tasks. Context-Based Information Retrieval systems have been of great importance to reduce the effort of finding relevant data. Such systems have evolved by using machine learning techniques to improve their results, but they are mainly dependent on user feedback. Although information retrieval has been addressed in different works along with classifiers based on Optimum-Path Forest (OPF), these have so far not been applied to the learning to rank task. Therefore, the main contribution of this work is to evaluate classifiers based on Optimum-Path Forest, in such a context. Experiments were performed considering the image retrieval and ranking scenarios, and the performance of OPF-based approaches was compared to the well-known SVM-Rank pairwise technique and a baseline based on distance calculation. The experiments showed competitive results concerning precision and outperformed traditional techniques in terms of computational load.


title: Rank gain of Jacobians over number field extensions with prescribed Galois groups

abstract: We investigate the rank gain of elliptic curves, and more generally, Jacobian varieties, over non-Galois extensions whose Galois closure has Galois group permutation-isomorphic to a prescribed group $G$ (in short, "$G$-extensions"). In particular, for alternating groups and (an infinite family of) projective linear groups $G$, we show that most elliptic curves over (e.g.) $\mathbb{Q}$ gain rank over infinitely many $G$-extensions, conditional only on the parity conjecture. More generally, we provide a theoretical criterion which allows to deduce that "many" elliptic curves gain rank over infinitely many $G$-extensions, conditional on the parity conjecture and on the existence of geometric Galois realizations with group $G$ and certain local properties.


title: User-Inspired Posterior Network for Recommendation Reason Generation

abstract: Recommendation reason generation, aiming at showing the selling points of products for customers, plays a vital role in attracting customers' attention as well as improving user experience. A simple and effective way is to extract keywords directly from the knowledge-base of products, i.e., attributes or title, as the recommendation reason. However, generating recommendation reason from product knowledge doesn't naturally respond to users' interests. Fortunately, on some E-commerce websites, there exists more and more user-generated content (user-content for short), i.e., product question-answering (QA) discussions, which reflect user-cared aspects. Therefore, in this paper, we consider generating the recommendation reason by taking into account not only the product attributes but also the customer-generated product QA discussions. In reality, adequate user-content is only possible for the most popular commodities, whereas large sums of long-tail products or new products cannot gather a sufficient number of user-content. To tackle this problem, we propose a user-inspired multi-source posterior transformer (MSPT), which induces the model reflecting the users' interests with a posterior multiple QA discussions module, and generating recommendation reasons containing the product attributes as well as the user-cared aspects. Experimental results show that our model is superior to traditional generative models. Additionally, the analysis also shows that our model can focus more on the user-cared aspects than baselines.


title: Training Larger Networks for Deep Reinforcement Learning

abstract: The success of deep learning in the computer vision and natural language processing communities can be attributed to training of very deep neural networks with millions or billions of parameters which can then be trained with massive amounts of data. However, similar trend has largely eluded training of deep reinforcement learning (RL) algorithms where larger networks do not lead to performance improvement. Previous work has shown that this is mostly due to instability during training of deep RL agents when using larger networks. In this paper, we make an attempt to understand and address training of larger networks for deep RL. We first show that naively increasing network capacity does not improve performance. Then, we propose a novel method that consists of 1) wider networks with DenseNet connection, 2) decoupling representation learning from training of RL, 3) a distributed training method to mitigate overfitting problems. Using this three-fold technique, we show that we can train very large networks that result in significant performance gains. We present several ablation studies to demonstrate the efficacy of the proposed method and some intuitive understanding of the reasons for performance gain. We show that our proposed method outperforms other baseline algorithms on several challenging locomotion tasks.


title: The DeCAMFounder: Non-Linear Causal Discovery in the Presence of Hidden Variables

abstract: Many real-world decision-making tasks require learning causal relationships between a set of variables. Traditional causal discovery methods, however, require that all variables are observed, which is often not feasible in practical scenarios. Without additional assumptions about the unobserved variables, it is not possible to recover any causal relationships from observational data. Fortunately, in many applied settings, additional structure among the confounders can be expected. In particular, pervasive confounding is commonly encountered and has been utilized for consistent causal estimation in linear causal models. In this paper, we present a provably consistent method to estimate causal relationships in the non-linear, pervasive confounding setting. The core of our procedure relies on the ability to estimate the confounding variation through a simple spectral decomposition of the observed data matrix. We derive a DAG score function based on this insight, prove its consistency in recovering a correct ordering of the DAG, and empirically compare it to previous approaches. We demonstrate improved performance on both simulated and real datasets by explicitly accounting for both confounders and non-linear effects.


title: Accelerated Algorithms for Smooth Convex-Concave Minimax Problems with $\mathcal{O}(1/k^2)$ Rate on Squared Gradient Norm

abstract: In this work, we study the computational complexity of reducing the squared gradient magnitude for smooth minimax optimization problems. First, we present algorithms with accelerated $\mathcal{O}(1/k^2)$ last-iterate rates, faster than the existing $\mathcal{O}(1/k)$ or slower rates for extragradient, Popov, and gradient descent with anchoring. The acceleration mechanism combines extragradient steps with anchoring and is distinct from Nesterov's acceleration. We then establish optimality of the $ \mathcal{O}(1/k^2)$ rate through a matching lower bound.


title: Darboux-Frame-Based Parametrization for a Spin-Rolling Sphere on a Plane: A Nonlinear Transformation of Underactuated System to Fully-Actuated Model

abstract: This paper presents a new kinematic model based on the Darboux frame for motion control and planning. In this work, we show that an underactuated model of a spin-rolling sphere on a plane with five states and three inputs can be transformed into a fully-actuated one by a given Darboux frame transformation. This nonlinear state transformation establishes a geometric model that is different from conventional state-space ones. First, a kinematic model of the Darboux frame at the contact point of the rolling sphere is established. Next, we propose a virtual surface that is trapped between the sphere and the contact plane. This virtual surface is used for generating arc-length-based inputs for controlling the contact trajectories on the sphere and the plane. Finally, we discuss the controllability of this new model. In the future, we will design a geometric path planning method for the proposed kinematic model.


title: Compilation of mathematical expressions in Kotlin

abstract: Interpreting mathematical expressions at runtime is a standard task in scientific software engineering. There are different approaches to this problem from creating an embedded domain-specific language (eDSL) with its own parser and interpreter specifically for that task, to using a full-fledged embedded compiler. This article is dedicated to a middle-ground solution implemented in the KMath library, which uses the Kotlin object builder DSL and its own algebraic abstractions to generate an AST for mathematical operations. This AST is then compiled just-in-time to generate JVM bytecode. A similar approach is tested on other Kotlin platforms, where its performance is compared across a variety of supported platforms.


title: Focal Inverse Distance Transform Maps for Crowd Localization

abstract: In this paper, we focus on the crowd localization task, a crucial topic of crowd analysis. Most regression-based methods utilize convolution neural networks (CNN) to regress a density map, which can not accurately locate the instance in the extremely dense scene, attributed to two crucial reasons: 1) the density map consists of a series of blurry Gaussian blobs, 2) severe overlaps exist in the dense region of the density map. To tackle this issue, we propose a novel Focal Inverse Distance Transform (FIDT) map for the crowd localization task. Compared with the density maps, the FIDT maps accurately describe the persons' locations without overlapping in dense regions. Based on the FIDT maps, a Local-Maxima-Detection-Strategy (LMDS) is derived to effectively extract the center point for each individual. Furthermore, we introduce an Independent SSIM (I-SSIM) loss to make the model tend to learn the local structural information, better recognizing local maxima. Extensive experiments demonstrate that the proposed method reports state-of-the-art localization performance on six crowd datasets and one vehicle dataset. Additionally, we find that the proposed method shows superior robustness on the negative and extremely dense scenes, which further verifies the effectiveness of the FIDT maps. The code and model will be available at https://github.com/dk-liang/FIDTM.


title: Have Attention Heads in BERT Learned Constituency Grammar?

abstract: With the success of pre-trained language models in recent years, more and more researchers focus on opening the "black box" of these models. Following this interest, we carry out a qualitative and quantitative analysis of constituency grammar in attention heads of BERT and RoBERTa. We employ the syntactic distance method to extract implicit constituency grammar from the attention weights of each head. Our results show that there exist heads that can induce some grammar types much better than baselines, suggesting that some heads act as a proxy for constituency grammar. We also analyze how attention heads' constituency grammar inducing (CGI) ability changes after fine-tuning with two kinds of tasks, including sentence meaning similarity (SMS) tasks and natural language inference (NLI) tasks. Our results suggest that SMS tasks decrease the average CGI ability of upper layers, while NLI tasks increase it. Lastly, we investigate the connections between CGI ability and natural language understanding ability on QQP and MNLI tasks.


title: Structured Dropout Variational Inference for Bayesian Neural Networks

abstract: Approximate inference in Bayesian deep networks exhibits a dilemma of how to yield high fidelity posterior approximations while maintaining computational efficiency and scalability. We tackle this challenge by introducing a novel variational structured approximation inspired by the Bayesian interpretation of Dropout regularization. Concretely, we focus on the inflexibility of the factorized structure in Dropout posterior and then propose an improved method called Variational Structured Dropout (VSD). VSD employs an orthogonal transformation to learn a structured representation on the variational Gaussian noise with plausible complexity, and consequently induces statistical dependencies in the approximate posterior. Theoretically, VSD successfully addresses the pathologies of previous Variational Dropout methods and thus offers a standard Bayesian justification. We further show that VSD induces an adaptive regularization term with several desirable properties which contribute to better generalization. Finally, we conduct extensive experiments on standard benchmarks to demonstrate the effectiveness of VSD over state-of-the-art variational methods on predictive accuracy, uncertainty estimation, and out-of-distribution detection.


title: Ramification groups of some finite Galois extensions of maximal nilpotency class over local fields of positive characteristic

abstract: We examine the ramification groups of finite Galois extensions over complete discrete valuation fields of equal characteristic $p>0$. Brylinski (1983) calculated the ramification groups in the case where the Galois groups are abelian. We extend the results of Brylinski to some non-abelian cases where the Galois groups are of order $\leq p^{p+1}$ and of maximal nilpotency class.


title: Near-Optimal Algorithms for Differentially Private Online Learning in a Stochastic Environment

abstract: In this paper, we study differentially private online learning problems in a stochastic environment under both bandit and full information feedback. For differentially private stochastic bandits, we propose both UCB and Thompson Sampling-based algorithms that are anytime and achieve the optimal $O \left(\sum_{j: \Delta_j>0} \frac{\ln(T)}{\min \left\{\Delta_j, \epsilon \right\}} \right)$ instance-dependent regret bound, where $T$ is the finite learning horizon, $\Delta_j$ denotes the suboptimality gap between the optimal arm and a suboptimal arm $j$, and $\epsilon$ is the required privacy parameter. For the differentially private full information setting with stochastic rewards, we show an $\Omega \left(\frac{\ln(K)}{\min \left\{\Delta_{\min}, \epsilon \right\}} \right)$ instance-dependent regret lower bound and an $\Omega\left(\sqrt{T\ln(K)} + \frac{\ln(K)}{\epsilon}\right)$ minimax lower bound, where $K$ is the total number of actions and $\Delta_{\min}$ denotes the minimum suboptimality gap among all the suboptimal actions. For the same differentially private full information setting, we also present an $\epsilon$-differentially private algorithm whose instance-dependent regret and worst-case regret match our respective lower bounds up to an extra $\log(T)$ factor.


title: Thermodynamically Consistent Algorithms for Models of Diblock Copolymer Solutions Interacting with Electric and Magnetic Fields

abstract: We derive thermodynamically consistent models for diblock copolymer solutions coupled with the electric and magnetic field, respectively. These models satisfy the second law of thermodynamics and therefore are therefore thermodynamically consistent. We then design a set of 2nd order, linear, semi-discrete schemes for the models using the energy quadratization method and the supplementary variable method, respectively, which preserve energy dissipation rates of the models. The spatial discretization is carried out subsequently using 2nd order finite difference methods, leading to fully discrete algorithms that preserve discrete energy-dissipation-rates of the models so that the resulting fully discrete models are thermodynamically consistent. Convergence rates are numerically confirmed through mesh refinement tests and several numerical examples are given to demonstrate the role of the mobility in pattern formation, defect removing effect of both electric and magnetic fields as well as the hysteresis effect for applied external fields in copolymer solutions.


title: A Shuffle Theorem for Paths Under Any Line

abstract: We generalize the shuffle theorem and its $(km,kn)$ version, as conjectured by Haglund et al. and Bergeron et al., and proven by Carlsson and Mellit, and Mellit, respectively. In our version the $(km,kn)$ Dyck paths on the combinatorial side are replaced by lattice paths lying under a line segment whose $x$ and $y$ intercepts need not be integers, and the algebraic side is given either by a Schiffmann algebra operator formula or an equivalent explicit raising operator formula. We derive our combinatorial identity as the polynomial truncation of an identity of infinite series of $GL_{l}$ characters, expressed in terms of infinite series versions of LLT polynomials. The series identity in question follows from a Cauchy identity for non-symmetric Hall-Littlewood polynomials.


title: Brief Note: Fast Authenticated Byzantine Consensus

abstract: Byzantine fault-tolerant (BFT) state machine replication (SMR) has been studied for over 30 years. Recently it has received more attention due to its application in permissioned blockchain systems. A sequence of research efforts focuses on improving the commit latency of the SMR protocol in the common good case, including PBFT with $3$-round latency and $n\geq 3f+1$ and FaB with $2$-round latency and $n\geq 5f+1$. In this paper, we propose an authenticated protocol that solves $2$-round BFT SMR with only $n\geq 5f-1$ replicas, which refutes the optimal resiliency claim made in FaB for needing $n \geq 5f+1$ for $2$-round PBFT-style BFT protocols. For the special case when $f=1$, our protocol needs only $4$ replicas, and strictly improves PBFT by reducing the latency by one round (even when one backup is faulty).


title: GraphGallery: A Platform for Fast Benchmarking and Easy Development of Graph Neural Networks Based Intelligent Software

abstract: Graph Neural Networks (GNNs) have recently shown to be powerful tools for representing and analyzing graph data. So far GNNs is becoming an increasingly critical role in software engineering including program analysis, type inference, and code representation. In this paper, we introduce GraphGallery, a platform for fast benchmarking and easy development of GNNs based software. GraphGallery is an easy-to-use platform that allows developers to automatically deploy GNNs even with less domain-specific knowledge. It offers a set of implementations of common GNN models based on mainstream deep learning frameworks. In addition, existing GNNs toolboxes such as PyG and DGL can be easily incorporated into the platform. Experiments demonstrate the reliability of implementations and superiority in fast coding. The official source code of GraphGallery is available at https://github.com/EdisonLeeeee/GraphGallery and a demo video can be found at https://youtu.be/mv7Zs1YeaYo.


title: System of Degenerate Parabolic $p$-Laplacian

abstract: In this paper, we study the mathematical properties of the solution $\bold{u}=\left(u^1,\cdots,u^k\right)$ to the degenerate parabolic system \begin{equation*} \bold{u}_t=\nabla\cdot\left(\left|\nabla\bold{u}\right|^{p-2}\nabla \bold{u}\right), \qquad \qquad \left(p>2\right). \end{equation*} More precisely, we show the uniqueness and existence of solution $\bold{u}$ and investigate a priori $L^{\infty}$ boundedness of the gradient of the solution. Assuming that the solution decays quickly at infinity, we also prove that the component $u^l$, $\left(1\leq l\leq k\right)$, converges to the function $c^l\mathcal{B}$ in space as $t\to\infty$. Here, the function $\mathcal{B}$ is the fundamental or Barenblatt solution of $p$-Laplacian equation and the constant $c^l$ is determined by the $L^1$-mass of $u^l$. The proof is based on the existence of entropy functional.\\ \indent As an application of the asymptotic large time behaviour, we establish a Harnack type inequality which makes the size of spatial average being controlled by the value of solution at one point.


title: Hierarchical Transformer-based Large-Context End-to-end ASR with Large-Context Knowledge Distillation

abstract: We present a novel large-context end-to-end automatic speech recognition (E2E-ASR) model and its effective training method based on knowledge distillation. Common E2E-ASR models have mainly focused on utterance-level processing in which each utterance is independently transcribed. On the other hand, large-context E2E-ASR models, which take into account long-range sequential contexts beyond utterance boundaries, well handle a sequence of utterances such as discourses and conversations. However, the transformer architecture, which has recently achieved state-of-the-art ASR performance among utterance-level ASR systems, has not yet been introduced into the large-context ASR systems. We can expect that the transformer architecture can be leveraged for effectively capturing not only input speech contexts but also long-range sequential contexts beyond utterance boundaries. Therefore, this paper proposes a hierarchical transformer-based large-context E2E-ASR model that combines the transformer architecture with hierarchical encoder-decoder based large-context modeling. In addition, in order to enable the proposed model to use long-range sequential contexts, we also propose a large-context knowledge distillation that distills the knowledge from a pre-trained large-context language model in the training phase. We evaluate the effectiveness of the proposed model and proposed training method on Japanese discourse ASR tasks.


title: DFAC Framework: Factorizing the Value Function via Quantile Mixture for Multi-Agent Distributional Q-Learning

abstract: In fully cooperative multi-agent reinforcement learning (MARL) settings, the environments are highly stochastic due to the partial observability of each agent and the continuously changing policies of the other agents. To address the above issues, we integrate distributional RL and value function factorization methods by proposing a Distributional Value Function Factorization (DFAC) framework to generalize expected value function factorization methods to their DFAC variants. DFAC extends the individual utility functions from deterministic variables to random variables, and models the quantile function of the total return as a quantile mixture. To validate DFAC, we demonstrate DFAC's ability to factorize a simple two-step matrix game with stochastic rewards and perform experiments on all Super Hard tasks of StarCraft Multi-Agent Challenge, showing that DFAC is able to outperform expected value function factorization baselines.


title: Inverse Reinforcement Learning in a Continuous State Space with Formal Guarantees

abstract: Inverse Reinforcement Learning (IRL) is the problem of finding a reward function which describes observed/known expert behavior. The IRL setting is remarkably useful for automated control, in situations where the reward function is difficult to specify manually or as a means to extract agent preference. In this work, we provide a new IRL algorithm for the continuous state space setting with unknown transition dynamics by modeling the system using a basis of orthonormal functions. Moreover, we provide a proof of correctness and formal guarantees on the sample and time complexity of our algorithm. Finally, we present synthetic experiments to corroborate our theoretical guarantees.


title: Global Well-posedness of Classical Solutions to the Compressible Navier-Stokes-Poisson Equations with Slip Boundary Conditions in 3D Bounded Domains

abstract: We consider the initial-boundary-value problem of the isentropic compressible Navier-Stokes-Poisson equations subject to large and non-flat doping profile in 3D bounded domain with slip boundary condition and vacuum. The global well-posedness of classical solution is established with small initial energy but possibly large oscillations and vacuum. The steady state (except velocity) and the doping profile are allowed to be of large variation.


title: Embedded solitons in second-harmonic-generating lattices

abstract: Embedded solitons are exceptional modes in nonlinear-wave systems with the propagation constant falling in the system's propagation band. An especially challenging topic is seeking for such modes in nonlinear dynamical lattices (discrete systems). We address this problem for a system of coupled discrete equations modeling the light propagation in an array of tunnel-coupled waveguides with a combination of intrinsic quadratic (second-harmonic-generating) and cubic nonlinearities. Solutions for discrete embedded solitons (DESs) are constructed by means of two analytical approximations, adjusted, severally, for broad and narrow DESs, and in a systematic form with the help of numerical calculations. DESs of several types, including ones with identical and opposite signs of their fundamental-frequency and second-harmonic components, are produced. In the most relevant case of narrow DESs, the analytical approximation produces very accurate results, in comparison with the numerical findings. In this case, the DES branch extends from the propagation band into a semi-infinite gap as a family of regular discrete solitons. The study of stability of DESs demonstrates that, in addition to ones featuring the well-known property of semi-stability, there are linearly stable DESs which are genuinely robust modes.


title: Attitude Trajectory Optimization for Agile Satellites in Autonomous Remote Sensing Constellation

abstract: Agile attitude maneuvering maximizes the utility of remote sensing satellite constellations. By taking into account a satellite's physical properties and its actuator specifications, we may leverage the full performance potential of the attitude control system to conduct agile remote sensing beyond conventional slew-and-stabilize maneuvers. Employing a constellation of agile satellites, coordinated by an autonomous and responsive scheduler, can significantly increase overall response rate, revisit time and global coverage for the mission. In this paper, we use recent advances in sequential convex programming based trajectory optimization to enable rapid-target acquisition, pointing and tracking capabilities for a scheduler-based constellation. We present two problem formulations. The Minimum-Time Slew Optimal Control Problem determines the minimum time, required energy, and optimal trajectory to slew between any two orientations given nonlinear quaternion kinematics, gyrostat and actuator dynamics, and state/input constraints. By gridding the space of 3D rotations and efficiently solving this problem on the grid, we produce lookup tables or parametric fits off-line that can then be used on-line by a scheduler to compute accurate estimates of minimum-time and maneuver energy for real-time constellation scheduling. The Minimum-Effort Multi-Target Pointing Optimal Control Problem is used on-line by each satellite to produce continuous attitude-state and control-input trajectories that realize a given schedule while minimizing attitude error and control effort. The optimal trajectory may then be achieved by a low-level tracking controller. We demonstrate our approach with an example of a reference satellite in Sun-synchronous orbit passing over globally-distributed, Earth-observation targets.


title: On the dimension distortions of quasi-symmetric homeomorphisms

abstract: In this paper, we first generalize a result of Bishop and Steger [Representation theoretic rigidity in PSL(2, R). Acta Math., 170, (1993), 121-149] by proving that for a Fuchsian group $G$ of divergence type and non-lattice, if $h$ is a quasi-symmetric homeomorphism of the real axis $\mathbb{R}$ corresponding to a quasi-conformal compact deformation of $G$. Then for any $E\subset \mathbb{R}$, we have max(dim$E$, dim$h(\mathbb{R}\setminus E))=1$. Furthermore, we showed that Bishop and steger's result does not hold for the covering groups of all '$d$-dimensional jungle gym' (d is any positive integer) which generalizes G\"onye's results [ Differentiability of quasi-conformal maps on the jungle gym. Trans. Amer. Math. Soc. Vol 359 (2007), 9-32] where the author discussed the case of '$1$-dimensional jungle gym'.


title: Dirac index of some unitary representations of $Sp(2n, \mathbb{R})$ and $SO^*(2n)$

abstract: Let $G$ be $Sp(2n, \mathbb{R})$ or $SO^*(2n)$. We compute the Dirac index of a large class of unitary representations considered by Vogan in Section 8 of [Vog84], which include all weakly fair $A_{\mathfrak{q}}(\lambda)$ modules and (weakly) unipotent representations of $G$ as two extreme cases. We conjecture that these representations exhaust all unitary representations of $G$ with nonzero Dirac cohomology. In general, for certain irreducible unitary module of an equal rank group, we clarify the link between the possible cancellations in its Dirac index, and the parities of its spin-lowest $K$-types.


title: Structured Graph Learning for Scalable Subspace Clustering: From Single-view to Multi-view

abstract: Graph-based subspace clustering methods have exhibited promising performance. However, they still suffer some of these drawbacks: encounter the expensive time overhead, fail in exploring the explicit clusters, and cannot generalize to unseen data points. In this work, we propose a scalable graph learning framework, seeking to address the above three challenges simultaneously. Specifically, it is based on the ideas of anchor points and bipartite graph. Rather than building a $n\times n$ graph, where $n$ is the number of samples, we construct a bipartite graph to depict the relationship between samples and anchor points. Meanwhile, a connectivity constraint is employed to ensure that the connected components indicate clusters directly. We further establish the connection between our method and the K-means clustering. Moreover, a model to process multi-view data is also proposed, which is linear scaled with respect to $n$. Extensive experiments demonstrate the efficiency and effectiveness of our approach with respect to many state-of-the-art clustering methods.


title: Deep Equilibrium Architectures for Inverse Problems in Imaging

abstract: Recent efforts on solving inverse problems in imaging via deep neural networks use architectures inspired by a fixed number of iterations of an optimization method. The number of iterations is typically quite small due to difficulties in training networks corresponding to more iterations; the resulting solvers cannot be run for more iterations at test time without incurring significant errors. This paper describes an alternative approach corresponding to an infinite number of iterations, yielding a consistent improvement in reconstruction accuracy above state-of-the-art alternatives and where the computational budget can be selected at test time to optimize context-dependent trade-offs between accuracy and computation. The proposed approach leverages ideas from Deep Equilibrium Models, where the fixed-point iteration is constructed to incorporate a known forward model and insights from classical optimization-based reconstruction methods.


title: Local Hyper-Flow Diffusion

abstract: Recently, hypergraphs have attracted a lot of attention due to their ability to capture complex relations among entities. The insurgence of hypergraphs has resulted in data of increasing size and complexity that exhibit interesting small-scale and local structure, e.g., small-scale communities and localized node-ranking around a given set of seed nodes. Popular and principled ways to capture the local structure are the local hypergraph clustering problem and related seed set expansion problem. In this work, we propose the first local diffusion method that achieves edge-size-independent Cheeger-type guarantee for the problem of local hypergraph clustering while applying to a rich class of higher-order relations that covers many previously studied special cases. Our method is based on a primal-dual optimization formulation where the primal problem has a natural network flow interpretation, and the dual problem has a cut-based interpretation using the $\ell_2$-norm penalty on associated cut-costs. We demonstrate the new technique is significantly better than state-of-the-art methods on both synthetic and real-world data.


title: A generalization of the Ross symbols in higher K-groups and hypergeometric functions II

abstract: This is a sequel of the paper "A generalization of the Ross symbols in higher K-groups and hypergeometric functions I" where we introduced higher Ross symbols in higher $K$-groups of the hypergeometric schemes, and discussed the Beilinson regulators. In this paper we give its p-adic counterpart and an application to the $p$-adic Beilinson conjecture for K3 surfaces of Picard number 20.


title: Multi-band observations of Swift J0840.7-3516: a new transient ultra-compact X-ray binary candidate

abstract: We report on multi-band observations of the transient source Swift J0840.7-3516, which was detected in outburst in 2020 February by the Neil Gehrels Swift Observatory. The outburst episode lasted just ~5 days, during which the X-ray luminosity quickly decreased from ~3E37 erg/s at peak down to ~5E33 erg/s in quiescence (0.3-10 keV; at 10 kpc). Such a marked and rapid decrease in the flux was also registered at UV and optical wavelengths. In outburst, the source showed considerable aperiodic variability in the X-rays on timescales as short as a few seconds. The spectrum of the source in the energy range 0.3-20 keV was well described by a thermal, blackbody-like, component plus a non-thermal, power law-like, component and it softened considerably as the source returned to quiescence. The spectrum of the optical counterpart in quiescence showed broad emission features associated mainly with ionised carbon and oxygen, superposed on a blue continuum. No evidence for bright continuum radio emission was found in quiescence. We discuss possible scenarios for the nature of this source, and show that the observed phenomenology points to a transient ultra-compact X-ray binary system.


title: In Most 6-regular Toroidal Graphs All 5-colorings are Kempe Equivalent

abstract: A Kempe swap in a proper coloring interchanges the colors on some maximal connected 2-colored subgraph. Two $k$-colorings are $k$-equivalent if we can transform one into the other using Kempe swaps. The triangulated toroidal grid, $T[m\times n]$, is formed from (a toroidal embedding of) the Cartesian product of $C_m$ and $C_n$ by adding parallel diagonals inside all 4-faces. Mohar and Salas showed that not all 4-colorings of $T[m\times n]$ are 4-equivalent. In contrast, Bonamy, Bousquet, Feghali, and Johnson showed that all 6-colorings of $T[m\times n]$ are 6-equivalent. They asked whether the same is true for 5-colorings. We answer their question affirmatively when $m,n\ge 6$. Further, we show that if $G$ is 6-regular with a toroidal embedding where every non-contractible cycle has length at least 7, then all 5-colorings of $G$ are 5-equivalent. Our results relate to the antiferromagnetic Pott's model in statistical mechanics.


title: Optimal Distributed Frequency and Voltage Control for Zonal Electricity Markets

abstract: Zonal pricing is a well-suited mechanism to incentivize grid-supporting behavior of profit-maximizing producers and consumers operating on a large-scale power system. In zonal electricity markets, local system operators create individual price zones, which provide appropriate price signals depending on local grid conditions such as an excess or shortage of electrical energy in certain regions. In this paper, a real-time zonal pricing controller for AC power networks is presented that ensures frequency and voltage stability as well as Pareto efficiency of the resulting closed-loop equilibria. Based on a dynamic network model that takes line losses and power exchange with adjacent price zones into account, distributed continuous-time control laws are derived which require only neighbor-to-neighbor communication. Application to a real-time congestion management strategy illustrates how spatially and temporally differentiated prices enable grid-supportive operation of the participants without interventions by a superordinate control authority. Effectiveness of different zonal pricing concepts compared to an isolated grid operation is demonstrated through simulations on the IEEE-57 bus system.


title: On the condition for the central caustic degeneracy of the planetary microlensing

abstract: It is shown that the linear approximation of the central caustic for the planetary ($q\ll1$) microlensing is valid if $|1-s|\gg q^{1/3}$ (where $q$ is the mass ratio and $s$ is the projected separation in the unit of the Einstein ring radius of the primary). The condition is also consistent with the requirement that the binary separation is far from those in the resonant binary regime resulting in a single six-cusp caustic. Given that the linear approximation of the caustic is invariant under $s\leftrightarrow s^{-1}$, the close/wide binary degeneracy observed under the same condition may be understood via the linear approximation of the central caustic. Finally it is argued that the local degeneracies of lensing features associated with caustic crossings can still persist in the planetary events even when $|1-s|\sim q^{1/3}$ although the overall caustic shape may not be degenerate at all.