title: Estimating Counterfactual Treatment Outcomes over Time Through Adversarially Balanced Representations

abstract: Identifying when to give treatments to patients and how to select among multiple treatments over time are important medical problems with a few existing solutions. In this paper, we introduce the Counterfactual Recurrent Network (CRN), a novel sequence-to-sequence model that leverages the increasingly available patient observational data to estimate treatment effects over time and answer such medical questions. To handle the bias from time-varying confounders, covariates affecting the treatment assignment policy in the observational data, CRN uses domain adversarial training to build balancing representations of the patient history. At each timestep, CRN constructs a treatment invariant representation which removes the association between patient history and treatment assignments and thus can be reliably used for making counterfactual predictions. On a simulated model of tumour growth, with varying degree of time-dependent confounding, we show how our model achieves lower error in estimating counterfactuals and in choosing the correct treatment and timing of treatment than current state-of-the-art methods.


title: Archipelagos of Total Bound and Free Entanglement. II

abstract: In the indicated preceding preprint (I), we reported the results of, in particular interest here, certain three-parameter qubit-ququart ($2 \times 4$) and two-ququart ($4 \times 4$) analyses. In them, we relied upon entanglement constraints given by Li and Qiao. However, further studies of ours conclusively show--using the well-known necessary and sufficient conditions for positive-semidefiniteness that all leading minors (of separable components, in this context) be nonnegative--that certain of the constraints given are flawed and need to be replaced (by weaker ones). Doing so, leads to a new set of results, somewhat qualitatively different and, in certain respects, simpler in nature. For example, bound-entanglement probabilities of $\frac{2}{3} \left(\sqrt{2}-1\right) \approx 0.276142$, $\frac{1}{4} \left(3-2 \log ^2(2)-\log (4)\right) \approx 0.1632$, $\frac{1}{2}-\frac{2}{3 \pi ^2} \approx 0.432453$ and $\frac{1}{6}$, are reported for various implementations of constraints. We also adopt the Li-Qiao three-parameter framework to a two-parameter one, with interesting visual results.


title: Proof of Sarkar-Kumar's Conjectures on Average Entanglement Entropies over the Bures-Hall Ensemble

abstract: Sarkar and Kumar recently conjectured [J. Phys. A: Math. Theor. $\textbf{52}$, 295203 (2019)] that for a bipartite system of Hilbert dimension $mn$, the mean values of quantum purity and von Neumann entropy of a subsystem of dimension $m\leq n$ over the Bures-Hall measure are given by \begin{equation*} \frac{2n(2n+m)-m^{2}+1}{2n(2mn-m^2+2)} \end{equation*} and \begin{equation*} \psi_{0}\left(mn-\frac{m^2}{2}+1\right)-\psi_{0}\left(n+\frac{1}{2}\right), \end{equation*} respectively, where $\psi_{0}(\cdot)$ is the digamma function. We prove the above conjectured formulas in this work. A key ingredient of the proofs is Forrester and Kieburg's discovery on the connection between the Bures-Hall ensemble and the Cauchy-Laguerre biorthogonal ensemble studied by Bertola, Gekhtman, and Szmigielski.


title: Convergent Under-Approximations of Reachable Sets and Tubes for Linear Uncertain Systems

abstract: In this note, we propose a method to under-approximate finite-time reachable sets and tubes for a class of continuous-time linear uncertain systems. The class under consideration is the linear time-varying (LTV) class with integrable time-varying system matrices and uncertain initial and input values belonging to known convex compact sets. The proposed method depends upon the iterative use of constant-input reachable sets which results in convergent under-approximations in the sense of Hausdorff distance. We illustrate our approach through two numerical examples.


title: Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy

abstract: Well-designed technologies that offer high levels of human control and high levels of computer automation can increase human performance, leading to wider adoption. The Human-Centered Artificial Intelligence (HCAI) framework clarifies how to (1) design for high levels of human control and high levels of computer automation so as to increase human performance, (2) understand the situations in which full human control or full computer control are necessary, and (3) avoid the dangers of excessive human control or excessive computer control. The methods of HCAI are more likely to produce designs that are Reliable, Safe & Trustworthy (RST). Achieving these goals will dramatically increase human performance, while supporting human self-efficacy, mastery, creativity, and responsibility.


title: Electronic g-factor and Magneto-transport in InSb Quantum Wells

abstract: High mobility InSb quantum wells with tunable carrier densities are investigated by transport experiments in magnetic fields tilted with respect to the sample normal. We employ the coincidence method and the temperature dependence of the Shubnikov-de Haas oscillations and find a value for the effective g-factor of $\mid g^{\ast}\mid $ =35$\pm$4 and a value for the effective mass of $m^*\approx0.017 m_0$, where $m_0$ is the electron mass in vacuum. Our measurements are performed in a magnetic field and a density range where the enhancement mechanism of the effective g-factor can be neglected. Accordingly, the obtained effective g-factor and the effective mass can be quantitatively explained in a single particle picture. Additionally, we explore the magneto-transport up to magnetic fields of 35 T and do not find features related to the fractional quantum Hall effect.


title: Mapping class group actions from Hopf monoids and ribbon graphs

abstract: We show that any pivotal Hopf monoid $H$ in a symmetric monoidal category $\mathcal{C}$ gives rise to actions of mapping class groups of oriented surfaces of genus $g \geq 1$ with $n \geq 1$ boundary components. These mapping class group actions are given by group homomorphisms into the group of automorphisms of certain Yetter-Drinfeld modules over $H$. They are associated with edge slides in embedded ribbon graphs that generalise chord slides in chord diagrams. We give a concrete description of these mapping class group actions in terms of generating Dehn twists and defining relations. For the case where $\mathcal{C}$ is finitely complete and cocomplete, we also obtain actions of mapping class groups of closed surfaces by imposing invariance and coinvariance under the Yetter-Drinfeld module structure.


title: Convergence Guarantees of Policy Optimization Methods for Markovian Jump Linear Systems

abstract: Recently, policy optimization for control purposes has received renewed attention due to the increasing interest in reinforcement learning. In this paper, we investigate the convergence of policy optimization for quadratic control of Markovian jump linear systems (MJLS). First, we study the optimization landscape of direct policy optimization for MJLS, and, in particular, show that despite the non-convexity of the resultant problem the unique stationary point is the global optimal solution. Next, we prove that the Gauss-Newton method and the natural policy gradient method converge to the optimal state feedback controller for MJLS at a linear rate if initialized at a controller which stabilizes the closed-loop dynamics in the mean square sense. We propose a novel Lyapunov argument to fix a key stability issue in the convergence proof. Finally, we present a numerical example to support our theory. Our work brings new insights for understanding the performance of policy learning methods on controlling unknown MJLS.


title: Learning to Solve Network Flow Problems via Neural Decoding

abstract: Many decision-making problems in engineering applications such as transportation, power system and operations research require repeatedly solving large-scale linear programming problems with a large number of different inputs. For example, in energy systems with high levels of uncertain renewable resources, tens of thousands of scenarios may need to be solved every few minutes. Standard iterative algorithms for linear network flow problems, even though highly efficient, becomes a bottleneck in these applications. In this work, we propose a novel learning approach to accelerate the solving process. By leveraging the rich theory and economic interpretations of LP duality, we interpret the output of the neural network as a noisy codeword, where the codebook is given by the optimization problem's KKT conditions. We propose a feedforward decoding strategy that finds the optimal set of active constraints. This design is error correcting and can offer orders of magnitude speedup compared to current state-of-the-art iterative solvers, while providing much better solutions in terms of feasibility and optimality compared to end-to-end learning approaches.


title: Synchronization of Coupled Kuramoto Oscillators under Resource Constraints

abstract: A fundamental understanding of synchronized behavior in multi-agent systems can be acquired by studying analytically tractable Kuramoto models. However, such models typically diverge from many real systems whose dynamics evolve under non-negligible resource constraints. Here we construct a system of coupled Kuramoto oscillators that consume or produce resources as a function of their oscillation frequency. At high coupling, we observe strongly synchronized dynamics, whereas at low coupling we observe independent oscillator dynamics, as expected from standard Kuramoto models. For intermediate coupling, which typically induces a partially synchronized state, we empirically observe that (and theoretically explain why) the system can exist in either (i) a state in which the order parameter oscillates in time, or (ii) a state in which multiple synchronization states are simultaneously stable. Whether (i) or (ii) occurs depends upon whether the oscillators consume or produce resources, respectively. Relevant for systems as varied as coupled neurons and social groups, our study lays important groundwork for future efforts to develop quantitative predictions of synchronized dynamics for systems embedded in environments marked by sparse resources.


title: Rigorous derivation of the generalized Reynolds equation from the Boltzmann equation

abstract: We study the stationary Boltzmann equation in a thin slab for a rarefied gas for which the molecular mean free path is comparable to the film thickness. We prove that there exists a solution which converges, in the hydrodynamic limit, to a density Maxwellian -- this density is obtained as the solution to the generalized Reynolds equation. The convergence is proved using a truncated Hilbert expansion by carefully estimating the remainder.


title: Model adaptation and unsupervised learning with non-stationary batch data under smooth concept drift

abstract: Most predictive models assume that training and test data are generated from a stationary process. However, this assumption does not hold true in practice. In this paper, we consider the scenario of a gradual concept drift due to the underlying non-stationarity of the data source. While previous work has investigated this scenario under a supervised-learning and adaption conditions, few have addressed the common, real-world scenario when labels are only available during training. We propose a novel, iterative algorithm for unsupervised adaptation of predictive models. We show that the performance of our batch adapted prediction algorithm is better than that of its corresponding unadapted version. The proposed algorithm provides similar (or better, in most cases) performance within significantly less run time compared to other state of the art methods. We validate our claims though extensive numerical evaluations on both synthetic and real data.


title: Automatic Discourse Segmentation: an evaluation in French

abstract: In this article, we describe some discursive segmentation methods as well as a preliminary evaluation of the segmentation quality. Although our experiment were carried for documents in French, we have developed three discursive segmentation models solely based on resources simultaneously available in several languages: marker lists and a statistic POS labeling. We have also carried out automatic evaluations of these systems against the Annodis corpus, which is a manually annotated reference. The results obtained are very encouraging.


title: Towards a distributed and infrastructure-less vehicular traffic management system

abstract: In the past few years, several systems have been proposed to deal with issues related to the vehicular traffic management. Usually, their solutions include the integration of computational technologies such as vehicular networks, central servers, and roadside units. Most systems use a hybrid approach, which means they still need a central entity (central server or roadside unit) and Internet connection to find out an en-route event as well as alternative routes for vehicles. It is easy to understand the need for a central entity because selecting the most appropriate vehicle to perform aforementioned procedures is a difficult task. In addition to that, as far as we know, there are very few systems that apply the altruistic approach (not selfish behavior) to routing decisions. Because of that, the issue addressed in this work is how to perform the vehicular traffic management, when an en-route event is detected, in a distributed, scalable, and cost-effective fashion. To deal with these issues, we proposed a distributed vehicle traffic management system, named as dEASY (distributed vEhicle trAffic management SYstem). The dEASY system was designed and implemented on a three-layer architecture, namely environment sensing and vehicle ranking, knowledge generation and distribution, and knowledge consumption. Each layer of the dEASY architecture is responsible for dealing with the main issues that were not addressed in related works or could be improved. Simulation results have shown that, compared with other systems from the literature, our proposed system has lower network overhead due to applied vehicle selection and broadcast suppression mechanisms. In average, dEASY also outperformed all other competitors in what regards to the travel time and time lost metrics. Through the analysis of results, it is possible to conclude that our infrastructure-less system is scalable and cost-effective.


title: Renyi entropy and the holographic dark energy in flat space time

abstract: Based on Renyi entropy, we study the entropy corrected version of the holographic dark energy (HDE) model in apparent horizon of spatially flat FLRW universe. Applying the generalized entropy leads to the modified version of the Friedmann evolution equations which besides pressure-less matter and HDE, there is an extra term that is purely geometric. This extra term are assumed as another part of dark energy. We assume the universe is filled by non-interacting components of ideal fluids such as dark matter and holographic dark energy. The total dark energy, which is a combination of generalized HDE and geometric part, has a density parameter that approaches one by decreasing the redshift. Considering the total equation of state parameter and deceleration parameter of the universe indicates that the universe could stays in positive accelerated expansion phase that shows an agreement with observational data, only for the specific values of the constant $\zeta$.


title: Outlier Guided Optimization of Abdominal Segmentation

abstract: Abdominal multi-organ segmentation of computed tomography (CT) images has been the subject of extensive research interest. It presents a substantial challenge in medical image processing, as the shape and distribution of abdominal organs can vary greatly among the population and within an individual over time. While continuous integration of novel datasets into the training set provides potential for better segmentation performance, collection of data at scale is not only costly, but also impractical in some contexts. Moreover, it remains unclear what marginal value additional data have to offer. Herein, we propose a single-pass active learning method through human quality assurance (QA). We built on a pre-trained 3D U-Net model for abdominal multi-organ segmentation and augmented the dataset either with outlier data (e.g., exemplars for which the baseline algorithm failed) or inliers (e.g., exemplars for which the baseline algorithm worked). The new models were trained using the augmented datasets with 5-fold cross-validation (for outlier data) and withheld outlier samples (for inlier data). Manual labeling of outliers increased Dice scores with outliers by 0.130, compared to an increase of 0.067 with inliers (p<0.001, two-tailed paired t-test). By adding 5 to 37 inliers or outliers to training, we find that the marginal value of adding outliers is higher than that of adding inliers. In summary, improvement on single-organ performance was obtained without diminishing multi-organ performance or significantly increasing training time. Hence, identification and correction of baseline failure cases present an effective and efficient method of selecting training data to improve algorithm performance.


title: Dynamic Impact for Ant Colony Optimization algorithm

abstract: This paper proposes an extension method for Ant Colony Optimization (ACO) algorithm called Dynamic Impact. Dynamic Impact is designed to solve challenging optimization problems that has nonlinear relationship between resource consumption and fitness in relation to other part of the optimized solution. This proposed method is tested against complex real-world Microchip Manufacturing Plant Production Floor Optimization (MMPPFO) problem, as well as theoretical benchmark Multi-Dimensional Knapsack problem (MKP). MMPPFO is a non-trivial optimization problem, due the nature of solution fitness value dependence on collection of wafer-lots without prioritization of any individual wafer-lot. Using Dynamic Impact on single objective optimization fitness value is improved by 33.2%. Furthermore, MKP benchmark instances of small complexity have been solved to 100% success rate where high degree of solution sparseness is observed, and large instances have showed average gap improved by 4.26 times. Algorithm implementation demonstrated superior performance across small and large datasets and sparse optimization problems.


title: Correcting for Leakage Energy in the SiD Silicon-Tungsten ECal

abstract: A dominant contribution to ECal resolution at high energy (eg. 100 GeV) comes from leakage beyond the containment of the calorimeter. We have studied the leakage energy for the SiD silicon-tungsten ECal and developed a neural network algorithm for estimating the leakage energy and correcting the energy measurement. The SiD TDR design calls for 20 thin 2.5 mm tungsten layers followed by 10 thick 5.0 mm tungsten layers. We have investigated the impact on the leakage energy of a reduced number of layers, and the ability of an optimized neutral network analysis to correct for the leakage with a reduced number of layers, and reduced material thickness. Reducing layer numbers is motivated by cost containment.


title: Sequential Monitoring of Changes in Housing Prices

abstract: We propose a sequential monitoring scheme to find structural breaks in real estate markets. The changes in the real estate prices are modeled by a combination of linear and autoregressive terms. The monitoring scheme is based on a detector and a suitably chosen boundary function. If the detector crosses the boundary function, a structural break is detected. We provide the asymptotics for the procedure under the stability null hypothesis and the stopping time under the change point alternative. Monte Carlo simulation is used to show the size and the power of our method under several conditions. We study the real estate markets in Boston, Los Angeles and at the national U.S. level. We find structural breaks in the markets, and we segment the data into stationary segments. It is observed that the autoregressive parameter is increasing but stays below 1.


title: Validation and Optimization of Multi-Organ Segmentation on Clinical Imaging Archives

abstract: Segmentation of abdominal computed tomography(CT) provides spatial context, morphological properties, and a framework for tissue-specific radiomics to guide quantitative Radiological assessment. A 2015 MICCAI challenge spurred substantial innovation in multi-organ abdominal CT segmentation with both traditional and deep learning methods. Recent innovations in deep methods have driven performance toward levels for which clinical translation is appealing. However, continued cross-validation on open datasets presents the risk of indirect knowledge contamination and could result in circular reasoning. Moreover, 'real world' segmentations can be challenging due to the wide variability of abdomen physiology within patients. Herein, we perform two data retrievals to capture clinically acquired deidentified abdominal CT cohorts with respect to a recently published variation on 3D U-Net (baseline algorithm). First, we retrieved 2004 deidentified studies on 476 patients with diagnosis codes involving spleen abnormalities (cohort A). Second, we retrieved 4313 deidentified studies on 1754 patients without diagnosis codes involving spleen abnormalities (cohort B). We perform prospective evaluation of the existing algorithm on both cohorts, yielding 13% and 8% failure rate, respectively. Then, we identified 51 subjects in cohort A with segmentation failures and manually corrected the liver and gallbladder labels. We re-trained the model adding the manual labels, resulting in performance improvement of 9% and 6% failure rate for the A and B cohorts, respectively. In summary, the performance of the baseline on the prospective cohorts was similar to that on previously published datasets. Moreover, adding data from the first cohort substantively improved performance when evaluated on the second withheld validation cohort.


title: SL(2,C) Floer cohomology for surgeries on some knots

abstract: We establish a relationship between the sheaf-theoretic SL(2,C) Floer cohomology HP(Y), as defined by Abouzaid and Manolescu, for Y a surgery on a small knot in S^3, and the SL(2,C) Casson invariant, as defined by Curtis. We determine a similar formula involving the framed sheaf-theoretic SL(2,C) Floer cohomology, HP_#(Y). We use these relationships to compute HP and HP_# for most surgeries on two-bridge knots. We also compute HP for surgeries on two non-small knots, the granny and square knots.


title: Energy and Spectral Efficiency Tradeoff in OFDMA Networks via Antenna Selection Strategy

abstract: In this paper, we investigate the joint resource allocation and antenna selection algorithm design for uplink orthogonal frequency division multiple access (OFDMA) communication system. We propose a multi-objective optimization framework to strike a balance between spectral efficiency (SE) and energy efficiency (EE). The resource allocation design is formulated as a multi-objective optimization problem (MOOP), where the conflicting objective functions are linearly combined into a single objective function employing the weighted sum method. In order to develop an efficient solution, the majorization minimization (MM) approach is proposed where a surrogate function serves as a lower bound of the objective function. Then an iterative suboptimal algorithm is proposed to maximize the approximate objective function. Numerical results unveil an interesting tradeoff between the considered conflicting system design objectives and reveal the improved EE and SE facilitated by the proposed transmit antenna selection in OFDMA systems.


title: Polarimetric characterization of light and media

abstract: An analysis of the matrix models representing the polarimetric properties of light and material media is carried out by using the concept of the coherency matrix, which leads to the identification and definition of their corresponding physical quantities. For light, cases of homogeneous and inhomogeneous wavefront are analyzed, and a model for 3D polarimetric purity is formulated. For linear passive material media, a general model is developed on the basis that any physically realizable linear transformation of Stokes vectors is equivalent to an ensemble average of passive, deterministic, nondepolarizing transformations. Through this framework, the relevant physical quantities, including the indices of polarimetric purity, are identified and decoupled. Some decompositions of the whole system into a set of well-defined components are considered, as well as techniques for isolating the unknown components by means of new procedures for subtracting coherency matrices. These results and methods constitute a powerful tool for analyzing and exploiting experimental and industrial polarimetry. Some particular application examples are indicated.


title: Neural network representability of fully ionized plasma fluid model closures

abstract: The closure problem in fluid modeling is a well-known challenge to modelers aiming to accurately describe their system of interest. Over many years, analytic formulations in a wide range of regimes have been presented but a practical, generalized fluid closure for magnetized plasmas remains an elusive goal. In this study, as a first step towards constructing a novel data based approach to this problem, we apply ever-maturing machine learning methods to assess the capability of neural network architectures to reproduce crucial physics inherent in popular magnetized plasma closures. We find encouraging results, indicating the applicability of neural networks to closure physics but also arrive at recommendations on how one should choose appropriate network architectures for given locality properties dictated by underlying physics of the plasma.


title: Lyman-$\alpha$ Polarization Intensity Mapping

abstract: We present a formalism that incorporates hydrogen Lyman-alpha (Ly$\alpha$) polarization arising from the scattering of radiation in galaxy halos into the intensity mapping approach. Using the halo model, and emission profiles based on simulations and observations, we calculate auto and cross power spectra at redshifts $3\leq z \leq13$ for the Ly$\alpha$ total intensity, $I$, polarized intensity, $P$, degree of polarization, $\Pi=P/I$, and two new quantities, the astrophysical $E$ and $B$ modes of Ly$\alpha$ polarization. The one-halo terms of the $\Pi$ power spectra show a turnover that signals the average extent of the polarization signal, and thus the extent of the scattering medium. The position of this feature depends on redshift, and on the specific emission profile shape and extent, in our formalism. Therefore, the comparison of various Ly$\alpha$ polarization quantities and redshifts can break degeneracies between competing effects, and it can reveal the true shape of the emission profiles, and thus, the physical properties of the cool gas in halos. Furthermore, measurements of Ly$\alpha$ $E$ and $B$ modes may be used as probes of galaxy evolution, because they are related to the average degree of anisotropy in the emission and in the halo gas distribution across redshifts. The detection of the polarization signal at $z \sim 3-5$ requires improvements in the sensitivity of current ground-based experiments by a factor of $\sim 10$, and of $\sim 100$ for space-based instruments targeting the redshifts $z\sim 9-10$, the exact values depending on the specific redshift and experiment. Interloper contamination in polarization is expected to be small, because the interlopers need to also be polarized. Overall, Ly$\alpha$ polarization boosts the amount of physical information retrievable on galaxies and their surroundings, most of it not achievable with total emission alone. (abridged)


title: Adversarial Filters of Dataset Biases

abstract: Large neural models have demonstrated human-level performance on language and vision benchmarks, while their performance degrades considerably on adversarial or out-of-distribution samples. This raises the question of whether these models have learned to solve a dataset rather than the underlying task by overfitting to spurious dataset biases. We investigate one recently proposed approach, AFLite, which adversarially filters such dataset biases, as a means to mitigate the prevalent overestimation of machine performance. We provide a theoretical understanding for AFLite, by situating it in the generalized framework for optimum bias reduction. We present extensive supporting evidence that AFLite is broadly applicable for reduction of measurable dataset biases, and that models trained on the filtered datasets yield better generalization to out-of-distribution tasks. Finally, filtering results in a large drop in model performance (e.g., from 92% to 62% for SNLI), while human performance still remains high. Our work thus shows that such filtered datasets can pose new research challenges for robust generalization by serving as upgraded benchmarks.


title: On Reward Shaping for Mobile Robot Navigation: A Reinforcement Learning and SLAM Based Approach

abstract: We present a map-less path planning algorithm based on Deep Reinforcement Learning (DRL) for mobile robots navigating in unknown environment that only relies on 40-dimensional raw laser data and odometry information. The planner is trained using a reward function shaped based on the online knowledge of the map of the training environment, obtained using grid-based Rao-Blackwellized particle filter, in an attempt to enhance the obstacle awareness of the agent. The agent is trained in a complex simulated environment and evaluated in two unseen ones. We show that the policy trained using the introduced reward function not only outperforms standard reward functions in terms of convergence speed, by a reduction of 36.9\% of the iteration steps, and reduction of the collision samples, but it also drastically improves the behaviour of the agent in unseen environments, respectively by 23\% in a simpler workspace and by 45\% in a more clustered one. Furthermore, the policy trained in the simulation environment can be directly and successfully transferred to the real robot. A video of our experiments can be found at: https://youtu.be/UEV7W6e6ZqI


title: Dynamically Generated Inflationary Lambda-CDM

abstract: Our primary objective is to construct a plausible unified model of inflation, dark energy and dark matter from a fundamental Lagrangian action first principle, where all fundamental ingredients are systematically dynamically generated starting from a very simple model of modified gravity interacting with a single scalar field employing the formalism of non-Riemannian spacetime volume-elements. The non-Riemannian volume element in the initial scalar field action leads to a hidden nonlinear Noether symmetry which produces energy-momentum tensor identified as a sum of a dynamically generated cosmological constant and a dust-like dark matter. The non-Riemannian volume-element in the initial Einstein-Hilbert action upon passage to the physical Einstein-frame creates dynamically a second scalar field with a non-trivial inflationary potential and with an additional interaction with the dynamically generated dark matter. The resulting Einstein-frame action describes a fully dynamically generated inflationary model coupled to dark matter. Numerical results for observables such as the scalar power spectral index and the tensor-to-scalar ratio conform to the latest 2018 PLANCK data.


title: Threshold expansion formula of $N$-boson in finite volume from variational approach

abstract: In present work, we show how the threshold expansion formula of $N$ identical bosons in finite volume may be derived by iterations of Faddeev-type coupled dynamical equations. The energy shift of $N$-boson system near threshold is dominated by zero momenta mode of $N$-body amplitudes with all particles nearly static. The dominant zero momenta mode and sub-leading non-zero momenta mode contributions are connected through finite volume Faddeev-type coupled dynamical equations. Eliminating non-zero momenta modes by iterations ultimately yields an analytic expression that can be solved by threshold expansion.


title: Connecting GANs, MFGs, and OT

abstract: Generative adversarial networks (GANs) have enjoyed tremendous success in image generation and processing, and have recently attracted growing interests in financial modelings. This paper analyzes GANs from the perspectives of mean-field games (MFGs) and optimal transport. More specifically, from the game theoretical perspective, GANs are interpreted as MFGs under Pareto Optimality criterion or mean-field controls; from the optimal transport perspective, GANs are to minimize the optimal transport cost indexed by the generator from the known latent distribution to the unknown true distribution of data. The MFGs perspective of GANs leads to a GAN-based computational method (MFGANs) to solve MFGs: one neural network for the backward Hamilton-Jacobi-Bellman equation and one neural network for the forward Fokker-Planck equation, with the two neural networks trained in an adversarial way. Numerical experiments demonstrate superior performance of this proposed algorithm, especially in the higher dimensional case, when compared with existing neural network approaches.


title: From SN2010da to NGC 300 ULX-1: Ten Years of Observations of an Unusual High Mass X-ray Binary in NGC 300

abstract: In 2010 May, an intermediate luminosity optical transient was discovered in the nearby galaxy NGC 300 by a South African amateur astronomer. In the decade since its discovery, multi-wavelength observations of the misnamed ``SN 2010da'' have continually re-shaped our understanding of this high mass X-ray binary system. In this review, we present an overview of the multi-wavelength observations and attempts to understand the 2010 transient event and, later, the re-classification of this system as NGC~300 ULX-1: a red supergiant + neutron star ultraluminous X-ray source.


title: Cross-Modality Paired-Images Generation for RGB-Infrared Person Re-Identification

abstract: RGB-Infrared (IR) person re-identification is very challenging due to the large cross-modality variations between RGB and IR images. The key solution is to learn aligned features to the bridge RGB and IR modalities. However, due to the lack of correspondence labels between every pair of RGB and IR images, most methods try to alleviate the variations with set-level alignment by reducing the distance between the entire RGB and IR sets. However, this set-level alignment may lead to misalignment of some instances, which limits the performance for RGB-IR Re-ID. Different from existing methods, in this paper, we propose to generate cross-modality paired-images and perform both global set-level and fine-grained instance-level alignments. Our proposed method enjoys several merits. First, our method can perform set-level alignment by disentangling modality-specific and modality-invariant features. Compared with conventional methods, ours can explicitly remove the modality-specific features and the modality variation can be better reduced. Second, given cross-modality unpaired-images of a person, our method can generate cross-modality paired images from exchanged images. With them, we can directly perform instance-level alignment by minimizing distances of every pair of images. Extensive experimental results on two standard benchmarks demonstrate that the proposed model favourably against state-of-the-art methods. Especially, on SYSU-MM01 dataset, our model can achieve a gain of 9.2% and 7.7% in terms of Rank-1 and mAP. Code is available at https://github.com/wangguanan/JSIA-ReID.


title: Dating the Break in High-dimensional Data

abstract: This paper is concerned with estimation and inference for the location of a change point in the mean of independent high-dimensional data. Our change point location estimator maximizes a new U-statistic based objective function, and its convergence rate and asymptotic distribution after suitable centering and normalization are obtained under mild assumptions. Our estimator turns out to have better efficiency as compared to the least squares based counterpart in the literature. Based on the asymptotic theory, we construct a confidence interval by plugging in consistent estimates of several quantities in the normalization. We also provide a bootstrap-based confidence interval and state its asymptotic validity under suitable conditions. Through simulation studies, we demonstrate favorable finite sample performance of the new change point location estimator as compared to its least squares based counterpart, and our bootstrap-based confidence intervals, as compared to several existing competitors. The asymptotic theory based on high-dimensional U-statistic is substantially different from those developed in the literature and is of independent interest.


title: Co-Exploration of Neural Architectures and Heterogeneous ASIC Accelerator Designs Targeting Multiple Tasks

abstract: Neural Architecture Search (NAS) has demonstrated its power on various AI accelerating platforms such as Field Programmable Gate Arrays (FPGAs) and Graphic Processing Units (GPUs). However, it remains an open problem, how to integrate NAS with Application-Specific Integrated Circuits (ASICs), despite them being the most powerful AI accelerating platforms. The major bottleneck comes from the large design freedom associated with ASIC designs. Moreover, with the consideration that multiple DNNs will run in parallel for different workloads with diverse layer operations and sizes, integrating heterogeneous ASIC sub-accelerators for distinct DNNs in one design can significantly boost performance, and at the same time further complicate the design space. To address these challenges, in this paper we build ASIC template set based on existing successful designs, described by their unique dataflows, so that the design space is significantly reduced. Based on the templates, we further propose a framework, namely NASAIC, which can simultaneously identify multiple DNN architectures and the associated heterogeneous ASIC accelerator design, such that the design specifications (specs) can be satisfied, while the accuracy can be maximized. Experimental results show that compared with successive NAS and ASIC design optimizations which lead to design spec violations, NASAIC can guarantee the results to meet the design specs with 17.77%, 2.49x, and 2.32x reductions on latency, energy, and area and with 0.76% accuracy loss. To the best of the authors' knowledge, this is the first work on neural architecture and ASIC accelerator design co-exploration.


title: A computable realization of Ruelle's formula for linear response of statistics in chaotic systems

abstract: We present a computable reformulation of Ruelle's linear response formula for chaotic systems. The new formula, called Space-Split Sensitivity or S3, achieves an error convergence of the order ${\cal O}(1/\sqrt{N})$ using $N$ phase points. The reformulation is based on splitting the overall sensitivity into that to stable and unstable components of the perturbation. The unstable contribution to the sensitivity is regularized using ergodic properties and the hyperbolic structure of the dynamics. Numerical examples of uniformly hyperbolic attractors are used to validate the S3 formula against a na\"ive finite-difference calculation; sensitivities match closely, with far fewer sample points required by S3.


title: Area Spectral Efficiency and SINR Scaling Laws in Multi-Antenna Cellular Networks

abstract: We study the scaling laws of the signal-to-interference-plus-noise ratio (SINR) and area spectral efficiency (ASE) in multi-antenna cellular networks, where the number of antennas scales with the base station (BS) spatial density $\lambda$. We start with the MISO case having $N_t(\lambda)$ transmit antennas and a single receive antenna and prove that the average SINR scales as $\frac{N_t(\lambda)}{\lambda}$ and the average ASE scales as $\lambda\log\left(1+\frac{N_t(\lambda)}{\lambda}\right)$. For the MIMO case with single-stream eigenbeamforming and $N_r(\lambda) \leq N_t(\lambda)$ receive antennas, we prove that the scaling laws of the conditional SINR and ASE are exactly the same as the MISO case, i.e. not dependent on $N_r(\lambda)$. We also show that coordinated beamforming amongst $K\leq N_t(\lambda)$ neighboring BSs does not improve the scaling laws regardless of $K$. From a system design perspective, our results suggest that deploying multi-antenna BSs can help maintain the per-user throughput and the linear increase in the ASE with BS density, while the number of antennas at the user equipment and the use of BS cooperation do not matter much.


title: A decade of multi-wavelength observations of the TeV blazar 1ES 1215+303: Extreme shift of the synchrotron peak frequency and long-term optical-gamma-ray flux increase

abstract: Blazars are known for their variability on a wide range of timescales at all wavelengths. Most studies of TeV gamma-ray blazars focus on short timescales, especially during flares. With a decade of observations from the Fermi-LAT and VERITAS, we present an extensive study of the long-term multi-wavelength radio-to-gamma-ray flux-density variability, with the addition of a couple of short-time radio-structure and optical polarization observations of the blazar 1ES 1215+303 (z=0.130), with a focus on its gamma-ray emission from 100 MeV to 30 TeV. Multiple strong GeV gamma-ray flares, a long-term increase in the gamma-ray and optical flux baseline and a linear correlation between these two bands are observed over the ten-year period. Typical HBL behaviors are identified in the radio morphology and broadband spectrum of the source. Three stationary features in the innermost jet are resolved by VLBA at 43.1, 22.2, and 15.3 GHz. We employ a two-component synchrotron self-Compton model to describe different flux states of the source, including the epoch during which an extreme shift in energy of the synchrotron peak frequency from infrared to soft X-rays is observed.


title: Flavor-changing decay $h\to \tau\mu$ at super hadron colliders

abstract: We study the flavor-changing decay $h\to \tau \mu$ with $\tau=\tau^-+\tau^+$ and $\mu=\mu^-+\mu^+$ of a Higgs boson at future hadron colliders, namely: a) High Luminosity Large Hadron Collider, b) High Energy Large Hadron Collider and c) Future hadron-hadron Circular Collider. The theoretical framework adopted is the Two-Higgs-Doublet Model type III. The free model parameters involved in the calculation are constrained through Higgs boson data, Lepton Flavor Violating processes and the muon anomalous magnetic dipole moment; later they are used to analyze the branching ratio of the decay $h\to\tau\mu$ and to evaluate the $gg\to h$ production cross section. We find that at the Large Hadron Collider is not possible to claim for evidence of the decay $h\to\tau\mu$ achieving a signal significance about of $1.46\sigma$ by considering its final integrated luminosity, 300 fb$^{-1}$. More promising results arise at the High Luminosity Large Hadron Collider in which a prediction of 4.6$\sigma$ when an integrated luminosity of 3 ab$^{-1}$ and $\tan\beta=8$ are achieved. Meanwhile, at the High Energy Large Hadron Collider (Future hadron-hadron Circular Collider) a potential discovery could be claimed with a signal significance around $5.04\sigma$ ($5.43\sigma$) for an integrated luminosity of 3 ab$^{-1}$ and $\tan\beta=8$ (5 ab$^{-1}$ and $\tan\beta=4$).


title: Logsmooth Gradient Concentration and Tighter Runtimes for Metropolized Hamiltonian Monte Carlo

abstract: We show that the gradient norm $\|\nabla f(x)\|$ for $x \sim \exp(-f(x))$, where $f$ is strongly convex and smooth, concentrates tightly around its mean. This removes a barrier in the prior state-of-the-art analysis for the well-studied Metropolized Hamiltonian Monte Carlo (HMC) algorithm for sampling from a strongly logconcave distribution. We correspondingly demonstrate that Metropolized HMC mixes in $\tilde{O}(\kappa d)$ iterations, improving upon the $\tilde{O}(\kappa^{1.5}\sqrt{d} + \kappa d)$ runtime of (Dwivedi et. al. '18, Chen et. al. '19) by a factor $(\kappa/d)^{1/2}$ when the condition number $\kappa$ is large. Our mixing time analysis introduces several techniques which to our knowledge have not appeared in the literature and may be of independent interest, including restrictions to a nonconvex set with good conductance behavior, and a new reduction technique for boosting a constant-accuracy total variation guarantee under weak warmness assumptions. This is the first high-accuracy mixing time result for logconcave distributions using only first-order function information which achieves linear dependence on $\kappa$; we also give evidence that this dependence is likely to be necessary for standard Metropolized first-order methods.


title: Stability for the Training of Deep Neural Networks and Other Classifiers

abstract: We examine the stability of loss-minimizing training processes that are used for deep neural networks (DNN) and other classifiers. While a classifier is optimized during training through a so-called loss function, the performance of classifiers is usually evaluated by some measure of accuracy, such as the overall accuracy which quantifies the proportion of objects that are well classified. This leads to the guiding question of stability: does decreasing loss through training always result in increased accuracy? We formalize the notion of stability, and provide examples of instability. Our main result consists of two novel conditions on the classifier which, if either is satisfied, ensure stability of training, that is we derive tight bounds on accuracy as loss decreases. We also derive a sufficient condition for stability on the training set alone, identifying flat portions of the data manifold as potential sources of instability. The latter condition is explicitly verifiable on the training dataset. Our results do not depend on the algorithm used for training, as long as loss decreases with training.


title: Geometric nested sampling: sampling from distributions defined on non-trivial geometries

abstract: Metropolis Hastings nested sampling evolves a Markov chain, accepting new points along the chain according to a version of the Metropolis Hastings acceptance ratio, which has been modified to satisfy the nested sampling likelihood constraint. The geometric nested sampling algorithm I present here is based on the Metropolis Hastings method, but treats parameters as though they represent points on certain geometric objects, namely circles, tori and spheres. For parameters which represent points on a circle or torus, the trial distribution is "wrapped" around the domain of the posterior distribution such that samples cannot be rejected automatically when evaluating the Metropolis ratio due to being outside the sampling domain. Furthermore, this enhances the mobility of the sampler. For parameters which represent coordinates on the surface of a sphere, the algorithm transforms the parameters into a Cartesian coordinate system before sampling which again makes sure no samples are automatically rejected, and provides a physically intuitive way of the sampling the parameter space.


title: Cybersecurity for Industrial Control Systems: A Survey

abstract: Industrial Control System (ICS) is a general term that includes supervisory control & data acquisition (SCADA) systems, distributed control systems (DCS), and other control system configurations such as programmable logic controllers (PLC). ICSs are often found in the industrial sectors and critical infrastructures, such as nuclear and thermal plants, water treatment facilities, power generation, heavy industries, and distribution systems. Though ICSs were kept isolated from the Internet for so long, significant achievable business benefits are driving a convergence between ICSs and the Internet as well as information technology (IT) environments, such as cloud computing. As a result, ICSs have been exposed to the attack vectors used in the majority of cyber-attacks. However, ICS devices are inherently much less secure against such advanced attack scenarios. A compromise to ICS can lead to enormous physical damage and danger to human lives. In this work, we have a close look at the shift of the ICS from stand-alone systems to cloud-based environments. Then we discuss the major works, from industry and academia towards the development of the secure ICSs, especially applicability of the machine learning techniques for the ICS cyber-security. The work may help to address the challenges of securing industrial processes, particularly while migrating them to the cloud environments.


title: Evolution of parton showers and parton distribution functions

abstract: Initial state evolution in parton shower event generators involves parton distribution functions. We examine the probability for the system to evolve from a higher scale to a lower scale without an initial state splitting. A simple argument suggests that this probability, when multiplied by the ratio of the parton distributions at the two scales, should be independent of the parton distribution functions. We call this the PDF property. We examine whether the PDF property actually holds using Pythia and Deductor. We also test a related property for the Deductor shower and discuss the physics behind the results.


title: Randomized Kaczmarz with Averaging

abstract: The randomized Kaczmarz (RK) method is an iterative method for approximating the least-squares solution of large linear systems of equations. The standard RK method uses sequential updates, making parallel computation difficult. Here, we study a parallel version of RK where a weighted average of independent updates is used. We analyze the convergence of RK with averaging and demonstrate its performance empirically. We show that as the number of threads increases, the rate of convergence improves and the convergence horizon for inconsistent systems decreases.


title: Finding manoeuvre motifs in vehicle telematics

abstract: Driving behaviour has a great impact on road safety. A popular way of analysing driving behaviour is to move the focus to the manoeuvres as they give useful information about the driver who is performing them. In this paper, we investigate a new way of identifying manoeuvres from vehicle telematics data, through motif detection in time-series. We implement a modified version of the Extended Motif Discovery (EMD) algorithm, a classical variable-length motif detection algorithm for time-series and we applied it to the UAH-DriveSet, a publicly available naturalistic driving dataset. After a systematic exploration of the extracted motifs, we were able to conclude that the EMD algorithm was not only capable of extracting simple manoeuvres such as accelerations, brakes and curves, but also more complex manoeuvres, such as lane changes and overtaking manoeuvres, which validates motif discovery as a worthwhile line for future research.


title: N-sided Radial Schramm-Loewner Evolution

abstract: We use the interpretation of the Schramm-Loewner evolution as a limit of path measures tilted by a loop term in order to motivate the definition of $n$-radial SLE going to a particular point. In order to justify the definition we prove that the measure obtained by an appropriately normalized loop term on $n$-tuples of paths has a limit. The limit measure can be described as $n$ paths moving by the Loewner equation with a driving term of Dyson Brownian motion. While the limit process has been considered before, this paper shows why it naturally arises as a limit of configurational measures obtained from loop measures.


title: On the monodromy group of desingularised moduli spaces of sheaves on K3 surfaces

abstract: We compute the monodromy group of irreducible holomorphic symplectic manifolds of OG10 type, confirming a conjecture of Markman.


title: Complexity of Finding Stationary Points of Nonsmooth Nonconvex Functions

abstract: We provide the first non-asymptotic analysis for finding stationary points of nonsmooth, nonconvex functions. In particular, we study the class of Hadamard semi-differentiable functions, perhaps the largest class of nonsmooth functions for which the chain rule of calculus holds. This class contains examples such as ReLU neural networks and others with non-differentiable activation functions. We first show that finding an $\epsilon$-stationary point with first-order methods is impossible in finite time. We then introduce the notion of $(\delta, \epsilon)$-stationarity, which allows for an $\epsilon$-approximate gradient to be the convex combination of generalized gradients evaluated at points within distance $\delta$ to the solution. We propose a series of randomized first-order methods and analyze their complexity of finding a $(\delta, \epsilon)$-stationary point. Furthermore, we provide a lower bound and show that our stochastic algorithm has min-max optimal dependence on $\delta$. Empirically, our methods perform well for training ReLU neural networks.


title: Mean-Field Controls with Q-learning for Cooperative MARL: Convergence and Complexity Analysis

abstract: Multi-agent reinforcement learning (MARL), despite its popularity and empirical success, suffers from the curse of dimensionality. This paper builds the mathematical framework to approximate cooperative MARL by a mean-field control (MFC) approach, and shows that the approximation error is of $\mathcal{O}(\frac{1}{\sqrt{N}})$. By establishing an appropriate form of the dynamic programming principle for both the value function and the Q function, it proposes a model-free kernel-based Q-learning algorithm (MFC-K-Q), which is shown to have a linear convergence rate for the MFC problem, the first of its kind in the MARL literature. It further establishes that the convergence rate and the sample complexity of MFC-K-Q are independent of the number of agents $N$, which provides an $\mathcal{O}(\frac{1}{\sqrt{N}})$ approximation to the MARL problem with $N$ agents in the learning environment. Empirical studies for the network traffic congestion problem demonstrate that MFC-K-Q outperforms existing MARL algorithms when $N$ is large, for instance when $N>50$.


title: Europa's surface water ice crystallinity: Discrepancy between observations and thermophysical and particle flux modeling

abstract: Physical processing of Europan surface water ice by thermal relaxation, charged particle bombardment, and possible cryovolcanic activity can alter the percentage of the crystalline form of water ice compared to that of the amorphous form of water ice (the ''crystallinity'') on Europa's surface. The timescales over which amorphous water ice is thermally transformed to crystalline water ice at Europan surface temperatures suggests that the water ice there should be primarily in the crystalline form, however, surface bombardment by charged particles induced by Jupiter's magnetic field, and vapor deposition of water ice from Europan plumes, can produce amorphous water ice surface deposits on short timescales. The purpose of this investigation is to determine whether the Europan surface water ice crystallinity derived from ground-based spectroscopic measurements is in agreement with the crystallinity expected based on temperature and radiation modeling. Using a 1D thermophysical model of Europa's surface, we calculate a full-disk crystallinity of Europa's leading hemisphere by incorporating the thermal relaxation of amorphous to crystalline water ice and the degradation of crystalline to amorphous water ice by irradiation. Concurrently, we derive the full-disk crystallinity of Europa's leading hemisphere using a comparison of near-infrared ground-based spectral observations from Grundy et al. (1999), Busarev et al. (2018), and the Apache Point Observatory with laboratory spectra from Mastrapa et al. (2018) and the Ice Spectroscopy Lab at the Jet Propulsion Laboratory. We calculate a modeled crystallinity significantly higher than crystallinities derived from ground-based observations and laboratory spectra. This discrepancy may be a result of geophysical processes, such as by vapor-deposited plume material, or it may arise from assumptions and uncertainties in the crystallinity calculations.


title: Efficient sideband cooling protocol for long trapped-ion chains

abstract: Trapped ions are a promising candidate for large scale quantum computation. Several systems have been built in both academic and industrial settings to implement modestly-sized quantum algorithms. Efficient cooling of the motional degrees of freedom is a key requirement for high-fidelity quantum operations using trapped ions. Here, we present a technique whereby individual ions are used to cool individual motional modes in parallel, reducing the time required to bring an ion chain to its motional ground state. We demonstrate this technique experimentally and develop a model to understand the efficiency of our parallel sideband cooling technique compared to more traditional methods. This technique is applicable to any system using resolved sideband cooling of co-trapped atomic species and only requires individual addressing of the trapped particles.


title: The Hasse invariant of the Tate normal form $E_5$ and the class number of $\mathbb{Q}(\sqrt{-5l})$

abstract: It is shown that the number of irreducible quartic factors of the form $g(x) = x^4+ax^3+(11a+2)x^2-ax+1$ which divide the Hasse invariant of the Tate normal form $E_5$ in characteristic $l$ is a simple linear function of the class number $h(-5l)$ of the field $\mathbb{Q}(\sqrt{-5l})$, when $l \equiv 2,3$ modulo $5$. A similar result holds for irreducible quadratic factors of $g(x)$, when $l \equiv 1, 4$ modulo $5$. This implies a formula for the number of linear factors over $\mathbb{F}_p$ of the supersingular polynomial $ss_p^{(5*)}(x)$ corresponding to the Fricke group $\Gamma_0^*(5)$.


title: Apollonian depth and the accidental fractal

abstract: The depth function of three numbers representing curvatures of three mutually tangent circles is introduced. Its 2D plot leads to a partition of the moduli space of the triples of mutually tangent circles/disks that is unexpectedly a beautiful fractal, the general form of which resembles that of an Apollonian disk packing, except that it consists of ellipses instead of circles.


title: The neonatal sepsis is diminished by cervical vagus nerve stimulation and tracked non-invasively by ECG: a preliminary report in the piglet model

abstract: An electrocardiogram (ECG)-derived heart rate variability (HRV) index reliably tracks the inflammatory response induced by low-dose lipopolysaccharide (LPS) in near-term sheep fetuses. We evaluated the effect of vagus nerve stimulation (VNS) on vagus nerve electroneurogram (VENG) and the systemic inflammatory response induced by a high dose of LPS in neonatal piglets to mimic late-onset neonatal sepsis. We tested if our HRV inflammatory index tracks inflammation in piglets and its relationship to VENG. Following anesthesia, electrodes were attached to the left vagal nerve; ECG and blood pressure (BP) were recorded throughout the experiment. Following baseline, the piglets were administered LPS as 2mg/kg IV bolus. In the VNS treated piglet, the vagus nerve was stimulated for 10 minutes prior to and 10 min after the injection of LPS. In both groups, every 15 min post LPS, the arterial blood sample was drawn for blood gas, metabolites, and inflammatory cytokines. At the end of the experiment, the piglets were euthanized. BP and HRV measures were calculated. The piglets developed a potent inflammatory response to the LPS injection with TNF-alpha, IL-1beta, IL-6 and IL-8 peaking between 45 and 90 min post-injection. VNS diminished the LPS-induced systemic inflammatory response varying across the measured cytokines from two to ten-fold. The HRV index tracked accurately the temporal profile of cytokines and VENG changes. This novel model allows manipulating and tracking neonatal sepsis: The HRV inflammatory index 1) applies across species pre- and postnatally and 2) performs well at different degrees of sepsis (i.e., nanogram and milligram doses of LPS); 3) the present VNS paradigm effectively suppresses LPS-induced inflammation, even at high doses of LPS. The potential of early postnatal VNS to counteract sepsis and of HRV monitoring to early detect and track it deserve further study.


title: On Robust Mean Estimation under Coordinate-level Corruption

abstract: We study the problem of robust mean estimation and introduce a novel Hamming distance-based measure of distribution shift for coordinate-level corruptions. We show that this measure yields adversary models that capture more realistic corruptions than those used in prior works, and present an information-theoretic analysis of robust mean estimation in these settings. We show that for structured distributions, methods that leverage the structure yield information theoretically more accurate mean estimation. We also focus on practical algorithms for robust mean estimation and study when data cleaning-inspired approaches that first fix corruptions in the input data and then perform robust mean estimation can match the information theoretic bounds of our analysis. We finally demonstrate experimentally that this two-step approach outperforms structure-agnostic robust estimation and provides accurate mean estimation even for high-magnitude corruption.


title: Explaining Explanations: Axiomatic Feature Interactions for Deep Networks

abstract: Recent work has shown great promise in explaining neural network behavior. In particular, feature attribution methods explain which features were most important to a model's prediction on a given input. However, for many tasks, simply knowing which features were important to a model's prediction may not provide enough insight to understand model behavior. The interactions between features within the model may better help us understand not only the model, but also why certain features are more important than others. In this work, we present Integrated Hessians, an extension of Integrated Gradients that explains pairwise feature interactions in neural networks. Integrated Hessians overcomes several theoretical limitations of previous methods to explain interactions, and unlike such previous methods is not limited to a specific architecture or class of neural network. Additionally, we find that our method is faster than existing methods when the number of features is large, and outperforms previous methods on existing quantitative benchmarks. Code available at https://github.com/suinleelab/path_explain


title: Jet Sub-structure in Fireworks Emission from Non-uniform and Rotating Bose-Einstein Condensates

abstract: We show that jet emission from a Bose condensate with periodically driven interactions, a.k.a. "Bose fireworks", contains essential information on the condensate wavefunction, which is difficult to obtain using standard detection methods. We illustrate the underlying physics with two examples. When condensates acquire phase patterns from external potentials or from vortices, the jets display novel sub-structure, such as oscillations or spirals, in their correlations. Through a comparison of theory, numerical simulations and experiments, we show how one can quantitatively extract the phase and the helicity of a condensate from the emission pattern. Our work demonstrating the strong link between jet emission and the underlying quantum system, bears on the recent emphasis on jet sub-structure in particle physics.


title: Local Densities of Diagonal Integral Ternary Quadratic Forms at Odd Primes

abstract: We give formulas for local densities of diagonal integral ternary quadratic forms at odd primes. Exponential sums and quadratic Gauss sums are used to obtain these formulas. These formulas (along with 2-adic densities and Siegel's mass formula) can be used to compute the representation numbers of certain ternary quadratic forms.


title: Affine Demazure crystals for specialized nonsymmetric Macdonald polynomials

abstract: We give a crystal-theoretic proof that nonsymmetric Macdonald polynomials specialized to $t=0$ are affine Demazure characters. We explicitly construct an affine Demazure crystal on semistandard key tabloids such that removing the affine edges recovers the finite Demazure crystals constructed earlier by the authors. We also realize the filtration on highest weight modules by Demazure modules by defining explicit embedding operators which, at the level of characters, parallels the recursion operators of Knop and Sahi for specialized nonsymmetric Macdonald polynomials. Thus we prove combinatorially in type A that every affine Demazure module admits a finite Demazure flag.


title: A time-dependent scattering approach to core-level spectroscopies

abstract: While new light sources allow for unprecedented resolution in experiments with X-rays, a theoretical understanding of the scattering cross-section is lacking. In the particular case of strongly correlated electron systems, numerical techniques are quite limited, since conventional approaches rely on calculating a response function (Kramers-Heisenberg formula) that is obtained from a perturbative analysis of scattering processes in the frequency domain. This requires a knowledge of a full set of eigenstates in order to account for all intermediate processes away from equilibrium, limiting the applicability to small tractable systems. In this work, we present an alternative paradigm, recasting the problem in the time domain and explicitly solving the time-dependent Schr\"odinger equation without the limitations of perturbation theory: a faithful simulation of the scattering processes taking place in actual experiments, including photons and core electrons. We show how this approach can yield the full time and momentum resolved Resonant Inelastic X-Ray Scattering (RIXS) spectrum of strongly interacting many-body systems. We demonstrate the formalism with an application to Mott insulating Hubbard chains using the time-dependent density matrix renormalization group method, which does not require a priory knowledge of the eigenstates and can solve very large systems with dozens of orbitals. This approach can readily be applied to systems out of equilibrium without modification and generalized to other spectroscopies.


title: A robust solver for elliptic PDEs in 3D complex geometries

abstract: We develop a boundary integral equation solver for elliptic partial differential equations on complex \threed geometries. Our method is efficient, high-order accurate and robustly handles complex geometries. A key component is our singular and near-singular layer potential evaluation scheme, \qbkix: a simple extrapolation of the solution along a line to the boundary. We present a series of geometry-processing algorithms required for \qbkix to run efficiently with accuracy guarantees on arbitrary geometries and an adaptive upsampling scheme based on a iteration-free heuristic for quadrature error. We validate the accuracy and performance with a series of numerical tests and compare our approach to a competing local evaluation method.


title: Momentum Improves Optimization on Riemannian Manifolds

abstract: We develop a new Riemannian descent algorithm that relies on momentum to improve over existing first-order methods for geodesically convex optimization. In contrast, accelerated convergence rates proved in prior work have only been shown to hold for geodesically strongly-convex objective functions. We further extend our algorithm to geodesically weakly-quasi-convex objectives. Our proofs of convergence rely on a novel estimate sequence that illustrates the dependency of the convergence rate on the curvature of the manifold. We validate our theoretical results empirically on several optimization problems defined on the sphere and on the manifold of positive definite matrices.


title: Vapor-cell-based atomic electrometry for detection frequencies below kHz

abstract: Rydberg-assisted atomic electrometry using alkali-metal atoms contained inside a vacuum environment for detecting external electric fields (E-fields) at frequencies $<$ a few kHz has been quite challenging due to the low-frequency E-field screening effect that is caused by the alkali-metal atoms adsorbed on the inner surface of the container. We report a very slow E-field screening phenomenon with a time scale up to $\sim$ second on a rubidium (Rb) vapor cell that is made of monocrystalline sapphire. Using this sapphire-made Rb vapor cell with optically induced, internal bias E-field, we demonstrate vapor-cell-based, low-frequency atomic electrometry that responds to the E-field strength linearly. Limited by the given experimental conditions, this demonstrated atomic electrometer uses an active volume of 11 mm$^3$ and delivers a spectral noise floor around $0.34$ (mV/m)/$\sqrt{\rm Hz}$ and the 3-dB low cut-off frequency around 770 Hz inside the vapor cell. This work investigates a regime of vapor-cell-based atomic electrometry that was seldom studied before, which may enable more applications that utilize atomic E-field sensing technology.


title: Bispectral mode decomposition of nonlinear flows

abstract: Triadic interactions are the fundamental mechanism of energy transfer in fluid flows. This work introduces bispectral mode decomposition as a direct means of educing flow structures that are associated with triadic interactions from experimental or numerical data. Triadic interactions are characterized by quadratic phase coupling which can be detected by the bispectrum. The proposed method maximizes an integral measure of this third-order statistic to compute modes associated with frequency triads, as well as a mode bispectrum that identifies resonant three-wave interactions. Unlike the classical bispectrum, the decomposition establishes a causal relationship between the three frequency components of a triad. This permits the distinction of sum- and difference-interactions, and the computation of interaction maps that indicate regions of nonlinear coupling. Three examples highlight different aspects of the method. Cascading triads and their regions of interaction are educed from direct numerical simulation data of laminar cylinder flow. It is further demonstrated that linear instability mechanisms that attain an appreciable amplitude are revealed indirectly by their difference-self-interactions. Applicability to turbulent flows and noise-rejection is demonstrated on particle image velocimetry data of a massively separated wake. The generation of sub- and ultra-harmonics in large eddy simulation data of a transitional jet is explained by extending the method to cross-bispectral information.


title: Reconstructing the Noise Manifold for Image Denoising

abstract: Deep Convolutional Neural Networks (CNNs) have been successfully used in many low-level vision problems like image denoising. Although the conditional image generation techniques have led to large improvements in this task, there has been little effort in providing conditional generative adversarial networks (cGAN)[42] with an explicit way of understanding the image noise for object-independent denoising reliable for real-world applications. The task of leveraging structures in the target space is unstable due to the complexity of patterns in natural scenes, so the presence of unnatural artifacts or over-smoothed image areas cannot be avoided. To fill the gap, in this work we introduce the idea of a cGAN which explicitly leverages structure in the image noise space. By learning directly a low dimensional manifold of the image noise, the generator promotes the removal from the noisy image only that information which spans this manifold. This idea brings many advantages while it can be appended at the end of any denoiser to significantly improve its performance. Based on our experiments, our model substantially outperforms existing state-of-the-art architectures, resulting in denoised images with less oversmoothing and better detail.


title: The role of intrinsic dimension in high-resolution player tracking data -- Insights in basketball

abstract: A new range of statistical analysis has emerged in sports after the introduction of the high-resolution player tracking technology, specifically in basketball. However, this high dimensional data is often challenging for statistical inference and decision making. In this article, we employ Hidalgo, a state-of-the-art Bayesian mixture model that allows the estimation of heterogeneous intrinsic dimensions (ID) within a dataset and propose some theoretical enhancements. ID results can be interpreted as indicators of variability and complexity of basketball plays and games. This technique allows classification and clustering of NBA basketball player's movement and shot charts data. Analyzing movement data, Hidalgo identifies key stages of offensive actions such as creating space for passing, preparation/shooting and following through. We found that the ID value spikes reaching a peak between 4 and 8 seconds in the offensive part of the court after which it declines. In shot charts, we obtained groups of shots that produce substantially higher and lower successes. Overall, game-winners tend to have a larger intrinsic dimension which is an indication of more unpredictability and unique shot placements. Similarly, we found higher ID values in plays when the score margin is small compared to large margin ones. These outcomes could be exploited by coaches to obtain better offensive/defensive results.


title: Maximizing Products of Linear Forms, and The Permanent of Positive Semidefinite Matrices

abstract: We study the convex relaxation of a polynomial optimization problem, maximizing a product of linear forms over the complex sphere. We show that this convex program is also a relaxation of the permanent of Hermitian positive semidefinite (HPSD) matrices. By analyzing a constructive randomized rounding algorithm, we obtain an improved multiplicative approximation factor to the permanent of HPSD matrices, as well as computationally efficient certificates for this approximation. We also propose an analog of van der Waerden's conjecture for HPSD matrices, where the polynomial optimization problem is interpreted as a relaxation of the permanent.


title: Utilizing the Wavelet Transform's Structure in Compressed Sensing

abstract: Compressed sensing has empowered quality image reconstruction with fewer data samples than previously though possible. These techniques rely on a sparsifying linear transformation. The Daubechies wavelet transform is a common sparsifying transformation used for this purpose. In this work, we take advantage of the structure of this wavelet transform and identify an affine transformation that increases the sparsity of the result. After inclusion of this affine transformation, we modify the resulting optimization problem to comply with the form of the Basis Pursuit Denoising problem. Finally, we show theoretically that this yields a lower bound on the error of the reconstruction and present results where solving this modified problem yields images of higher quality for the same sampling patterns.


title: Statistical aspects of nuclear mass models

abstract: We study the information content of nuclear masses from the perspective of global models of nuclear binding energies. To this end, we employ a number of statistical methods and diagnostic tools, including Bayesian calibration, Bayesian model averaging, chi-square correlation analysis, principal component analysis, and empirical coverage probability. Using a Bayesian framework, we investigate the structure of the 4-parameter Liquid Drop Model by considering discrepant mass domains for calibration. We then use the chi-square correlation framework to analyze the 14-parameter Skyrme energy density functional calibrated using homogeneous and heterogeneous datasets. We show that a quite dramatic parameter reduction can be achieved in both cases. The advantage of Bayesian model averaging for improving uncertainty quantification is demonstrated. The statistical approaches used are pedagogically described; in this context this work can serve as a guide for future applications.


title: Multiphase interpolating digital power amplifiers for TX beamforming

abstract: This paper presents a 4-channel beamforming TX implemented in 65nm CMOS. Each beamforming TX is comprised of a C-2C split-array multiphase switched-capacitor power amplifier (SAMP-SCPA). This is the first use of multiphase interpolation (MPI) for beam-steering. This technique is ideal for low-frequency beamforming and MIMO, as it does not require passive or LO based phase shifters. The SCPA is ideal to use as the core element since it can perform frequency translation, data conversion and drive an output at high power and efficiency in a compact die area. A prototype 4-element beamforming TX, occupying 2 mm X 2.5 mm, can achieve peak output power of 24.4 dBm with a peak system efficiency (SE) of 24%, while achieving < 1{\deg} phase resolution and <1 dB gain error. When transmitting a 15 MHz, 64 QAM long-term evolution (LTE) signal it outputs 18.4 dBm at 14% SE with a measured adjacent channel leakage ratio (ACLR) < -30 dBc and error vector magnitude (EVM) of 3.27 %-rms at 1.75 GHz. A synthesized beam pattern based on measured results from a single die achieves <0.32{\deg}-rms beam angle error and <0.15 dB rms beam amplitude error.


title: Superadditivity of channel capacity through quantum fields

abstract: Given that any communication is communication through quantum fields, we here study the scenario where a sender, Alice, causes information-carrying disturbances in a quantum field. We track the exact spread of these disturbances in space and time by using the technique of quantum information capsules (QIC). We find that the channel capacity between Alice and a receiver, Bob, is enhanced by Bob placing detectors not only inside but in addition also outside the causal future of Alice's encoding operation. Intuitively, this type of superadditivity arises because the field outside the causal future of Alice is entangled with the field inside Alice's causal future. Hence, the quantum noise picked up by Bob's detectors outside Alice's causal future is correlated with the noise of Bob's detectors inside Alice's causal future. In effect, this correlation allows Bob to improve the signal-to-noise ratio of those of his detectors which are in the causal future of Alice. Further, we develop the multimode generalization of the QIC technique. This allows us to extend the analysis to the case where Alice operates multiple localized and optionally entangled emitters. We apply the new techniques to the case where Alice enhances the channel capacity by operating multiple emitters that are suitably lined up and pre-timed to generate a quantum shockwave in the field.


title: Almost critical regularity of non-abelian Chern-Simons-Higgs system in the Lorenz gauge

abstract: In this paper we consider a Cauchy problem on the self-dual relativistic non-abelian Chern-Simons-Higgs model, which is the system of equations of $\mathfrak{su}(n)\, (n \ge 2)$-valued matter field $\phi$ and gauge field $A$. Based on the frequency localization as well as the null structure we show the local well-posedness in Sobolev space $H^{s+\frac12} \times H^s$ for $s>\frac14$. We also prove that the solution flow map $(\phi(0), A(0)) \mapsto (\phi(t), A(t))$ fails to be $C^2$ at the origin of $H^s \times H^\sigma$ when $\sigma < \frac14$ regardless of $s \in \mathbb R$. This means the regularity $H^s$, $s>\frac14$ is almost critical.


title: ForecastNet: A Time-Variant Deep Feed-Forward Neural Network Architecture for Multi-Step-Ahead Time-Series Forecasting

abstract: Recurrent and convolutional neural networks are the most common architectures used for time series forecasting in deep learning literature. These networks use parameter sharing by repeating a set of fixed architectures with fixed parameters over time or space. The result is that the overall architecture is time-invariant (shift-invariant in the spatial domain) or stationary. We argue that time-invariance can reduce the capacity to perform multi-step-ahead forecasting, where modelling the dynamics at a range of scales and resolutions is required. We propose ForecastNet which uses a deep feed-forward architecture to provide a time-variant model. An additional novelty of ForecastNet is interleaved outputs, which we show assist in mitigating vanishing gradients. ForecastNet is demonstrated to outperform statistical and deep learning benchmark models on several datasets.


title: Turbo-Aggregate: Breaking the Quadratic Aggregation Barrier in Secure Federated Learning

abstract: Federated learning is a distributed framework for training machine learning models over the data residing at mobile devices, while protecting the privacy of individual users. A major bottleneck in scaling federated learning to a large number of users is the overhead of secure model aggregation across many users. In particular, the overhead of the state-of-the-art protocols for secure model aggregation grows quadratically with the number of users. In this paper, we propose the first secure aggregation framework, named Turbo-Aggregate, that in a network with $N$ users achieves a secure aggregation overhead of $O(N\log{N})$, as opposed to $O(N^2)$, while tolerating up to a user dropout rate of $50\%$. Turbo-Aggregate employs a multi-group circular strategy for efficient model aggregation, and leverages additive secret sharing and novel coding techniques for injecting aggregation redundancy in order to handle user dropouts while guaranteeing user privacy. We experimentally demonstrate that Turbo-Aggregate achieves a total running time that grows almost linear in the number of users, and provides up to $40\times$ speedup over the state-of-the-art protocols with up to $N=200$ users. Our experiments also demonstrate the impact of model size and bandwidth on the performance of Turbo-Aggregate.


title: Liberation of slave modes inside domain walls in multiferroic Cu-Cl boracite

abstract: Domain walls (DWs), the two-dimensional boundaries between symmetry equivalent ferroic domains, are actively investigated due to their promise for novel logic and memory devices. Moreover, they can be easily created, erased and reshaped at a low energy cost due to their high mobility and large electrical conductivity. Most work so far has been focused on DWs in proper ferroelectrics, where the primary order parameter, ferroelectric polarization, interpolates between the values in the domains by either reducing to zero (in Ising-type DW) or rotating (Bloch type DW). Here we present a new member of DW family with a complex inner texture of slave order parameters inside the wall where the primary order parameter reduces to zero. Our first-principles-derived model predicts the existence of monopolar and toroidal polarization patterns. The results enable large-scale phase field simulations of complex domain patterns in boracites and could inspire novel devices based on domain walls in improper ferroelectrics.


title: Enhanced four-wave-mixing with 2D layered graphene oxide films integrated with CMOS compatible micro-ring resonators

abstract: Layered 2D graphene oxide (GO) films are integrated with microring resonators (MRRs) to experimentally demonstrate enhanced nonlinear optics in the form of four wave mixing (FWM). Both uniformly coated and patterned GO films are integrated on CMOS compatible doped silica MRRs using a large area, transfer free, layer by layer GO coating method together with photolithography and lift off processes, yielding precise control of the film thickness, placement, and coating length. The high Kerr nonlinearity and low loss of the GO films combined with the strong light matter interaction within the MRRs results in a significant improvement in the FWM efficiency in the hybrid MRRs. Detailed FWM measurements are performed at different pump powers and resonant wavelengths for the uniformly coated MRRs with 1 to 5 layers of GO as well as the patterned devices with 10 to 50 layers of GO. The experimental results show good agreement with theory, achieving up to 7.6 dB enhancement in the FWM conversion efficiency (CE) for an MRR uniformly coated with 1 layer of GO and 10.3 dB for a patterned device with 50 layers of GO. By fitting the measured CE as a function of pump power for devices with different numbers of GO layers, we also extract the dependence of the third-order nonlinearity on layer number and pump power, revealing interesting physical insights about the evolution of the layered GO films from 2D monolayers to quasi bulk like behavior. These results confirm the high nonlinear optical performance of integrated photonic resonators incorporated with 2D layered GO films.


title: Observation of an antiferromagnetic quantum critical point in high-purity LaNiO$_3$

abstract: Amongst the rare-earth perovskite nickelates, LaNiO$_3$ (LNO) is an exception. While the former have insulating and antiferromagnetic ground states, LNO remains metallic and non-magnetic down to the lowest temperatures. It is believed that LNO is a strange metal, on the verge of an antiferromagnetic instability. Our work suggests that LNO is a quantum critical metal, close to an antiferromagnetic quantum critical point (QCP). The QCP behavior in LNO is manifested in epitaxial thin films with unprecedented high purities. We find that the temperature and magnetic field dependences of the resistivity of LNO at low temperatures are consistent with scatterings of charge carriers from weak disorder and quantum fluctuations of an antiferromagnetic nature. Furthermore, we find that the introduction of a small concentration of magnetic impurities qualitatively changes the magnetotransport properties of LNO, resembling that found in some heavy-fermion Kondo lattice systems in the vicinity of an antiferromagnetic QCP.


title: Age dependence of fitness and body mass index in Korean adults

abstract: The aim of this study was to investigate the age dependence of the fitness and body mass index (BMI) in Korean adults and to find an effective exercise to restore the degradation of fitness due to aging. The age dependence of the fitness and BMI were calculated using their lump mean values (LMVs) and a linear regression method. The fitness sensitivity percentage to age (FSPA) and fitness sensitivity percentage to BMI (FSPB) were introduced as indicators for the effective improvement of the fitness. The results showed that the degradation of fitness due to aging, especially the degradation of cardiorespiratory endurance and muscular endurance, could be improved effectively by controlling the 20-m multi-stage shuttle run and sit-up scores for both males and females. The results also showed that the BMIs could be effectively controlled with enhancing the 10-m shuttle run and standing long jump scores for both males and females. It is expected that the LMV, FSPA, and FSPB could be used to improve fitness effectively and to establish personal exercise aims.


title: Analyzer Free Linear Dichroic Ptychography

abstract: Linear-dichroism is an important tool to characterize the transmission matrix and determine the crystal or orbital orientation in a material. In order to gain high resolution mapping of the transmission properties of such materials, we introduce the linear-dichroism scattering model in ptychographic imaging, and then develop an efficient two-stage reconstruction algorithm. Using proposed algorithm, the dichroic transmission matrix without an analyzer can be recovered by using ptychography measurements with as few as three different polarization angles, with the help of an empty region to remove phase ambiguities.


title: Incremental Meta-Learning via Indirect Discriminant Alignment

abstract: Majority of the modern meta-learning methods for few-shot classification tasks operate in two phases: a meta-training phase where the meta-learner learns a generic representation by solving multiple few-shot tasks sampled from a large dataset and a testing phase, where the meta-learner leverages its learnt internal representation for a specific few-shot task involving classes which were not seen during the meta-training phase. To the best of our knowledge, all such meta-learning methods use a single base dataset for meta-training to sample tasks from and do not adapt the algorithm after meta-training. This strategy may not scale to real-world use-cases where the meta-learner does not potentially have access to the full meta-training dataset from the very beginning and we need to update the meta-learner in an incremental fashion when additional training data becomes available. Through our experimental setup, we develop a notion of incremental learning during the meta-training phase of meta-learning and propose a method which can be used with multiple existing metric-based meta-learning algorithms. Experimental results on benchmark dataset show that our approach performs favorably at test time as compared to training a model with the full meta-training set and incurs negligible amount of catastrophic forgetting


title: Cosmic-ray Antinuclei as Messengers of New Physics: Status and Outlook for the New Decade

abstract: The precise measurement of cosmic-ray antinuclei serves as an important means for identifying the nature of dark matter and other new astrophysical phenomena, and could be used with other cosmic-ray species to understand cosmic-ray production and propagation in the Galaxy. For instance, low-energy antideuterons would provide a "smoking gun" signature of dark matter annihilation or decay, essentially free of astrophysical background. Studies in recent years have emphasized that models for cosmic-ray antideuterons must be considered together with the abundant cosmic antiprotons and any potential observation of antihelium. Therefore, a second dedicated Antideuteron Workshop was organized at UCLA in March 2019, bringing together a community of theorists and experimentalists to review the status of current observations of cosmic-ray antinuclei, the theoretical work towards understanding these signatures, and the potential of upcoming measurements to illuminate ongoing controversies. This review aims to synthesize this recent work and present implications for the upcoming decade of antinuclei observations and searches. This includes discussion of a possible dark matter signature in the AMS-02 antiproton spectrum, the most recent limits from BESS Polar-II on the cosmic antideuteron flux, and reports of candidate antihelium events by AMS-02; recent collider and cosmic-ray measurements relevant for antinuclei production models; the state of cosmic-ray transport models in light of AMS-02 and Voyager data; and the prospects for upcoming experiments, such as GAPS. This provides a roadmap for progress on cosmic antinuclei signatures of dark matter in the coming years.


title: On the statistics of scaling exponents and the Multiscaling Value at Risk

abstract: Scaling and multiscaling financial time series have been widely studied in the literature. The research on this topic is vast and still flourishing. One way to analyze the scaling properties of time series is through the estimation of their scaling exponents, that are recognized as being valuable measures to discriminate between random, persistent, and anti-persistent behaviors in these time series. In the literature, several methods have been proposed to study the multiscaling property. In this paper, we use the generalized Hurst exponent (GHE) tool and we propose a novel statistical procedure based on GHE which we name Relative Normalized and Standardized Generalized Hurst Exponent (RNSGHE). This method is used to robustly estimate and test the multiscaling property and, together with a combination of t-tests and F-tests, serves to discriminate between real and spurious scaling. Furthermore, we introduce a new tool to estimate the optimal aggregation time used in our methodology which we name Autocororrelation Segmented Regression. We numerically validate this procedure on simulated time series by using the Multifractal Random Walk (MRW) and we then apply it to real financial data. We present results for times series with and without anomalies and we compute the bias that such anomalies introduce in the measurement of the scaling exponents. We also show how the use of proper scaling and multiscaling can ameliorate the estimation of risk measures such as Value at Risk (VaR). Finally, we propose a methodology based on Monte Carlo simulation, which we name Multiscaling Value at Risk (MSVaR), that takes into account the statistical properties of multiscaling time series. We show that by using this statistical procedure in combination with the robustly estimated multiscaling exponents, the one year forecasted MSVaR mimics the VaR on the annual data for the majority of the stocks analyzed.


title: Training with Streaming Annotation

abstract: In this paper, we address a practical scenario where training data is released in a sequence of small-scale batches and annotation in earlier phases has lower quality than the later counterparts. To tackle the situation, we utilize a pre-trained transformer network to preserve and integrate the most salient document information from the earlier batches while focusing on the annotation (presumably with higher quality) from the current batch. Using event extraction as a case study, we demonstrate in the experiments that our proposed framework can perform better than conventional approaches (the improvement ranges from 3.6 to 14.9% absolute F-score gain), especially when there is more noise in the early annotation; and our approach spares 19.1% time with regard to the best conventional method.


title: Secure Millimeter Wave Cloud Radio Access Networks Relying on Microwave Multicast Fronthaul

abstract: In this paper, we investigate the downlink secure beamforming (BF) design problem of cloud radio access networks (C-RANs) relying on multicast fronthaul, where millimeter-wave and microwave carriers are used for the access links and fronthaul links, respectively. The base stations (BSs) jointly serve users through cooperating hybrid analog/digital BF. We first develop an analog BF for cooperating BSs. On this basis, we formulate a secrecy rate maximization (SRM) problem subject both to a realistic limited fronthaul capacity and to the total BS transmit power constraint. Due to the intractability of the non-convex problem formulated, advanced convex approximated techniques, constrained concave convex procedures and semi-definite programming (SDP) relaxation are applied to transform it into a convex one. Subsequently, an iterative algorithm of jointly optimizing multicast BF, cooperative digital BF and the artificial noise (AN) covariance is proposed. Next, we construct the solution of the original problem by exploiting both the primal and the dual optimal solution of the SDP-relaxed problem. Furthermore, a per-BS transmit power constraint is considered, necessitating the reformulation of the SRM problem, which can be solved by an efficient iterative algorithm. We then eliminate the idealized simplifying assumption of having perfect channel state information (CSI) for the eavesdropper links and invoke realistic imperfect CSI. Furthermore, a worst-case SRM problem is investigated. Finally, by combining the so-called $\mathcal{S}$-Procedure and convex approximated techniques, we design an efficient iterative algorithm to solve it. Simulation results are presented to evaluate the secrecy rate and demonstrate the effectiveness of the proposed algorithms.


title: Joint Beamforming And Power Splitting Design For C-RAN With Multicast Fronthaul

abstract: In this paper, we investigate the joint beamforming and power splitting design problem in a base station (BS) cluster-based cloud radio access network (C-RAN) with multicast fronthaul, where users are jointly served by BSs within each cluster. Meanwhile, each user can simultaneously obtain information and energy from received signals. On this basis, under predefined minimum harvested energy of each user and maximum transmit power of each BS and central processor, we formulate a sum rate maximization problem by jointly optimizing multicast fronthaul beamforming, cooperative access beamforming and power split ratios. Due to the difficulty in solving the formulated problem, we first transform it into a convex one by successive convex approximate and semidefinite program (SDP) relaxation techniques, and then propose an effective iterative algorithm. Moreover, we design a randomization method that can always obtain the rank-one solution. Finally, numerical results are conducted to validate the effectiveness of our proposed algorithm.


title: Waves, Algebraic Growth and Clumping in Sedimenting Disk Arrays

abstract: An array of spheres descending slowly through a viscous fluid always clumps [J.M. Crowley, J. Fluid Mech. {\bf 45}, 151 (1971)]. We show that anisotropic particle shape qualitatively transforms this iconic instability of collective sedimentation. In experiment and theory on disks, aligned facing their neighbours in a horizontal one-dimensional lattice and settling at Reynolds number $\sim 10^{-4}$ in a quasi-two-dimensional slab geometry, we find that for large enough lattice spacing the coupling of disk orientation and translation rescues the array from the clumping instability. Despite the absence of inertia the resulting dynamics displays the wavelike excitations of a mass-and-spring array, with a conserved "momentum" in the form of the collective tilt of the disks and an emergent spring stiffness from the viscous hydrodynamic interaction. However, the non-normal character of the dynamical matrix leads to algebraic growth of perturbations even in the linearly stable regime. Stability analysis demarcates a phase boundary in the plane of wavenumber and lattice spacing, separating the regimes of algebraically growing waves and clumping, in quantitative agreement with our experiments. Anisotropic shape thus suppresses the classic linear instability of sedimenting sphere arrays, introduces a new conserved variable, and opens a window to the physics of transient growth of linearly stable modes.