title: Cross-Modal Discrete Representation Learning

abstract: Recent advances in representation learning have demonstrated an ability to represent information from different modalities such as video, text, and audio in a single high-level embedding vector. In this work we present a self-supervised learning framework that is able to learn a representation that captures finer levels of granularity across different modalities such as concepts or events represented by visual objects or spoken words. Our framework relies on a discretized embedding space created via vector quantization that is shared across different modalities. Beyond the shared embedding space, we propose a Cross-Modal Code Matching objective that forces the representations from different views (modalities) to have a similar distribution over the discrete embedding space such that cross-modal objects/actions localization can be performed without direct supervision. In our experiments we show that the proposed discretized multi-modal fine-grained representation (e.g., pixel/word/frame) can complement high-level summary representations (e.g., video/sentence/waveform) for improved performance on cross-modal retrieval tasks. We also observe that the discretized representation uses individual clusters to represent the same semantic concept across modalities.


title: The impacts of the electricity demand pattern on electricity system cost and the electricity supply mix: a comprehensive modeling analysis for Europe

abstract: Energy system models for long-term planning are widely used to explore the future electricity system. Typically, to represent the future electricity demand in these models, historical demand profiles are used directly or scaled up linearly. Although the volume change for the electricity demand is considered, the potential change of the demand pattern is ignored. Meanwhile, the future electricity demand pattern is highly uncertain due to various factors, including climate change, e-mobility, electric heating, and electric cooling. We use a techno-economic cost optimization model to investigate a stylized case and assess the effects on system cost and electricity supply mix of assuming different demand patterns for the models. Our results show that differences in diurnal demand patterns affect the system cost by less than 3%. Similarly, demand profiles with a flat seasonal variation or a winter peak result in only minor changes in system cost, as compared to the present demand profile. Demand profiles with a summer peak may display a system cost increase of up to 8%, whereas the electricity supply mix may differ by a factor of two. A more detailed case study is conducted for Europe and the results are consistent with the findings from the stylized case.


title: In silico Prediction of Mozenavir as potential drug for SARS-CoV-2 infection via Binding Multiple Drug Targets

abstract: Since the epidemic began in November 2019, no viable medicine against SARS-CoV-2 has been discovered. The typical medication discovery strategy requires several years of rigorous research and development as well as a significant financial commitment, which is not feasible in the face of the current epidemic. Through molecular docking and dynamic simulation studies, we used the FDA-approved drug mezonavir against the most important viral targets, including spike (S) glycoprotein, Transmembrane serine protease 2 (TMPRSS2), RNA-dependent RNA polymerase (RdRp), Main protease (Mpro), human angiotensin-converting enzyme 2 (ACE-2), and furin. These targets are critical for viral replication and infection propagation because they play a key role in replication/transcription and host cell recognition. Molecular docking revealed that the antiviral medication mozenavir showed a stronger affinity for SARS-CoV-2 target proteins than reference medicines in this investigation. We discovered that mozenavir increases the complex's stability and validates the molecular docking findings using molecular dynamics modelling. Furin, a target protein of COVID-19, has a greater binding affinity (-12.04 kcal/mol) than other COVID-19 target proteins, forming different hydrogen bonds and polar and hydrophobic interactions, suggesting that it might be used as an antiviral treatment against SARS-CoV-2. Overall, the present in silico results will be valuable in identifying crucial targets for subsequent experimental investigations that might help combat COVID-19 by blocking the protease furin's proteolytic activity.


title: Unsupervised Video Person Re-identification via Noise and Hard frame Aware Clustering

abstract: Unsupervised video-based person re-identification (re-ID) methods extract richer features from video tracklets than image-based ones. The state-of-the-art methods utilize clustering to obtain pseudo-labels and train the models iteratively. However, they underestimate the influence of two kinds of frames in the tracklet: 1) noise frames caused by detection errors or heavy occlusions exist in the tracklet, which may be allocated with unreliable labels during clustering; 2) the tracklet also contains hard frames caused by pose changes or partial occlusions, which are difficult to distinguish but informative. This paper proposes a Noise and Hard frame Aware Clustering (NHAC) method. NHAC consists of a graph trimming module and a node re-sampling module. The graph trimming module obtains stable graphs by removing noise frame nodes to improve the clustering accuracy. The node re-sampling module enhances the training of hard frame nodes to learn rich tracklet information. Experiments conducted on two video-based datasets demonstrate the effectiveness of the proposed NHAC under the unsupervised re-ID setting.


title: Marginal Stability Enables Memory Training in Jammed Solids

abstract: Memory encoding by cyclic shear is a reliable process to store information in jammed solids, yet its underlying mechanism and its connection to the amorphous structure are not fully understood. When a jammed sphere packing is repeatedly sheared with cycles of the same strain amplitude, it optimizes its mechanical response to the cyclic driving and stores a memory of it. We study memory by cyclic shear training as a function of the underlying stability of the amorphous structure in marginally stable and highly stable packings, the latter produced by minimizing the potential energy using both positional and radial degrees of freedom. We find that jammed solids need to be marginally stable in order to store a memory by cyclic shear. In particular, highly stable packings store memories only after overcoming brittle yielding and the cyclic shear training takes place in the shear band, a region which we show to be marginally stable.


title: Fast Laser Cooling Using Optimal Quantum Control

abstract: Cooling down a trapped ion into its motional ground state is a central step for trapped ions based quantum information processing. State of the art cooling schemes often work under a set of optimal cooling conditions derived analytically using a perturbative approach, in which the sideband coupling is assumed to be the weakest of all the relevant transitions. As a result the cooling rate is severely limited. Here we propose to use quantum control technique powered with automatic differentiation to speed up the classical cooling schemes. We demonstrate the efficacy of our approach by applying it to find the optimal cooling conditions for classical sideband cooling and electromagnetically induced transparency cooling schemes, which are in general beyond the weak sideband coupling regime. Based on those numerically found optimal cooling conditions, we show that faster cooling can be achieved while at the same time a low average phonon occupation can be retained.


title: Multiplicative perturbation bounds for the Generalized block Cholesky downdating problem

abstract: The explicit expressions for the strong and the weak rigorous multiplicative perturbation bounds for the Generalized block Cholesky downdating problem are obtained. By bringing together the modified matrix-vector equation approach with the method of Lyapunov majorant function and the Banach fixed point theorem, we derived the strong rigorous multiplicative perturbation bounds. By using the matrix-equation approach the weak rigorous multiplicative bounds are presented. Numerical experiments are provided to illustrate the obtained results.


title: Exploiting Local Convergence of Quasi-Newton Methods Globally: Adaptive Sample Size Approach

abstract: In this paper, we study the application of quasi-Newton methods for solving empirical risk minimization (ERM) problems defined over a large dataset. Traditional deterministic and stochastic quasi-Newton methods can be executed to solve such problems; however, it is known that their global convergence rate may not be better than first-order methods, and their local superlinear convergence only appears towards the end of the learning process. In this paper, we use an adaptive sample size scheme that exploits the superlinear convergence of quasi-Newton methods globally and throughout the entire learning process. The main idea of the proposed adaptive sample size algorithms is to start with a small subset of data points and solve their corresponding ERM problem within its statistical accuracy, and then enlarge the sample size geometrically and use the optimal solution of the problem corresponding to the smaller set as an initial point for solving the subsequent ERM problem with more samples. We show that if the initial sample size is sufficiently large and we use quasi-Newton methods to solve each subproblem, the subproblems can be solved superlinearly fast (after at most three iterations), as we guarantee that the iterates always stay within a neighborhood that quasi-Newton methods converge superlinearly. Numerical experiments on various datasets confirm our theoretical results and demonstrate the computational advantages of our method.


title: Symmetry-breaking bifurcations and ghost states in the fractional nonlinear Schr\"{o}dinger equation with a PT-symmetric potential

abstract: We report symmetry-breaking and restoring bifurcations of solitons in a fractional Schr\"{o}dinger equation with the cubic or cubic-quintic (CQ) nonlinearity and a parity-time (PT)-symmetric potential, which may be realized in optical cavities. Solitons are destabilized at the bifurcation point, and, in the case of the CQ nonlinearity, the stability is restored by an inverse bifurcation. Two mutually-conjugate branches of ghost states (GSs), with complex propagation constants, are created by the bifurcation, solely in the case of the fractional diffraction. While GSs are not true solutions, direct simulations confirm that their shapes and results of their stability analysis provide a blueprint for the evolution of genuine localized modes in the system.


title: Recovering a Riemannian Metric from Cherenkov Radiation in Inhomogeneous Anisotropic Medium

abstract: Although travelling faster than the speed of light in vacuum is not physically allowed, the analogous bound in medium can be exceeded by a moving particle. For an electron in dielectric material this leads to emission of photons which is usually referred to as Cherenkov radiation. In this article a related mathematical system for waves in inhomogeneous anisotropic medium with a maximum of three polarisation directions is studied. The waves are assumed to satisfy $P^k_j u_k (x,t) = S_j(x,t)$, where $P$ is a vector-valued wave operator that depends on a Riemannian metric and $S $ is a point source that moves at speed $\beta < c$ in given direction $\theta \in \mathbb{S}^2$. The phase velocity $v_{\text{phase}}$ is described by the metric and depends on both location and direction of motion. In regions where $v_{\text{phase}}(x,\theta) < \beta <c $ holds the source generates a cone-shaped front of singularities that propagate according to the underlying geometry. We introduce a model for a measurement setup that applies the mechanism and show that the Riemannian metric inside a bounded region can be reconstructed from partial boundary measurements. The result suggests that Cherenkov type radiation can be applied to detect internal geometric properties of an inhomogeneous anisotropic target from a distance.


title: Cohomology Group of $K(\mathbb{Z},4)$ and $K(\mathbb{Z},5)$

abstract: We are familiar with properties and structure of topological spaces. One of the powerful tools, which help us to figure out the structure of topological spaces is (Leray- Serre) spectral sequence. Although Eilenberg-Maclane space plays important roles in topology, and respectively geometry. Actually finding cohomology groups of this space can be useful for classifying spaces, and also homotopy groups structure of these groups. This paper discusses how to compute cohomology groups of Eilenberg-Maclane spaces $K(\mathbb{Z}, 4)$ and $K(\mathbb{Z}, 5)$ (cohomology degree less than $11$). Furthermore we give the method to find cohomology groups of $K(\mathbb{Z}, n)$. Some proofs are given to the basic facts about cohomology group of $K(\mathbb{Z}, 5)$ and $K(\mathbb{Z},4).$


title: Investigating Alternatives to the Root Mean Square for Adaptive Gradient Methods

abstract: Adam is an adaptive gradient method that has experienced widespread adoption due to its fast and reliable training performance. Recent approaches have not offered significant improvement over Adam, often because they do not innovate upon one of its core features: normalization by the root mean square (RMS) of recent gradients. However, as noted by Kingma and Ba (2015), any number of $L^p$ normalizations are possible, with the RMS corresponding to the specific case of $p=2$. In our work, we theoretically and empirically characterize the influence of different $L^p$ norms on adaptive gradient methods for the first time. We show mathematically how the choice of $p$ influences the size of the steps taken, while leaving other desirable properties unaffected. We evaluate Adam with various $L^p$ norms on a suite of deep learning benchmarks, and find that $p > 2$ consistently leads to improved learning speed and final performance. The choices of $p=3$ or $p=6$ also match or outperform state-of-the-art methods in all of our experiments.


title: Input Augmentation Improves Constrained Beam Search for Neural Machine Translation: NTT at WAT 2021

abstract: This paper describes our systems that were submitted to the restricted translation task at WAT 2021. In this task, the systems are required to output translated sentences that contain all given word constraints. Our system combined input augmentation and constrained beam search algorithms. Through experiments, we found that this combination significantly improves translation accuracy and can save inference time while containing all the constraints in the output. For both En->Ja and Ja->En, our systems obtained the best evaluation performances in automatic evaluation.


title: A New Model for Fractons, Fluxons, and Freeons

abstract: We propose a lattice spin model on a cubic lattice that shares many of the properties of the 3D toric code and the X-cube fracton model. The model, made of Z_3 degrees of freedom at the links, has the vertex, the cube, and the plaquette terms. Being a stabilizer code the ground states are exactly solved. With only the vertex and the cube terms present, we show that the ground state degeneracy (GSD) is 3^(L3+3L-1) where L is the linear dimension of the cubic lattice. In addition to fractons, there are free vertex excitations we call the freeons. With the addition of the plaquette terms, GSD is vastly reduced to 3^3, with fracton, fluxon, and freeon excitations, among which only the freeons are deconfined. The model is called the AB model if only the vertex (A_v) and the cube (B_c) terms are present, and the ABC model if in addition the plaquette terms (C_p) are included. The AC model consisting of vertex and plaquette terms is the Z_3 3D toric code. The extensive GSD of the AB model derives from the existence of both local and non-local logical operators that connect different ground states. The latter operators are identical to the logical operators of the Z_3 X-cube model. Fracton excitations are immobile and accompanied by the creation of fluxons - plaquettes having nonzero flux. In the ABC model, such fluxon creation costs energy and ends up confining the fractons. Unlike past models of fractons, vertex excitations are free to move in any direction and pick up a non-trivial statistical phase when passing through a fluxon or a fracton cluster.


title: Nonlinear mixed-dimension model for embedded tubular networks with application to root water uptake

abstract: We present a numerical scheme for the solution of nonlinear mixed-dimensional PDEs describing coupled processes in embedded tubular network system in exchange with a bulk domain. Such problems arise in various biological and technical applications such as in the modeling of root-water uptake, heat exchangers, or geothermal wells. The nonlinearity appears in form of solution-dependent parameters such as pressure-dependent permeability or temperature-dependent thermal conductivity. We derive and analyse a numerical scheme based on distributing the bulk-network coupling source term by a smoothing kernel with local support. By the use of local analytical solutions, interface unknowns and fluxes at the bulk-network interface can be accurately reconstructed from coarsely resolved numerical solutions in the bulk domain. Numerical examples give confidence in the robustness of the method and show the results in comparison to previously published methods. The new method outperforms these existing methods in accuracy and efficiency. In a root water uptake scenario, we accurately estimate the transpiration rate using only a few thousand 3D mesh cells and a structured cube grid whereas other state-of-the-art numerical schemes require millions of cells and local grid refinement to reach comparable accuracy.


title: Improving White-box Robustness of Pre-processing Defenses via Joint Adversarial Training

abstract: Deep neural networks (DNNs) are vulnerable to adversarial noise. A range of adversarial defense techniques have been proposed to mitigate the interference of adversarial noise, among which the input pre-processing methods are scalable and show great potential to safeguard DNNs. However, pre-processing methods may suffer from the robustness degradation effect, in which the defense reduces rather than improving the adversarial robustness of a target model in a white-box setting. A potential cause of this negative effect is that adversarial training examples are static and independent to the pre-processing model. To solve this problem, we investigate the influence of full adversarial examples which are crafted against the full model, and find they indeed have a positive impact on the robustness of defenses. Furthermore, we find that simply changing the adversarial training examples in pre-processing methods does not completely alleviate the robustness degradation effect. This is due to the adversarial risk of the pre-processed model being neglected, which is another cause of the robustness degradation effect. Motivated by above analyses, we propose a method called Joint Adversarial Training based Pre-processing (JATP) defense. Specifically, we formulate a feature similarity based adversarial risk for the pre-processing model by using full adversarial examples found in a feature space. Unlike standard adversarial training, we only update the pre-processing model, which prompts us to introduce a pixel-wise loss to improve its cross-model transferability. We then conduct a joint adversarial training on the pre-processing model to minimize this overall risk. Empirical results show that our method could effectively mitigate the robustness degradation effect across different target models in comparison to previous state-of-the-art approaches.


title: Sign Consistency of the Generalized Elastic Net Estimator

abstract: In this paper, we propose a novel variable selection approach in the framework of high-dimensional linear models where the columns of the design matrix are highly correlated. It consists in rewriting the initial high-dimensional linear model to remove the correlation between the columns of the design matrix and in applying a generalized Elastic Net criterion since it can be seen as an extension of the generalized Lasso. The properties of our approach called gEN (generalized Elastic Net) are investigated both from a theoretical and a numerical point of view. More precisely, we provide a new condition called GIC (Generalized Irrepresentable Condition) which generalizes the EIC (Elastic Net Irrepresentable Condition) of Jia and Yu (2010) under which we prove that our estimator can recover the positions of the null and non null entries of the coefficients when the sample size tends to infinity. We also assess the performance of our methodology using synthetic data and compare it with alternative approaches. Our numerical experiments show that our approach improves the variable selection performance in many cases.


title: AKE-GNN: Effective Graph Learning with Adaptive Knowledge Exchange

abstract: Graph Neural Networks (GNNs) have already been widely used in various graph mining tasks. However, recent works reveal that the learned weights (channels) in well-trained GNNs are highly redundant, which inevitably limits the performance of GNNs. Instead of removing these redundant channels for efficiency consideration, we aim to reactivate them to enlarge the representation capacity of GNNs for effective graph learning. In this paper, we propose to substitute these redundant channels with other informative channels to achieve this goal. We introduce a novel GNN learning framework named AKE-GNN, which performs the Adaptive Knowledge Exchange strategy among multiple graph views generated by graph augmentations. AKE-GNN first trains multiple GNNs each corresponding to one graph view to obtain informative channels. Then, AKE-GNN iteratively exchanges redundant channels in the weight parameter matrix of one GNN with informative channels of another GNN in a layer-wise manner. Additionally, existing GNNs can be seamlessly incorporated into our framework. AKE-GNN achieves superior performance compared with various baselines across a suite of experiments on node classification, link prediction, and graph classification. In particular, we conduct a series of experiments on 15 public benchmark datasets, 8 popular GNN models, and 3 graph tasks and show that AKE-GNN consistently outperforms existing popular GNN models and even their ensembles. Extensive ablation studies and analyses on knowledge exchange methods validate the effectiveness of AKE-GNN.


title: It's good to be popular in high school: A look at disparities in STEM AP offerings in Northern California public high schools

abstract: In 2018, in response to the proposed elimination of physics at a predominately Hispanic and socioeconomically disadvantaged (SED) high school, the Northern California/Nevada chapter of the AAPT investigated school demographics and their effect on physics offerings in public high schools in our region. As access was a key issue, the focus was on public, non-charter high schools, which are free to students and do not require winning a lottery for attendance. As reported previously, the data revealed that the percentage of Hispanic students and the percentage of SED students at a high school are highly correlated (r^2=0.60). Additionally, these factors could be used as predictors of a school's physics offerings. To determine if the disparities in course offerings extended through other Advanced Placement (AP) STEM classes the data was further analyzed, revealing that as the popularity of an AP exam drops, so do the relative odds of it being offered, when comparing schools with different demographics. A Northern California public high school student is much more likely to get a strong selection of AP STEM classes if their school serves an affluent, non-Hispanic student majority rather than mostly poor, Hispanic students.


title: Phase diagram of the Hubbard model on a square lattice: A cluster slave-spin study

abstract: We employ the cluster slave-spin method to investigate systematically the ground state properties of the Hubbard model on a square lattice with doping $\delta$ and coupling strength $U$ being its parameters. In addition to a crossover reflected in the behavior of the antiferromagnetic gap $\Delta_{\text{AFM}}$, this property can also be observed in the energetics of the cluster slave-spin Hamiltonian -- the antiferromagnetism at small $U$ is due to the potential energy gain while that in the strong coupling limit is driven by the kinetic energy gain, which is consistent with the results from the cluster dynamical mean-field theory calculation and the quantum Monte Carlo simulation. We find the interaction $U_{c}$ for the crossover in the AFM state, separating the weak- and strong- coupling regimes, almost remains unchanged upon doping, and it is smaller than the critical coupling strength $U_{\text{Mott}}$ for the first-order metal-insulator Mott transition in the half-filled paramagnetic state. At half-filling, a relationship between the staggered magnetization $M$ and $\Delta_{\text{AFM}}$ is established in the small $U$ limit to nullify the Hartree-Fock theory, and a first-order Mott transition in the paramagnetic state is substantiated, which is characterized by discontinuities and hystereses at $U_{\text{Mott}}=10t$. Finally, an overall phase diagram in the $U$-$\delta$ plane is presented, which is composed of four regimes: the antiferromagnetic insulator, the antiferromagnetic metal with the compressibility $\kappa>0$ or $\kappa<0$, and the paramagnetic metal, as well as three phase transitions: (i) From the antiferromagnetic metal to the paramagnetic metal, (ii) between the antiferromagnetic metal phases with positive and negative $\kappa$, and (iii) separating the antiferromagnetic insulating phase from the antiferromagnetic metal phase.


title: Joint Landmark and Structure Learning for Automatic Evaluation of Developmental Dysplasia of the Hip

abstract: The ultrasound (US) screening of the infant hip is vital for the early diagnosis of developmental dysplasia of the hip (DDH). The US diagnosis of DDH refers to measuring alpha and beta angles that quantify hip joint development. These two angles are calculated from key anatomical landmarks and structures of the hip. However, this measurement process is not trivial for sonographers and usually requires a thorough understanding of complex anatomical structures. In this study, we propose a multi-task framework to learn the relationships among landmarks and structures jointly and automatically evaluate DDH. Our multi-task networks are equipped with three novel modules. Firstly, we adopt Mask R-CNN as the basic framework to detect and segment key anatomical structures and add one landmark detection branch to form a new multi-task framework. Secondly, we propose a novel shape similarity loss to refine the incomplete anatomical structure prediction robustly and accurately. Thirdly, we further incorporate the landmark-structure consistent prior to ensure the consistency of the bony rim estimated from the segmented structure and the detected landmark. In our experiments, 1,231 US images of the infant hip from 632 patients are collected, of which 247 images from 126 patients are tested. The average errors in alpha and beta angles are 2.221 degrees and 2.899 degrees. About 93% and 85% estimates of alpha and beta angles have errors less than 5 degrees, respectively. Experimental results demonstrate that the proposed method can accurately and robustly realize the automatic evaluation of DDH, showing great potential for clinical application.


title: Mode recovery in neural autoregressive sequence modeling

abstract: Despite its wide use, recent studies have revealed unexpected and undesirable properties of neural autoregressive sequence models trained with maximum likelihood, such as an unreasonably high affinity to short sequences after training and to infinitely long sequences at decoding time. We propose to study these phenomena by investigating how the modes, or local maxima, of a distribution are maintained throughout the full learning chain of the ground-truth, empirical, learned and decoding-induced distributions, via the newly proposed mode recovery cost. We design a tractable testbed where we build three types of ground-truth distributions: (1) an LSTM based structured distribution, (2) an unstructured distribution where probability of a sequence does not depend on its content, and (3) a product of these two which we call a semi-structured distribution. Our study reveals both expected and unexpected findings. First, starting with data collection, mode recovery cost strongly relies on the ground-truth distribution and is most costly with the semi-structured distribution. Second, after learning, mode recovery cost from the ground-truth distribution may increase or decrease compared to data collection, with the largest cost degradation occurring with the semi-structured ground-truth distribution. Finally, the ability of the decoding-induced distribution to recover modes from the learned distribution is highly impacted by the choices made earlier in the learning chain. We conclude that future research must consider the entire learning chain in order to fully understand the potentials and perils and to further improve neural autoregressive sequence models.


title: Spin-Orbit Torque Engineering in \beta-W/CoFeB Heterostructures via Ta and V Alloying at Interfaces

abstract: Spin-orbit torque manifested as an accumulated spin-polarized moment at nonmagnetic normal metal, and ferromagnet interfaces is a promising magnetization switching mechanism for spintronic devices. To fully exploit this in practice, materials with a high spin Hall angle, i.e., a charge-to-spin conversion efficiency, are indispensable. To date, very few approaches have been made to devise new nonmagnetic metal alloys. Moreover, new materials need to be compatible with semiconductor processing. Here we introduce W-Ta and W-V alloys and deploy them at the interface between $\beta$-W/CoFeB layers. First, spin Hall conductivities of W-Ta and W-V structures with various compositions are carried out by first-principles band calculations, which predict the spin Hall conductivity of the W-V alloy is improved from $-0.82 \times 10^3$ S/cm that of W to $-1.98 \times 10^3$ S/cm. Subsequently, heterostructure fabrication and spin-orbit torque properties are characterized experimentally. By alloying $\beta$-W with V at a concentration of 20 at%, we observe a large enhancement of the absolute value of spin Hall conductivity of up to $-(2.77 \pm 0.31) \times 10^3$ S/cm. By employing X-ray diffraction and scanning transmission electron microscopy, we further explain the enhancement of spin-orbit torque efficiency is stemmed from W-V alloy between W and CoFeB.


title: First-order sentences in random groups I: universal sentences

abstract: We prove that a random group, in Gromov's density model with $d<1/16$, satisfies a universal sentence $\sigma$ (in the language of groups) if and only if $\sigma$ is true in a nonabelian free group.


title: Lepton pair production in ultra-peripheral collisions

abstract: The lepton pair production in ultra-peripheral collisions (UPC) is studied in the classical field approximation. We derive a general form of the cross section in terms of photon distributions which depend on the transverse momentum and coordinate based on the wave packet form of nuclear wave functions. Such a general form of the cross section in the classical field approximation contains the results of the generalized equivalent photon approximation (EPA) as well as the corrections beyond EPA in the Born approximation. By rewriting the general form of the cross section in light-cone coordinates, we find a good connection with the transverse momentum dependent distribution (TMD) factorization formalism in the Born approximation. Our numerical results are consistent with current experimental data.


title: Cross-chain Interaction Model In a Fully Verified Way

abstract: There are different kinds of blockchains, which have been applied in various areas. Blockchains are relatively independent systems that are apt to form isolated data islands. Then cross-chain interaction is proposed to connect different blockchains. However, the current cross-chain methods do not maintain the security of the original blockchain. They either depend on a less secure third-party system or a less secure method. This makes the cross-chain interaction less secure than the original blockchains (the security downgrade issues), or the cross-chain interaction can be done even if the paired blockchain does not exist (the blockchain invisible issue). In this paper, we first propose a system interaction model and use it to analyze the possible security issues. Based on conclusions got from the proposed model, we propose the cross-chain method that verifies the data of the paired blockchain by the consensus algorithm of the paired blockchain (the CIFuV method). With this method, the cross-chain interaction can be as the same security as in the paired blockchain. At last, we evaluate the security issues during the system interaction process, and the possibility to have the CIFuV model on the public blockchains.


title: A note on injective factors with trivial bicentralizer

abstract: We give an alternative proof that an injective factor on a Hilbert space with trivial bicentralizer is ITPFI. Our proof is given in parallel with each type of factors and it is based on the strategy of Haagerup. As a consequence, the uniqueness theorem of injective factors except type III$_0$ follows from Araki-Woods' result.


title: Electroluminescence and thermal radiation from metallic carbon nanotubes with defects

abstract: Bias-induced light emission and thermal radiation from conducting channels of carbon nanotubes (CNTs) with defects are studied theoretically within the framework of nonequilibrium Green's function method based on a tight-binding model. Localized states induced by the single vacancy defect and single Stone-Wales defect in the low energy range enhance electroluminescence significantly while they reduce thermal radiation under zero bias. The influence of the diameters of the CNTs with defects on the radiation is discussed. Different from the 2D or bulk materials, the radiation intensities from quasi-one-dimensional metallic CNTs in thermal equilibrium are much smaller than that of the black-body radiation. We attribute this to the confinement of thermal excitation in the transverse direction of the CNT. Our study is important for optoelectronic applications of CNTs with defects.


title: Adaptive machine learning for protein engineering

abstract: Machine-learning models that learn from data to predict how protein sequence encodes function are emerging as a useful protein engineering tool. However, when using these models to suggest new protein designs, one must deal with the vast combinatorial complexity of protein sequences. Here, we review how to use a sequence-to-function machine-learning surrogate model to select sequences for experimental measurement. First, we discuss how to select sequences through a single round of machine-learning optimization. Then, we discuss sequential optimization, where the goal is to discover optimized sequences and improve the model across multiple rounds of training, optimization, and experimental measurement.


title: NetFC: enabling accurate floating-point arithmetic on programmable switches

abstract: In-network computation has been widely used to accelerate data-intensive distributed applications. Some computational tasks, traditional performed on servers, are offloaded to the network (i.e. programmable switches). However, the computational capacity of programmable switches is limited to simple integer arithmetic operations while many of applications require on-the-fly floating-point operations. To address this issue, prior approaches either adopt a float-to-integer method or directly offload computational tasks to the local CPUs of switches, incurring accuracy loss and delayed processing. To this end, we propose NetFC, a table-lookup method to achieve on-the-fly in-network floating-point arithmetic operations nearly without accuracy loss. NetFC adopts a divide-and-conquer mechanism that converts the original huge table into several much small tables together with some integer operations. NetFC adopts a scaling-factor mechanism for computational accuracy improvement, and a prefix-based lossless table compression method to reduce the memory overhead. We use different types of datasets to evaluate NetFC. The experimental results show that the average accuracy of NetFC can be as high as up to 99.94% at worst with only 448KB memory consumption. Furthermore, we integrate NetFC into Sonata for detecting Slowloris attack, yielding significant decrease of detection delay.


title: Multi-VFL: A Vertical Federated Learning System for Multiple Data and Label Owners

abstract: Vertical Federated Learning (VFL) refers to the collaborative training of a model on a dataset where the features of the dataset are split among multiple data owners, while label information is owned by a single data owner. In this paper, we propose a novel method, Multi Vertical Federated Learning (Multi-VFL), to train VFL models when there are multiple data and label owners. Our approach is the first to consider the setting where $D$-data owners (across which features are distributed) and $K$-label owners (across which labels are distributed) exist. This proposed configuration allows different entities to train and learn optimal models without having to share their data. Our framework makes use of split learning and adaptive federated optimizers to solve this problem. For empirical evaluation, we run experiments on the MNIST and FashionMNIST datasets. Our results show that using adaptive optimizers for model aggregation fastens convergence and improves accuracy.


title: Variational Information Bottleneck for Effective Low-Resource Fine-Tuning

abstract: While large-scale pretrained language models have obtained impressive results when fine-tuned on a wide variety of tasks, they still often suffer from overfitting in low-resource scenarios. Since such models are general-purpose feature extractors, many of these features are inevitably irrelevant for a given target task. We propose to use Variational Information Bottleneck (VIB) to suppress irrelevant features when fine-tuning on low-resource target tasks, and show that our method successfully reduces overfitting. Moreover, we show that our VIB model finds sentence representations that are more robust to biases in natural language inference datasets, and thereby obtains better generalization to out-of-domain datasets. Evaluation on seven low-resource datasets in different tasks shows that our method significantly improves transfer learning in low-resource scenarios, surpassing prior work. Moreover, it improves generalization on 13 out of 15 out-of-domain natural language inference benchmarks. Our code is publicly available in https://github.com/rabeehk/vibert.


title: Automated Self-Supervised Learning for Graphs

abstract: Graph self-supervised learning has gained increasing attention due to its capacity to learn expressive node representations. Many pretext tasks, or loss functions have been designed from distinct perspectives. However, we observe that different pretext tasks affect downstream tasks differently cross datasets, which suggests that searching pretext tasks is crucial for graph self-supervised learning. Different from existing works focusing on designing single pretext tasks, this work aims to investigate how to automatically leverage multiple pretext tasks effectively. Nevertheless, evaluating representations derived from multiple pretext tasks without direct access to ground truth labels makes this problem challenging. To address this obstacle, we make use of a key principle of many real-world graphs, i.e., homophily, or the principle that "like attracts like," as the guidance to effectively search various self-supervised pretext tasks. We provide theoretical understanding and empirical evidence to justify the flexibility of homophily in this search task. Then we propose the AutoSSL framework which can automatically search over combinations of various self-supervised tasks. By evaluating the framework on 7 real-world datasets, our experimental results show that AutoSSL can significantly boost the performance on downstream tasks including node clustering and node classification compared with training under individual tasks. Code is released at https://github.com/ChandlerBang/AutoSSL.


title: Coxeter Pop-Tsack Torsing

abstract: Given a finite irreducible Coxeter group $W$ with a fixed Coxeter element $c$, we define the Coxeter pop-tsack torsing operator $\mathsf{Pop}_T:W\to W$ by $\mathsf{Pop}_T(w)=w\cdot\pi_T(w)^{-1}$, where $\pi_T(w)$ is the join in the noncrossing partition lattice $\mathrm{NC}(w,c)$ of the set of reflections lying weakly below $w$ in the absolute order. This definition serves as a "Bessis dual" version of the first author's notion of a Coxeter pop-stack sorting operator, which, in turn, generalizes the pop-stack-sorting map on symmetric groups. We show that if $W$ is coincidental or of type $D$, then the identity element of $W$ is the unique periodic point of $\mathsf{Pop}_T$ and the maximum size of a forward orbit of $\mathsf{Pop}_T$ is the Coxeter number $h$ of $W$. In each of these types, we obtain a natural lift from $W$ to the dual braid monoid of $W$. We also prove that $W$ is coincidental if and only if it has a unique forward orbit of size $h$. For arbitrary $W$, we show that the forward orbit of $c^{-1}$ under $\mathsf{Pop}_T$ has size $h$ and is isolated in the sense that none of the non-identity elements of the orbit have preimages lying outside of the orbit.


title: A Central Limit Theorem, Loss Aversion and Multi-Armed Bandits

abstract: This paper studies a multi-armed bandit problem where the decision-maker is loss averse, in particular she is risk averse in the domain of gains and risk loving in the domain of losses. The focus is on large horizons. Consequences of loss aversion for asymptotic (large horizon) properties are derived in a number of analytical results. The analysis is based on a new central limit theorem for a set of measures under which conditional variances can vary in a largely unstructured history-dependent way subject only to the restriction that they lie in a fixed interval.


title: Stream processors and comodels

abstract: In 2009, Hancock, Pattinson and Ghani gave a coalgebraic characterisation of stream processors $A^\mathbb{N} \to B^\mathbb{N}$ drawing on ideas of Brouwerian constructivism. Their stream processors have an intensional character; in this paper, we give a corresponding coalgebraic characterisation of extensional stream processors, i.e., the set of continuous functions $A^\mathbb{N} \to B^\mathbb{N}$. Our account sites both our result and that of op. cit. within the apparatus of comodels for algebraic effects originating with Power-Shkaravska. Within this apparatus, the distinction between intensional and extensional equivalence for stream processors arises in the same way as the the distinction between bisimulation and trace equivalence for labelled transition systems and probabilistic generative systems.


title: The major mechanism to drive turbulence in star-forming galaxies

abstract: Two competing models, gravitational instability-driven transport and stellar feedback, have been proposed to interpret the high velocity dispersions observed in high-redshift galaxies. We study the major mechanisms to drive the turbulence in star-forming galaxies using a sample of galaxies from the xCOLD GASS survey, selected based on their star-formation rate (SFR) and gas fraction to be in the regime that can best distinguish between the proposed models. We perform Wide Field Spectrograph (WiFeS) integral field spectroscopic (IFS) observations to measure the intrinsic gas velocity dispersions, circular velocities and orbital periods in these galaxies. Comparing the relation between the SFR, velocity dispersion, and gas fraction with predictions of these two theoretical models, we find that our results are most consistent with a model that includes both transport and feedback as drivers of turbulence in the interstellar medium. By contrast, a model where stellar feedback alone drives turbulence under-predicts the observed velocity dispersion in our galaxies, and does not reproduce the observed trend with gas fraction. These observations therefore support the idea that gravitational instability makes a substantial contribution to turbulence in high redshift and high SFR galaxies.


title: Jointly Optimize Coding and Node Selection for Distributed Computing over Wireless Edge Networks

abstract: This work aims to jointly optimize the coding and node selection to minimize the processing time for distributed computing tasks over wireless edge networks. Since the joint optimization problem formulation is NP-hard and nonlinear, we leverage the discrete characteristic of its decision variables to transform the problem into an equivalent linear formulation. This linearization can guarantee to find the optimal solutions and significantly reduce the problem's complexity. Simulations based on real-world datasets show that the proposed approach can reduce the total processing time up to 2.3 times compared with that of state-of-the-art approach.


title: Learning Based Proximity Matrix Factorization for Node Embedding

abstract: Node embedding learns a low-dimensional representation for each node in the graph. Recent progress on node embedding shows that proximity matrix factorization methods gain superb performance and scale to large graphs with millions of nodes. Existing approaches first define a proximity matrix and then learn the embeddings that fit the proximity by matrix factorization. Most existing matrix factorization methods adopt the same proximity for different tasks, while it is observed that different tasks and datasets may require different proximity, limiting their representation power. Motivated by this, we propose {\em Lemane}, a framework with trainable proximity measures, which can be learned to best suit the datasets and tasks at hand automatically. Our method is end-to-end, which incorporates differentiable SVD in the pipeline so that the parameters can be trained via backpropagation. However, this learning process is still expensive on large graphs. To improve the scalability, we train proximity measures only on carefully subsampled graphs, and then apply standard proximity matrix factorization on the original graph using the learned proximity. Note that, computing the learned proximities for each pair is still expensive for large graphs, and existing techniques for computing proximities are not applicable to the learned proximities. Thus, we present generalized push techniques to make our solution scalable to large graphs with millions of nodes. Extensive experiments show that our proposed solution outperforms existing solutions on both link prediction and node classification tasks on almost all datasets.


title: Hermitian matrices of roots of unity and their characteristic polynomials

abstract: We investigate spectral conditions on Hermitian matrices of roots of unity. Our main results are conjecturally sharp upper bounds on the number of residue classes of the characteristic polynomial of such matrices modulo ideals generated by powers of $(1-\zeta)$, where $\zeta$ is a root of unity. We also prove a generalisation of a classical result of Harary and Schwenk about a relation for traces of powers of a graph-adjacency matrix, which is a crucial ingredient for the proofs of our main results.


title: Semantic-aware Binary Code Representation with BERT

abstract: A wide range of binary analysis applications, such as bug discovery, malware analysis and code clone detection, require recovery of contextual meanings on a binary code. Recently, binary analysis techniques based on machine learning have been proposed to automatically reconstruct the code representation of a binary instead of manually crafting specifics of the analysis algorithm. However, the existing approaches utilizing machine learning are still specialized to solve one domain of problems, rendering recreation of models for different types of binary analysis. In this paper, we propose DeepSemantic utilizing BERT in producing the semantic-aware code representation of a binary code. To this end, we introduce well-balanced instruction normalization that holds rich information for each of instructions yet minimizing an out-of-vocabulary (OOV) problem. DeepSemantic has been carefully designed based on our study with large swaths of binaries. Besides, DeepSemantic leverages the essence of the BERT architecture into re-purposing a pre-trained generic model that is readily available as a one-time processing, followed by quickly applying specific downstream tasks with a fine-tuning process. We demonstrate DeepSemantic with two downstream tasks, namely, binary similarity comparison and compiler provenance (i.e., compiler and optimization level) prediction. Our experimental results show that the binary similarity model outperforms two state-of-the-art binary similarity tools, DeepBinDiff and SAFE, 49.84% and 15.83% on average, respectively.


title: Nonlinear interaction of three impulsive gravitational waves II: the wave estimates

abstract: This is the second and last paper of a series aimed at solving the local Cauchy problem for polarized $\mathbb U(1)$ symmetric solutions to the Einstein vacuum equations featuring the nonlinear interaction of three small amplitude impulsive gravitational waves. Such solutions are characterized by their three singular "wave-fronts" across which the curvature tensor is allowed to admit a delta singularity. Under polarized $\mathbb U(1)$ symmetry, the Einstein vacuum equations reduce to the Einstein-scalar field system in $(2+1)$ dimensions. In this paper, we focus on the wave estimates for the scalar field in the reduced system. The scalar field terms are the most singular ones in the problem, with the scalar field only being Lipschitz initially. We use geometric commutators to prove energy estimates which reflect that the singularities are localized, and that the scalar field obeys additional fractional-derivative regularity, as well as regularity along appropriately defined "good directions". The main challenge is to carry out all these estimates using only the low-regularity properties of the metric. Finally, we prove an anisotropic Sobolev embedding lemma, which when combined with our energy estimates shows that the scalar field is everywhere Lipschitz, and that it obeys additional $C^{1,\theta}$ estimates away from the most singular region.


title: Lower Bounds on Metropolized Sampling Methods for Well-Conditioned Distributions

abstract: We give lower bounds on the performance of two of the most popular sampling methods in practice, the Metropolis-adjusted Langevin algorithm (MALA) and multi-step Hamiltonian Monte Carlo (HMC) with a leapfrog integrator, when applied to well-conditioned distributions. Our main result is a nearly-tight lower bound of $\widetilde{\Omega}(\kappa d)$ on the mixing time of MALA from an exponentially warm start, matching a line of algorithmic results up to logarithmic factors and answering an open question of Chewi et. al. We also show that a polynomial dependence on dimension is necessary for the relaxation time of HMC under any number of leapfrog steps, and bound the gains achievable by changing the step count. Our HMC analysis draws upon a novel connection between leapfrog integration and Chebyshev polynomials, which may be of independent interest.

categories: cs.DS cs.CC cs.LG math.ST stat.ML stat.TH


title: Tree-Structured Data Clustering-Driven Neural Network for Intra Prediction in Video Coding

abstract: As a crucial part of video compression, intra prediction utilizes local information of images to eliminate the redundancy in spatial domain. In both the High Efficiency Video Coding (H.265/HEVC) and Versatile Video Coding (H.266/VVC), multiple directional prediction modes are employed to find the texture trend of each small block and then the prediction is made based on reference samples in the selected direction. Recently, the intra prediction schemes based on neural networks have achieved great success. In these methods, the networks are trained and applied to intra prediction to assist the directional prediction modes. In this paper, we propose a novel tree-structured data clustering-driven neural network (dubbed TreeNet) for intra prediction, which builds the networks and clusters the training data in a tree-structured manner. Specifically, in each network split and training process of TreeNet, every parent network on a leaf node is split into two child networks by adding or subtracting Gaussian random noise. Then a data clustering-driven training is applied to train the two derived child networks using the clustered training data of their parent. To test the performance, TreeNet is integrated into VVC and HEVC to combine with or replace the directional prediction modes. In addition, a fast termination strategy is proposed to accelerate the search of TreeNet. The experimental results demonstrate that TreeNet with the fast termination can reach an average of 2.8% Bjontegaard distortion rate (BD-rate) improvement (up to 8.1%) and 4.9% BD-rate improvement (up to 8.2%) over VVC (VTM-4.0) and HEVC (HM-16.9) with all intra configuration, respectively.


title: Deep Position-wise Interaction Network for CTR Prediction

abstract: Click-through rate (CTR) prediction plays an important role in online advertising and recommender systems. In practice, the training of CTR models depends on click data which is intrinsically biased towards higher positions since higher position has higher CTR by nature. Existing methods such as actual position training with fixed position inference and inverse propensity weighted training with no position inference alleviate the bias problem to some extend. However, the different treatment of position information between training and inference will inevitably lead to inconsistency and sub-optimal online performance. Meanwhile, the basic assumption of these methods, i.e., the click probability is the product of examination probability and relevance probability, is oversimplified and insufficient to model the rich interaction between position and other information. In this paper, we propose a Deep Position-wise Interaction Network (DPIN) to efficiently combine all candidate items and positions for estimating CTR at each position, achieving consistency between offline and online as well as modeling the deep non-linear interaction among position, user, context and item under the limit of serving performance. Following our new treatment to the position bias in CTR prediction, we propose a new evaluation metrics named PAUC (position-wise AUC) that is suitable for measuring the ranking quality at a given position. Through extensive experiments on a real world dataset, we show empirically that our method is both effective and efficient in solving position bias problem. We have also deployed our method in production and observed statistically significant improvement over a highly optimized baseline in a rigorous A/B test.


title: On the 4-adic complexity of the two-prime quaternary generator

abstract: R. Hofer and A. Winterhof proved that the 2-adic complexity of the two-prime (binary) generator of period $pq$ with two odd primes $p\neq q$ is close to its period and it can attain the maximum in many cases. When the two-prime generator is applied to producing quaternary sequences, we need to determine the 4-adic complexity. We present the formulae of possible values of the 4-adic complexity, which is larger than $pq-\log_4(pq^2)-1$ if $p<q$. So it is good enough to resist the attack of the rational approximation algorithm.


title: A Unified Framework for Task-Driven Data Quality Management

abstract: High-quality data is critical to train performant Machine Learning (ML) models, highlighting the importance of Data Quality Management (DQM). Existing DQM schemes often cannot satisfactorily improve ML performance because, by design, they are oblivious to downstream ML tasks. Besides, they cannot handle various data quality issues (especially those caused by adversarial attacks) and have limited applications to only certain types of ML models. Recently, data valuation approaches (e.g., based on the Shapley value) have been leveraged to perform DQM; yet, empirical studies have observed that their performance varies considerably based on the underlying data and training process. In this paper, we propose a task-driven, multi-purpose, model-agnostic DQM framework, DataSifter, which is optimized towards a given downstream ML task, capable of effectively removing data points with various defects, and applicable to diverse models. Specifically, we formulate DQM as an optimization problem and devise a scalable algorithm to solve it. Furthermore, we propose a theoretical framework for comparing the worst-case performance of different DQM strategies. Remarkably, our results show that the popular strategy based on the Shapley value may end up choosing the worst data subset in certain practical scenarios. Our evaluation shows that DataSifter achieves and most often significantly improves the state-of-the-art performance over a wide range of DQM tasks, including backdoor, poison, noisy/mislabel data detection, data summarization, and data debiasing.


title: VaLiPro: Linear Programming Validator for Cluster Computing Systems

abstract: The article presents and evaluates a scalable algorithm for validating solutions of linear programming problems on cluster computing systems. The main idea of the method is to generate a regular set of points (validation set) on a small-radius hypersphere centered at the point of the solution under validation. The objective function is calculated for each point of the validation set that belongs to the feasible region. If all these values are less than or equal to the value of the objective function at the point under validation, then this point is the correct solution. The parallel implementation of the VaLiPro algorithm is performed in C++ through the parallel BSF-skeleton, which encapsulates all aspects related to the MPI-based parallelization of the program. We provide the results of large-scale computational experiments on a cluster computing system to study the scalability of the VaLiPro algorithm.


title: Kahler-Einstein metric near an isolated log canonical singularity

abstract: We construct Kahler-Einstein metrics with negative scalar curvature near an isolated log canonical (non-log terminal) singularity. Such metrics are complete near the singularity if the underlying space has complex dimension 2 or if the singularity is smoothable. In complex dimension 2, we show that any complete Kahler-Einstein metric of negative scalar curvature near an isolated log canonical (non-log terminal) singularity is smoothly asymptotically close to one of the model metrics constructed by Kobayashi and Nakamura arising from hyperbolic geometry.


title: RLCorrector: Reinforced Proofreading for Cell-level Microscopy Image Segmentation

abstract: Segmentation of nanoscale electron microscopy (EM) images is crucial but still challenging in connectomics research. One reason for this is that none of the existing segmentation methods are error-free, so they require proofreading, which is typically implemented as an interactive, semi-automatic process via manual intervention. Herein, we propose a fully automatic proofreading method based on reinforcement learning that mimics the human decision process of detection, classification, and correction of segmentation errors. We systematically design the proposed system by combining multiple reinforcement learning agents in a hierarchical manner, where each agent focuses only on a specific task while preserving dependency between agents. Furthermore, we demonstrate that the episodic task setting of reinforcement learning can efficiently manage a combination of merge and split errors concurrently presented in the input. We demonstrate the efficacy of the proposed system by comparing it with conventional proofreading methods over various testing cases.


title: Reply to: Comment on (t, n) Threshold d-level Quantum Secret Sharing

abstract: A corresponding comment, raised by Kao and Hwang, claims that the reconstructor Bob1 is unable to obtain the expected secret information in (t, n) Threshold d-level Quantum Secret Sharing (TDQSS)[Scientific Reports, Vol. 7, No. 1 (2017), pp.6366] . In this reply, we show the TDQSS scheme can obtain the dealer's secret information in the condition of adding a step on disentanglement.


title: Convex Risk Bounded Continuous-Time Trajectory Planning in Uncertain Nonconvex Environments

abstract: In this paper, we address the trajectory planning problem in uncertain nonconvex static and dynamic environments that contain obstacles with probabilistic location, size, and geometry. To address this problem, we provide a risk bounded trajectory planning method that looks for continuous-time trajectories with guaranteed bounded risk over the planning time horizon. Risk is defined as the probability of collision with uncertain obstacles. Existing approaches to address risk bounded trajectory planning problems either are limited to Gaussian uncertainties and convex obstacles or rely on sampling-based methods that need uncertainty samples and time discretization. To address the risk bounded trajectory planning problem, we leverage the notion of risk contours to transform the risk bounded planning problem into a deterministic optimization problem. Risk contours are the set of all points in the uncertain environment with guaranteed bounded risk. The obtained deterministic optimization is, in general, nonlinear and nonconvex time-varying optimization. We provide convex methods based on sum-of-squares optimization to efficiently solve the obtained nonconvex time-varying optimization problem and obtain the continuous-time risk bounded trajectories without time discretization. The provided approach deals with arbitrary probabilistic uncertainties, nonconvex and nonlinear, static and dynamic obstacles, and is suitable for online trajectory planning problems.


title: SignalNet: A Low Resolution Sinusoid Decomposition and Estimation Network

abstract: The detection and estimation of sinusoids is a fundamental signal processing task for many applications related to sensing and communications. While algorithms have been proposed for this setting, quantization is a critical, but often ignored modeling effect. In wireless communications, estimation with low resolution data converters is relevant for reduced power consumption in wideband receivers. Similarly, low resolution sampling in imaging and spectrum sensing allows for efficient data collection. In this work, we propose SignalNet, a neural network architecture that detects the number of sinusoids and estimates their parameters from quantized in-phase and quadrature samples. We incorporate signal reconstruction internally as domain knowledge within the network to enhance learning and surpass traditional algorithms in mean squared error and Chamfer error. We introduce a worst-case learning threshold for comparing the results of our network relative to the underlying data distributions. This threshold provides insight into why neural networks tend to outperform traditional methods and into the learned relationships between the input and output distributions. In simulation, we find that our algorithm is always able to surpass the threshold for three-bit data but often cannot exceed the threshold for one-bit data. We use the learning threshold to explain, in the one-bit case, how our estimators learn to minimize the distributional loss, rather than learn features from the data.


title: Hybrid Spherical- and Planar-Wave Channel Modeling and DCNN-powered Estimation for Terahertz Ultra-massive MIMO Systems

abstract: The Terahertz band is envisioned to meet the demanding 100 Gbps data rates for 6G wireless communications. Aiming at combating the distance limitation problem with low hardware-cost, ultra-massive MIMO with hybrid beamforming is promising. However, relationships among wavelength, array size and antenna spacing give rise to the inaccuracy of planar-wave channel model (PWM), while an enlarged channel matrix dimension leads to excessive parameters of applying spherical-wave channel model (SWM). Moreover, due to the adoption of hybrid beamforming, channel estimation (CE) needs to recover high-dimensional channels from severely compressed channel observation. In this paper, a hybrid spherical- and planar-wave channel model (HSPM) is investigated and proved to be accurate and efficient by adopting PWM within subarray and SWM among subarray. Furthermore, a two-phase HSPM CE mechanism is developed. A deep convolutional-neural-network (DCNN) is designed in the first phase for parameter estimation of reference subarrays, while geometric relationships of the remaining channel parameters between reference subarrays are leveraged to complete CE in the second phase. Extensive numerical results demonstrate the HSPM is accurate at various communication distances, array sizes and carrier frequencies.The DCNN converges fast and achieves high accuracy with 5.2 dB improved normalized-mean-square-error compared to literature methods, and owns substantially low complexity.


title: Learning to Play General-Sum Games Against Multiple Boundedly Rational Agents

abstract: We study the problem of training a principal in a multi-agent general-sum game using reinforcement learning (RL). Learning a robust principal policy requires anticipating the worst possible strategic responses of other agents, which is generally NP-hard. However, we show that no-regret dynamics can identify these worst-case responses in poly-time in smooth games. We propose a framework that uses this policy evaluation method for efficiently learning a robust principal policy using RL. This framework can be extended to provide robustness to boundedly rational agents too. Our motivating application is automated mechanism design: we empirically demonstrate our framework learns robust mechanisms in both matrix games and complex spatiotemporal games. In particular, we learn a dynamic tax policy that improves the welfare of a simulated trade-and-barter economy by 15%, even when facing previously unseen boundedly rational RL taxpayers.


title: Categorical Donaldson-Thomas theory for local surfaces: $\mathbb{Z}/2$-periodic version

abstract: We prove two kinds of $\mathbb{Z}/2$-periodic Koszul duality equivalences for triangulated categories of matrix factorizations associated with $(-1)$-shifted cotangents over quasi-smooth affine derived schemes. We use this result to define $\mathbb{Z}/2$-periodic version of Donaldson-Thomas categories for local surfaces, whose $\mathbb{C}^{\ast}$-equivariant version was introduced and developed in the author's previous paper. We compare $\mathbb{Z}/2$-periodic DT category with the $\mathbb{C}^{\ast}$-equivariant one, and deduce wall-crossing equivalences of $\mathbb{Z}/2$-periodic DT categories from those of $\mathbb{C}^{\ast}$-equivariant DT categories.


title: Superscalability of the random batch Ewald method

abstract: Coulomb interaction, following an inverse-square force-law, quantifies the amount of force between two stationary and electrically charged particles. The long-range nature of Coulomb interactions poses a major challenge to molecular dynamics simulations which are major tools for problems at the nano-/micro- scale. Various algorithms are developed to calculate the pairwise Coulomb interactions to a linear scaling but the poor scalability limits the size of simulated systems. Here, we conduct an efficient molecular dynamics algorithm with the random batch Ewald method on all-atom systems where the complete Fourier components in the Coulomb interaction are replaced by randomly selected mini-batches. By simulating the $N$-body systems up to 100 million particles using $10$ thousand CPU cores, we show that this algorithm furnishes $O(N)$ complexity, almost perfect scalability and an order of magnitude faster computational speed when compared to the existing state-of-the-art algorithms. Further examinations of our algorithm on distinct systems, including pure water, micro-phase-separated electrolyte and protein solution demonstrate that the spatiotemporal information on all time and length scales investigated and thermodynamic quantities derived from our algorithm are in perfect agreement with those obtained from the existing algorithms. Therefore, our algorithm provides a breakthrough solution on scalability of computing the Coulomb interaction. It is particularly useful and cost-effective to simulate ultra-large systems, which was either impossible or very costing to conduct using existing algorithms, thus would benefit the broad community of sciences.


title: Distance Metric Learning through Minimization of the Free Energy

abstract: Distance metric learning has attracted a lot of interest for solving machine learning and pattern recognition problems over the last decades. In this work we present a simple approach based on concepts from statistical physics to learn optimal distance metric for a given problem. We formulate the task as a typical statistical physics problem: distances between patterns represent constituents of a physical system and the objective function corresponds to energy. Then we express the problem as a minimization of the free energy of a complex system, which is equivalent to distance metric learning. Much like for many problems in physics, we propose an approach based on Metropolis Monte Carlo to find the best distance metric. This provides a natural way to learn the distance metric, where the learning process can be intuitively seen as stretching and rotating the metric space until some heuristic is satisfied. Our proposed method can handle a wide variety of constraints including those with spurious local minima. The approach works surprisingly well with stochastic nearest neighbors from neighborhood component analysis (NCA). Experimental results on artificial and real-world data sets reveal a clear superiority over a number of state-of-the-art distance metric learning methods for nearest neighbors classification.


title: Semiorthogonal decompositions for categorical Donaldson-Thomas theory via $\Theta$-stratifications

abstract: We show the existence of semiorthogonal decompositions of Donaldson-Thomas categories for $(-1)$-shifted cotangent derived stacks associated with $\Theta$-stratifications on them. Our main result gives an analogue of window theorem for categorical DT theory, which has applications to d-critical analogue of D/K equivalence conjecture, i.e. existence of fully-faithful functors (equivalences) under d-critical flips (flops). As an example of applications, we show the existence of fully-faithful functors of DT categories for Pandharipande-Thomas stable pair moduli spaces under wall-crossing at super-rigid rational curves for any relative reduced curve classes.


title: Hyperspace Neighbor Penetration Approach to Dynamic Programming for Model-Based Reinforcement Learning Problems with Slowly Changing Variables in A Continuous State Space

abstract: Slowly changing variables in a continuous state space constitute an important category of reinforcement learning and see its application in many domains, such as modeling a climate control system where temperature, humidity, etc. change slowly over time. However, this subject is less addressed in recent studies. Classical methods with certain variants, such as Dynamic Programming with Tile Coding which discretizes the state space, fail to handle slowly changing variables because those methods cannot capture the tiny changes in each transition step, as it is computationally expensive or impossible to establish an extremely granular grid system. In this paper, we introduce a Hyperspace Neighbor Penetration (HNP) approach that solves the problem. HNP captures in each transition step the state's partial "penetration" into its neighboring hyper-tiles in the gridded hyperspace, thus does not require the transition to be inter-tile in order for the change to be captured. Therefore, HNP allows for a very coarse grid system, which makes the computation feasible. HNP assumes near linearity of the transition function in a local space, which is commonly satisfied. In summary, HNP can be orders of magnitude more efficient than classical method in handling slowly changing variables in reinforcement learning. We have made an industrial implementation of NHP with a great success.


title: It's COMPASlicated: The Messy Relationship between RAI Datasets and Algorithmic Fairness Benchmarks

abstract: Risk assessment instrument (RAI) datasets, particularly ProPublica's COMPAS dataset, are commonly used in algorithmic fairness papers due to benchmarking practices of comparing algorithms on datasets used in prior work. In many cases, this data is used as a benchmark to demonstrate good performance without accounting for the complexities of criminal justice (CJ) processes. However, we show that pretrial RAI datasets can contain numerous measurement biases and errors, and due to disparities in discretion and deployment, algorithmic fairness applied to RAI datasets is limited in making claims about real-world outcomes. These reasons make the datasets a poor fit for benchmarking under assumptions of ground truth and real-world impact. Furthermore, conventional practices of simply replicating previous data experiments may implicitly inherit or edify normative positions without explicitly interrogating value-laden assumptions. Without context of how interdisciplinary fields have engaged in CJ research and context of how RAIs operate upstream and downstream, algorithmic fairness practices are misaligned for meaningful contribution in the context of CJ, and would benefit from transparent engagement with normative considerations and values related to fairness, justice, and equality. These factors prompt questions about whether benchmarks for intrinsically socio-technical systems like the CJ system can exist in a beneficial and ethical way.


title: AFAN: Augmented Feature Alignment Network for Cross-Domain Object Detection

abstract: Unsupervised domain adaptation for object detection is a challenging problem with many real-world applications. Unfortunately, it has received much less attention than supervised object detection. Models that try to address this task tend to suffer from a shortage of annotated training samples. Moreover, existing methods of feature alignments are not sufficient to learn domain-invariant representations. To address these limitations, we propose a novel augmented feature alignment network (AFAN) which integrates intermediate domain image generation and domain-adversarial training into a unified framework. An intermediate domain image generator is proposed to enhance feature alignments by domain-adversarial training with automatically generated soft domain labels. The synthetic intermediate domain images progressively bridge the domain divergence and augment the annotated source domain training data. A feature pyramid alignment is designed and the corresponding feature discriminator is used to align multi-scale convolutional features of different semantic levels. Last but not least, we introduce a region feature alignment and an instance discriminator to learn domain-invariant features for object proposals. Our approach significantly outperforms the state-of-the-art methods on standard benchmarks for both similar and dissimilar domain adaptations. Further extensive experiments verify the effectiveness of each component and demonstrate that the proposed network can learn domain-invariant representations.


title: Holographic time-dependent entanglement entropy in $p$-brane gas geometries

abstract: We study the time evolution of entanglement entropy in expanding universes with various matters. To describe expanding universes holographically, we take into account a braneworld moving in an asymptotic AdS space involving a uniform $p$-brane gas. In the braneworld model, an observer living in the braneworld detects the bulk motion of the braneworld as an expanding universe. We show that the entanglement entropy of expanding universes increases by the volume law in the early time and by the area law in the late time. We further consider the cosmological horizon, which is the border of the visible and invisible universe, and then investigate the time-dependent quantum entanglement between them across the cosmological horizon.


title: Frequency Dependence and Zero Crossover Effects in SQUID Based TDEM Measurements: Peculiarities or Facts?

abstract: In this paper we analyzed the two peculiarities frequently observed in SQUID magnetometer applications in TDEM based geophysical exploration such as the decay of the ground response is frequency dependent and sign reversal or zero-crossover effect at late decay times. A SQUID based TDEM system has been developed, characterized with prototype transmitter and field survey has been performed. Since the laboratory tests were done in a relatively noisy environment, the frequency dependence and the sign reversal effects have not been observed but the same have clearly been observed in the field survey. In the field survey, the decay transients surprisingly reached negative values in a terrain where a thin conducting layer is sandwiched between thick upper and thin lower resistive layers and the decay transients were highly dependent on base frequency of the transmitter waveforms. The major advantage of using the SQUIDs in TDEM applications is its extremely high sensitivity maintained at low frequencies. Therefore one can investigate the conductivity of the layers buried in deep below the surface of the ground. Nevertheless, the decay transients recorded with SQUID provided the information of the conducting layer along with an unexpected zero cross-over at later decay times. In this article, we describe the possible reasons for these peculiarities based on the observations made by various researchers, understanding of the TDEM concepts, behavior of the instruments and various experiments performed by us.


title: QNMnonreciprocal_resonators: an openly available toolbox for computing the QuasiNormal Modes of nonreciprocal resonators

abstract: QNMnonreciprocal_resonators is an extension (posted in 2021) of the QNMEig solver of the freeware package MAN. It provides a comprehensive presentation of the computation and normalization of electromagnetic quasinormal modes (QNMs) of resonators composed of nonreciprocal materials. It features a theoretical background on the topic and a COMSOL model that illustrates how to put into practice the theory on the example of a Yttrium iron garnet wire in a homogenous background. This document provides the necessary details on how the model is built so that the interested readers may easily modify it for computing QNMs of other nonreciprocal resonators.


title: Panel Data with Unknown Clusters

abstract: Clustered standard errors and approximate randomization tests are popular inference methods that allow for dependence within observations. However, they require researchers to know the cluster structure ex ante. We propose a procedure to help researchers discover clusters in panel data. Our method is based on thresholding an estimated long-run variance-covariance matrix and requires the panel to be large in the time dimension, but imposes no lower bound on the number of units. We show that our procedure recovers the true clusters with high probability with no assumptions on the cluster structure. The estimated clusters are independently of interest, but they can also be used in the approximate randomization tests or with conventional cluster-robust covariance estimators. The resulting procedures control size and have good power.


title: Significantly Enhanced Performance of Nanofluidic Osmotic Power Generation by Slipping Surfaces of Nanopores

abstract: High-performance osmotic energy conversion (OEC) with perm-selective porous membrane requires both high ionic selectivity and permeability simultaneously. Here, hydrodynamic slip is considered on surfaces of nanopores to break the tradeoff between ionic selectivity and permeability, because it decreases the viscous friction at solid-liquid interfaces which can promote ionic diffusion during OEC. Taking advantage of simulations, influences from individual slipping surfaces on the OEC performance have been investigated, i.e. the slipping inner surface (surfaceinner) and exterior surfaces on the low- and high-concentration sides (surfaceL and surfaceH). Results show that the slipping surfaceL is crucial for high-performance OEC. For nanopores with various lengths, the slipping surfaceL simultaneously increases both ionic permeability and selectivity of nanopores, which results in both significantly enhanced electric power and energy conversion efficiency. While for nanopores longer than 30 nm, the slipping surfaceinner plays a dominant role in the increase of electric power, which induces a considerable decrease in energy conversion efficiency due to enhanced transport of both cations and anions. Considering the difficulty in hydrodynamic slip modification to the surfaceinner of nanopores, the surface modification to the surfaceL may be a better choice to achieve high-performance OEC. Our results provide feasible guidance to the design of porous membranes for high-performance osmotic energy harvesting.


title: Convolutions and Self-Attention: Re-interpreting Relative Positions in Pre-trained Language Models

abstract: In this paper, we detail the relationship between convolutions and self-attention in natural language tasks. We show that relative position embeddings in self-attention layers are equivalent to recently-proposed dynamic lightweight convolutions, and we consider multiple new ways of integrating convolutions into Transformer self-attention. Specifically, we propose composite attention, which unites previous relative position embedding methods under a convolutional framework. We conduct experiments by training BERT with composite attention, finding that convolutions consistently improve performance on multiple downstream tasks, replacing absolute position embeddings. To inform future work, we present results comparing lightweight convolutions, dynamic convolutions, and depthwise-separable convolutions in language model pre-training, considering multiple injection points for convolutions in self-attention layers.


title: Brittle AI, Causal Confusion, and Bad Mental Models: Challenges and Successes in the XAI Program

abstract: The advances in artificial intelligence enabled by deep learning architectures are undeniable. In several cases, deep neural network driven models have surpassed human level performance in benchmark autonomy tasks. The underlying policies for these agents, however, are not easily interpretable. In fact, given their underlying deep models, it is impossible to directly understand the mapping from observations to actions for any reasonably complex agent. Producing this supporting technology to "open the black box" of these AI systems, while not sacrificing performance, was the fundamental goal of the DARPA XAI program. In our journey through this program, we have several "big picture" takeaways: 1) Explanations need to be highly tailored to their scenario; 2) many seemingly high performing RL agents are extremely brittle and are not amendable to explanation; 3) causal models allow for rich explanations, but how to present them isn't always straightforward; and 4) human subjects conjure fantastically wrong mental models for AIs, and these models are often hard to break. This paper discusses the origins of these takeaways, provides amplifying information, and suggestions for future work.


title: Transport in polymer membranes beyond linear response: Controlling permselectivity by the driving force

abstract: In the popular solution-diffusion picture, the membrane permeability is defined as the product of the partition ratio and the diffusivity of penetrating solutes inside the membrane in the linear response regime, i.e., in equilibrium. However, of practical importance is the penetrants' flux across the membrane driven by external forces. Here, we study nonequilibrium membrane permeation orchestrated by a uniform external driving field using molecular computer simulations and continuum (Smoluchowski) theory in the stationary state. In the simulations, we explicitly resolve the penetrants' transport across a finite monomer-resolved polymer network, addressing one-component penetrant systems and mixtures. We introduce and discuss possible definitions of nonequilibrium, force-dependent permeability, representing `system' and `membrane' permeability. In particular, we present for the first time a definition of the differential permeability response to the force. We demonstrate that the latter turns out to be significantly nonlinear for low-permeable systems, leading to a high amount of selectiveness in permeability, called `permselectivity', and is tunable by the driving force. Our continuum-level analytical solutions exhibit remarkable qualitative agreement with the penetrant- and polymer-resolved simulations, thereby allowing us to characterize the underlying mechanism of permeabilities and steady-state transport beyond the linear response level.


title: Vertical Federated Learning without Revealing Intersection Membership

abstract: Vertical Federated Learning (vFL) allows multiple parties that own different attributes (e.g. features and labels) of the same data entity (e.g. a person) to jointly train a model. To prepare the training data, vFL needs to identify the common data entities shared by all parties. It is usually achieved by Private Set Intersection (PSI) which identifies the intersection of training samples from all parties by using personal identifiable information (e.g. email) as sample IDs to align data instances. As a result, PSI would make sample IDs of the intersection visible to all parties, and therefore each party can know that the data entities shown in the intersection also appear in the other parties, i.e. intersection membership. However, in many real-world privacy-sensitive organizations, e.g. banks and hospitals, revealing membership of their data entities is prohibited. In this paper, we propose a vFL framework based on Private Set Union (PSU) that allows each party to keep sensitive membership information to itself. Instead of identifying the intersection of all training samples, our PSU protocol generates the union of samples as training instances. In addition, we propose strategies to generate synthetic features and labels to handle samples that belong to the union but not the intersection. Through extensive experiments on two real-world datasets, we show our framework can protect the privacy of the intersection membership while maintaining the model utility.


title: Does the Reionization Model Influence the Constraints on Dark Matter Decay or Annihilation?

abstract: If dark matter decay or annihilate, a large amount of energy and particles would be released into the cosmic plasma. Therefore, they could modify the thermal and ionization history of our universe, then leave footprints on the cosmic microwave background power spectra. In this paper, we take dark matter annihilation as an example and investigate whether different reionization models influence the constraints on dark matter annihilation. We consider the ionization history including both dark matter annihilation and star formation, then put constraints on DM annihilation. Combining the latest Planck data, BAO data, SNIa measurement, $Q_\text{HII}$ constraints from observations of quasars, as well as the star formation rate density from UV and IR data, the optical depth is $\tau=0.0571^{+0.0005}_{-0.0006}$ at 68$\%$C.L. and the upper limit of $\epsilon_0 f_d$ reads $2.7765\times 10^{-24}$ at 95$\%$C.L.. By comparison, we also constrain dark matter annihilation in the instantaneous reionization model from the same data combination except the $Q_\text{HII}$ constraints and star formation rate density. We get $\tau=0.0559^{+0.0069}_{-0.0076}$ at 68$\%$C.L. and the upper limit of $\epsilon_0 f_d$ is $2.8468\times 10^{-24}$ at 95$\%$C.L.. %, which is $2.5\%$ higher than the results in the previous model. This indicates various reionization models have little influence ($\lesssim 2.5\%$) on constraining parameters of dark matter decay or annihilation.


title: Symmetrical emergence of extreme events at multiple regions in a damped and driven velocity-dependent mechanical system

abstract: In this work, we report the emergence of extreme events in a damped and driven velocity-dependent mechanical system. We observe that the extreme events emerge at multiple points. We further notice that the extreme events occur symmetrically in both positive and negative values at all the points of emergence. We statistically confirm the emergence of extreme events by plotting the probability distribution function of peaks and interevent intervals. We also determine the mechanism behind the emergence of extreme events at all the points and classify these points into two categories depending on the region at which the extreme events emerge. Finally, we plot the two parameter diagram in order to have a complete overview of the system.


title: The KMOS Galaxy Evolution Survey (KGES): the angular momentum of star-forming galaxies over the last ~10 Gyr

abstract: We present the KMOS Galaxy Evolution Survey (KGES), a $K$-band Multi-Object Spectrograph (KMOS) study of the H$\alpha$ and [NII] emission from 288 $K$ band-selected galaxies at $1.2 \lesssim z \lesssim 1.8$, with stellar masses in the range $\log_{10}(M_{*}/\rm{M}_{\odot})\approx$9-11.5. In this paper, we describe the survey design, present the sample, and discuss the key properties of the KGES galaxies. We combine KGES with appropriately matched samples at lower redshifts from the KMOS Redshift One Spectroscopic Survey (KROSS) and the SAMI Galaxy Survey. Accounting for the effects of sample selection, data quality, and analysis techniques between surveys, we examine the kinematic characteristics and angular momentum content of star-forming galaxies at $z\approx1.5$, $\approx1$ and $\approx0$. We find that stellar mass, rather than redshift, most strongly correlates with the disc fraction amongst star-forming galaxies at $z \lesssim 1.5$, observing only a modest increase in the prevalence of discs between $z\approx1.5$ and $z\approx0.04$ at fixed stellar mass. Furthermore, typical star-forming galaxies follow the same median relation between specific angular momentum and stellar mass, regardless of their redshift, with the normalisation of the relation depending more strongly on how disc-like a galaxy's kinematics are. This suggests that massive star-forming discs form in a very similar manner across the $\approx$ 10 Gyr encompassed by our study and that the inferred link between the angular momentum of galaxies and their haloes does not change significantly across the stellar mass and redshift ranges probed in this work.


title: Some Large Deviations Asymptotics in Small Noise Filtering Problems

abstract: We consider nonlinear filters for diffusion processes when the observation and signal noises are small and of the same order. As the noise intensities approach zero, the nonlinear filter can be approximated by a certain variational problem that is closely related to Mortensen's optimization problem(1968). This approximation result can be made precise through a certain Laplace asymptotic formula. In this work we study probabilities of deviations of true filtering estimates from that obtained by solving the variational problem. Our main result gives a large deviation principle for Laplace functionals whose typical asymptotic behavior is described by Mortensen-type variational problems. Proofs rely on stochastic control representations for positive functionals of Brownian motions and Laplace asymptotics of the Kallianpur-Striebel formula.


title: Deterministic Mincut in Almost-Linear Time

abstract: We present a deterministic (global) mincut algorithm for weighted, undirected graphs that runs in $m^{1+o(1)}$ time, answering an open question of Karger from the 1990s. To obtain our result, we de-randomize the construction of the \emph{skeleton} graph in Karger's near-linear time mincut algorithm, which is its only randomized component. In particular, we partially de-randomize the well-known Benczur-Karger graph sparsification technique by random sampling, which we accomplish by the method of pessimistic estimators. Our main technical component is designing an efficient pessimistic estimator to capture the cuts of a graph, which involves harnessing the expander decomposition framework introduced in recent work by Goranci et al. (SODA 2021). As a side-effect, we obtain a structural representation of all approximate mincuts in a graph, which may have future applications.


title: Symmetric subcategories, tilting modules and derived recollements

abstract: For any good tilting module $T$ over a ring $A$, there exists an $n$-symmetric subcategory $\mathscr{E}$ of a module category such that the derived category of the endomorphism ring of $T$ is a recollement of the derived categories of $\mathscr{E}$ and $A$ in the sense of Beilinson-Bernstein-Deligne. Thus the kernel of the total left-derived tensor functor induced by the tilting module is triangle equivalent to the derived category of $\mathscr{E}$.


title: Understanding the Under-Coverage Bias in Uncertainty Estimation

abstract: Estimating the data uncertainty in regression tasks is often done by learning a quantile function or a prediction interval of the true label conditioned on the input. It is frequently observed that quantile regression -- a vanilla algorithm for learning quantiles with asymptotic guarantees -- tends to \emph{under-cover} than the desired coverage level in reality. While various fixes have been proposed, a more fundamental understanding of why this under-coverage bias happens in the first place remains elusive. In this paper, we present a rigorous theoretical study on the coverage of uncertainty estimation algorithms in learning quantiles. We prove that quantile regression suffers from an inherent under-coverage bias, in a vanilla setting where we learn a realizable linear quantile function and there is more data than parameters. More quantitatively, for $\alpha>0.5$ and small $d/n$, the $\alpha$-quantile learned by quantile regression roughly achieves coverage $\alpha - (\alpha-1/2)\cdot d/n$ regardless of the noise distribution, where $d$ is the input dimension and $n$ is the number of training data. Our theory reveals that this under-coverage bias stems from a certain high-dimensional parameter estimation error that is not implied by existing theories on quantile regression. Experiments on simulated and real data verify our theory and further illustrate the effect of various factors such as sample size and model capacity on the under-coverage bias in more practical setups.


title: Investigation of the correlation patterns and the Compton dominance variability of Mrk 421 in 2017

abstract: We present a detailed characterisation and theoretical interpretation of the broadband emission of the paradigmatic TeV blazar Mrk 421, with special focus on the multi-band flux correlations. The dataset has been collected through an extensive multiwavelength campaign organised between 2016 December and 2017 June. The instruments involved are MAGIC, FACT, Fermi-LAT, Swift, GASP-WEBT, OVRO, Medicina and Mets\"ahovi. Additionally, four deep exposures (several hours long) with simultaneous MAGIC and NuSTAR observations allowed a precise measurement of the falling segments of the two spectral components. The very-high-energy (VHE; E > 100 GeV) gamma rays and X-rays are positively correlated at zero time lag, but the strength and characteristics of the correlation change substantially across the various energy bands probed. The VHE versus X-ray fluxes follow different patterns, partly due to substantial changes in the Compton dominance during a few days without a simultaneous increase in the X-ray flux (i.e. orphan gamma-ray activity). Studying the broadband spectral energy distribution (SED) during the days including NuSTAR observations, we show that these changes can be explained within a one-zone leptonic model with a blob that increases its size over time. Our multi-band correlation study also hints at an anti-correlation between UV/optical and X-ray at a significance higher than 3 sigmas. A VHE flare observed on 2017 February 4 shows gamma-ray variability on multi-hour timescales, with a factor 10 increase in the TeV flux but only a moderate increase in the keV flux. The related broadband SED is better described by a two-zone leptonic scenario rather than by a one-zone scenario. We find that the flare can be produced by the appearance of a compact second blob populated by high energetic electrons spanning a narrow range of Lorentz factors.