title: Demonstration of a uniform, high-pressure, high-temperature gas cell with a dual frequency comb absorption spectrometer

abstract: Accurate absorption models for gases at high pressure and temperature support advanced optical combustion diagnostics and aid in the study of harsh planetary atmospheres. Developing and validating absorption models for these applications requires recreating the extreme temperature and pressure conditions of these environments in static, uniform, well-known conditions in the laboratory. Here, we present the design of a new gas cell to enable reference-quality absorption spectroscopy at high pressure and temperature. The design centers on a carefully controlled quartz sample cell housed at the core of a pressurized ceramic furnace. The half-meter sample cell is relatively long compared to past high- pressure and temperature absorption cells, and is surrounded by a molybdenum heat spreader that enables high temperature uniformity over the full length of the absorbing gas. We measure the temperature distribution of the sample gas using in situ thermocouples, and fully characterize the temperature uniformity across a full matrix of conditions up to 1000 K and 50 bar. The results demonstrate that the new design enables highly uniform and precisely known conditions across the full absorbing path length. Uniquely, we test the new gas cell with a broadband, high-resolution dual frequency comb spectrometer that enables highly resolved absorption spectroscopy across a wide range of temperature and pressure conditions. With this system, we measure the spectrum of CO$_2$ between 6800 and 7000 cm$^{-1}$ at pressures between 0.2 and 20 bar, and temperatures up to 1000 K. The measurements reveal discrepancies from spectra predicted by the HITRAN2016 database with a Voigt line shape at both low- and high-pressure conditions. These results motivate future work to expand absorption models and databases to accurately model high-pressure and -temperature spectra in combustion and planetary science research.


title: A comparative study of two-dimensional vocal tract acoustic modeling based on Finite-Difference Time-Domain methods

abstract: The two-dimensional (2D) numerical approaches for vocal tract (VT) modelling can afford a better balance between the low computational cost and accurate rendering of acoustic wave propagation. However, they require a high spatio-temporal resolution in the numerical scheme for a precise estimation of acoustic formants at the simulation run-time expense. We have recently proposed a new VT acoustic modelling technique, known as the 2.5D Finite-Difference Time-Domain (2.5D FDTD), which extends the existing 2D FDTD approach by adding tube depth to its acoustic wave solver. In this work, first, the simulated acoustic outputs of our new model are shown to be comparable with the 2D FDTD and a realistic 3D FEM VT model at a low spatio-temporal resolution. Next, a radiation model is developed by including a circular baffle around the VT as head geometry. The transfer functions of the radiation model are analyzed using five different vocal tract shapes for vowel sounds /a/, /e/, /i/, /o/ and /u/.


title: Two $^9$Li clusters connected with two valence neutrons in $^{20}$C

abstract: Many preceding works have shown in $^{11}$Li the presence of the halo structure comprised of the weakly bound two neutrons around $^9$Li, and it is intriguing to see how this halo structure changes when another $^9$Li approaches. In this study, we introduce a four-body model for $^{20}$C with two $^9$Li clusters and two valence neutrons. The recent development of the antisymmetrized quasi cluster model (AQCM) makes it possible to generate $jj$-coupling shell-model wave functions from $\alpha$ cluster models. Here, $jj$-coupling shell model wave function of $^9$Li is regarded as a cluster, which corresponds to the subclosure configuration of $p_{3/2}$ for the neutrons, and we discuss how the two neutrons connect two $^9$Li clusters. Until now, most of the clusters in the conventional models have been limited to the closures of the three-dimensional harmonic oscillators, such as $^4$He, $^{16}$O, and $^{40}$Ca; however, owing to AQCM, it is feasible to utilize the $jj$-coupling shell model wave functions as plural subsystems quite easily. The appearance of a rotational band structure with a cluster structure around the four-body threshold energy is discussed.


title: UVTomo-GAN: An adversarial learning based approach for unknown view X-ray tomographic reconstruction

abstract: Tomographic reconstruction recovers an unknown image given its projections from different angles. State-of-the-art methods addressing this problem assume the angles associated with the projections are known a-priori. Given this knowledge, the reconstruction process is straightforward as it can be formulated as a convex problem. Here, we tackle a more challenging setting: 1) the projection angles are unknown, 2) they are drawn from an unknown probability distribution. In this set-up our goal is to recover the image and the projection angle distribution using an unsupervised adversarial learning approach. For this purpose, we formulate the problem as a distribution matching between the real projection lines and the generated ones from the estimated image and projection distribution. This is then solved by reaching the equilibrium in a min-max game between a generator and a discriminator. Our novel contribution is to recover the unknown projection distribution and the image simultaneously using adversarial learning. To accommodate this, we use Gumbel-softmax approximation of samples from categorical distribution to approximate the generator's loss as a function of the unknown image and the projection distribution. Our approach can be generalized to different inverse problems. Our simulation results reveal the ability of our method in successfully recovering the image and the projection distribution in various settings.


title: Liquidation, Leverage and Optimal Margin in Bitcoin Futures Markets

abstract: Using the generalized extreme value theory to characterize tail distributions, we address liquidation, leverage, and optimal margins for bitcoin long and short futures positions. The empirical analysis of perpetual bitcoin futures on BitMEX shows that (1) daily forced liquidations to out- standing futures are substantial at 3.51%, and 1.89% for long and short; (2) investors got forced liquidation do trade aggressively with average leverage of 60X; and (3) exchanges should elevate current 1% margin requirement to 33% (3X leverage) for long and 20% (5X leverage) for short to reduce the daily margin call probability to 1%. Our results further suggest normality assumption on return significantly underestimates optimal margins. Policy implications are also discussed.


title: Infeasibility detection with primal-dual hybrid gradient for large-scale linear programming

abstract: We study the problem of detecting infeasibility of large-scale linear programming problems using the primal-dual hybrid gradient method (PDHG) of Chambolle and Pock (2011). The literature on PDHG has mostly focused on settings where the problem at hand is assumed to be feasible. When the problem is not feasible, the iterates of the algorithm do not converge. In this scenario, we show that the iterates diverge at a controlled rate towards a well-defined ray. The direction of this ray is known as the infimal displacement vector $v$. The first contribution of our work is to prove that this vector recovers certificates of primal and dual infeasibility whenever they exist. Based on this fact, we propose a simple way to extract approximate infeasibility certificates from the iterates of PDHG. We study three different sequences that converge to the infimal displacement vector: the difference of iterates, the normalized iterates, and the normalized average. All of them are easy to compute, and thus the approach is suitable for large-scale problems. Our second contribution is to establish tight convergence rates for these sequences. We demonstrate that the normalized iterates and the normalized average achieve a convergence rate of $O(1/k)$, improving over the known rate of $O(1/\sqrt{k})$. This rate is general and applies to any fixed-point iteration of a nonexpansive operator. Thus, it is a result of independent interest since it covers a broad family of algorithms, including, for example, ADMM, and can be applied settings beyond linear programming, such as quadratic and semidefinite programming. Further, in the case of linear programming we show that, under nondegeneracy assumptions, the iterates of PDHG identify the active set of an auxiliary feasible problem in finite time, which ensures that the difference of iterates exhibits eventual linear convergence to the infimal displacement vector.


title: Regularized Generative Adversarial Network

abstract: We propose a framework for generating samples from a probability distribution that differs from the probability distribution of the training set. We use an adversarial process that simultaneously trains three networks, a generator and two discriminators. We refer to this new model as regularized generative adversarial network (RegGAN). We evaluate RegGAN on a synthetic dataset composed of gray scale images and we further show that it can be used to learn some pre-specified notions in topology (basic topology properties). The work is motivated by practical problems encountered while using generative methods in the art world.


title: Rationally Inattentive Utility Maximization for Interpretable Deep Image Classification

abstract: Are deep convolutional neural networks (CNNs) for image classification explainable by utility maximization with information acquisition costs? We demonstrate that deep CNNs behave equivalently (in terms of necessary and sufficient conditions) to rationally inattentive utility maximizers, a generative model used extensively in economics for human decision making. Our claim is based by extensive experiments on 200 deep CNNs from 5 popular architectures. The parameters of our interpretable model are computed efficiently via convex feasibility algorithms. As an application, we show that our economics-based interpretable model can predict the classification performance of deep CNNs trained with arbitrary parameters with accuracy exceeding 94% . This eliminates the need to re-train the deep CNNs for image classification. The theoretical foundation of our approach lies in Bayesian revealed preference studied in micro-economics. All our results are on GitHub and completely reproducible.


title: BFV quantization of the nonprojectable 2+1 Horava theory

abstract: We show that the BFV quantization scheme can be implemented in the nonprojectable 2+1 Horava theory. This opens the possibility of imposing more general gauge conditions in the quantization of this theory. The BFV quantization is based on the canonical formalism, which is suitable to incorporate the measure associated to the second-class constraints that the theory has. Special features of the Hamiltonian density and the matrix of second-class constraints allow that the system be involutive in terms of Dirac brackets, which is a nontrivial requisite for implementing the BFV formalism. We present the BRST symmetry transformations in the canonical variables. The theory is of rank one, in the classification introduced by Fradkin and Fradkina. The originally called relativistic gauge-fixing conditions of the BFV formalism can be implemented in the nonprojectable Horava theory, extended to nonrelativistic forms. We show that the nonlocal gauge condition introduced in the projectable theory can be included among these gauges.


title: Directional recoil detection

abstract: Searches for dark matter-induced recoils have made impressive advances in the last few years. Yet the field is confronted by several outstanding problems. First, the inevitable background of solar neutrinos will soon inhibit the conclusive identification of many dark matter models. Second, and more fundamentally, current experiments have no practical way of confirming a detected signal's galactic origin. The concept of directional detection addresses both of these issues while offering opportunities to study novel dark matter and neutrino-related physics. The concept remains experimentally challenging, but gas time projection chambers are an increasingly attractive option, and when properly configured, would allow directional measurements of both nuclear and electron recoils. In this review, we reassess the required detector performance and survey relevant technologies. Fortuitously, the highly-segmented detectors required to achieve good directionality also enable several fundamental and applied physics measurements. We comment on near-term challenges and how the field could be advanced.


title: Optomechanical interface between telecom photons and spin quantum memory

abstract: Quantum networks enable a broad range of practical and fundamental applications spanning distributed quantum computing to sensing and metrology. A cornerstone of such networks is an interface between telecom photons and quantum memories. Here we demonstrate a novel approach based on cavity optomechanics that utilizes the susceptibility of spin qubits to strain. We use it to control electron spins of nitrogen-vacancy centers in diamond with photons in the 1550 nm telecommunications wavelength band. This method does not involve qubit optical transitions and is insensitive to spectral diffusion. Furthermore, our approach can be applied to solid-state qubits in a wide variety of materials, expanding the toolbox for quantum information processing.


title: Isolated subgroups of finite abelian groups

abstract: We say that a subgroup $H$ is isolated in a group $G$ if for every $x\in G$ we have either $x\in H$ or $\langle x\rangle\cap H=1$. In this short note, we describe the set of isolated subgroups of a finite abelian group. The technique used is based on an interesting connection between isolated subgroups and the function sum of element orders of a finite group.


title: On the Minimax Spherical Designs

abstract: Distributing points on a (possibly high-dimensional) sphere with minimal energy is a long-standing problem in and outside the field of mathematics. This paper considers a novel energy function that arises naturally from statistics and combinatorial optimization, and studies its theoretical properties. Our result solves both the exact optimal spherical point configurations in certain cases and the minimal energy asymptotics under general assumptions. Connections between our results and the L1-Principal Component analysis and Quasi-Monte Carlo methods are also discussed.


title: Graph Energy-based Model for Substructure Preserving Molecular Design

abstract: It is common practice for chemists to search chemical databases based on substructures of compounds for finding molecules with desired properties. The purpose of de novo molecular generation is to generate instead of search. Existing machine learning based molecular design methods have no or limited ability in generating novel molecules that preserves a target substructure. Our Graph Energy-based Model, or GEM, can fix substructures and generate the rest. The experimental results show that the GEMs trained from chemistry datasets successfully generate novel molecules while preserving the target substructures. This method would provide a new way of incorporating the domain knowledge of chemists in molecular design.


title: Supernova Constraint on Self-Interacting Dark Sector Particles

abstract: We examine the constraints on sub-GeV dark sector particles set by the proto-neutron star cooling associated with the core-collapse supernova event SN1987a. Considering explicitly a dark photon portal dark sector model, we compute the relevant interaction rates of dark photon ($A'$) and dark fermion ($\chi$) with the Standard Model particles as well as their self-interaction inside the dark sector. We find that even with a small dark sector fine structure constant $\alpha_D\ll 1$, dark sector self-interactions can easily lead to their own self-trapping. This effect strongly limits the energy luminosity carried away by dark sector particles from the supernova core and thus drastically affects the parameter space that can be constrained by SN1987a. We consider specifically two mass ratios $m_{A'}=3m_\chi$ and $3m_{A'}=m_\chi$ which represent scenarios where the decay of $A'$ to $\chi\bar\chi$ is allowed or not. We show that SN1987a can only place bounds on the dark sector when $\alpha_D\lesssim 10^{-15}$ ($10^{-7}$) for the former (latter) for $m_\chi\lesssim 20$ MeV. Furthermore, this evades the supernova bounds on the widely-examined dark photon parameter space completely if $\alpha_D\lesssim 10^{-7}$ for the former, while lifts the bounds when $\alpha_D\lesssim 10^{-7}$ if $m_\chi\lesssim 100$ MeV. Our findings thus imply that the existing supernova bounds on light dark particles can be generally evaded by a similar self-trapping mechanism. This also implies that non-standard strongly self-interacting neutrino is not consistent with the SN1987a observation. Same effects can also take place for other known stellar bounds on dark sector particles.


title: A characterization of spaces of homogeneous type induced by continuous ellipsoid covers of $\mathbb R^n$

abstract: We study the relationship between the concept of a continuous ellipsoid $\Theta$ cover of $\mathbb{R}^n$, which was introduced by Dahmen, Dekel, and Petrushev, and the space of homogeneous type induced by $\Theta$. We characterize the class of quasi-distances on $\mathbb{R}^n$ (up to equivalence) which correspond to continuous ellipsoid covers. This places firmly continuous ellipsoid covers as a subclass of spaces of homogeneous type on $\mathbb{R}^n$ satisfying quasi-convexity and $1$-Ahlfors-regularity.


title: Charged torus-like black holes as heat engines

abstract: We investigate the thermodynamical properties of charged torus-like black holes and take it as the working substance to study the heat engines. In the extended phase space, by interpreting the cosmological constant as the thermodynamic pressure, we derive the thermodynamical quantities by the first law of black hole thermodynamics and obtain the equation of state. Then, we calculate the efficiency of the heat engine in Carnot cycle as well as rectangular cycle, and investigate how the efficiency changes with respect to volume. In addition, to avoid a negative temperature, we emphasize that the charge of this black hole can not be arbitrary. Last, we check the calculation accuracy of a benchmark scheme and discuss the upper bound and lower bound for charged torus-like black hole in the scheme.


title: SwiftNet: Real-time Video Object Segmentation

abstract: In this work we present SwiftNet for real-time semisupervised video object segmentation (one-shot VOS), which reports 77.8% J &F and 70 FPS on DAVIS 2017 validation dataset, leading all present solutions in overall accuracy and speed performance. We achieve this by elaborately compressing spatiotemporal redundancy in matching-based VOS via Pixel-Adaptive Memory (PAM). Temporally, PAM adaptively triggers memory updates on frames where objects display noteworthy inter-frame variations. Spatially, PAM selectively performs memory update and match on dynamic pixels while ignoring the static ones, significantly reducing redundant computations wasted on segmentation-irrelevant pixels. To promote efficient reference encoding, light-aggregation encoder is also introduced in SwiftNet deploying reversed sub-pixel. We hope SwiftNet could set a strong and efficient baseline for real-time VOS and facilitate its application in mobile vision. The source code of SwiftNet can be found at https://github.com/haochenheheda/SwiftNet.


title: On-disk solar coronal condensations facilitated by magnetic reconnection between open and closed magnetic structures

abstract: Coronal condensation and rain are a crucial part of the mass cycle between the corona and chromosphere. In some cases, condensation and subsequent rain originate in the magnetic dips formed during magnetic reconnection. This provides a new and alternative formation mechanism for coronal rain. Until now, only off-limb, rather than on-disk, condensation events during reconnection have been reported. In this paper, employing extreme-ultraviolet (EUV) images of the Solar Terrestrial Relations Observatory (STEREO) and Solar Dynamics Observatory (SDO), we investigate the condensations facilitated by reconnection from 2011 July 14 to 15, when STEREO was in quadrature with respect to the Sun-Earth line. Above the limb, in STEREO/EUV Imager (EUVI) 171 \AA~images, higher-lying open structures move downward, reconnect with the lower-lying closed loops, and form dips. Two sets of newly reconnected structures then form. In the dips, bright condensations occur in EUVI 304 \AA~images repeatedly which then flow downward to the surface. In the on-disk observations by SDO/Atmospheric Imaging Assembly (AIA) in the 171 \AA~channel, these magnetic structures are difficult to identify. Dark condensations appear in AIA 304 \AA~images, and then move to the surface as on-disk coronal rain. The cooling and condensation of coronal plasma is revealed by the EUV light curves. If only the on-disk observations would be available, the relation between the condensations and reconnection, shown clearly by the off-limb observations, would not be identified. Thus, we suggest that some on-disk condensation events seen in transition region and chromospheric lines may be facilitated by reconnection.


title: Diversity + Inclusion at Belle II: Where We Are, What We've Done and Where We Want To Be

abstract: The Belle II Collaboration comprises over 1000 international high energy physicists, who investigate the properties of $b$-quarks and other particles at the luminosity frontier. In order to achieve our aim of a successful physics program, it is essential that we emphasise contributions from a diverse community. Belle II has thus far focused on diversity in gender and sexuality, among other efforts within our collaboration. These efforts are led by our two Diversity Officers, elected to the newly created positions in 2018. Their role has been to promote an inclusive atmosphere, raising awareness of diversity and being a safe first point of call for issues of discrimination and harassment. These proceedings accompany the short talk delivered during ICHEP 2020, marking the first conference the Belle II Collaboration has presented in the diversity and inclusion stream. It details the efforts described above, as well as examining the evolving gender demographics of our community, since membership began in 2011.

categories: physics.ed-ph hep-ex hep-ph physics.soc-ph


title: Control of superexchange interactions with DC electric fields

abstract: We discuss DC electric-field controls of superexchange interactions. We first present generic results about antiferromagnetic and ferromagnetic superexchange interactions valid in a broad class of Mott insulators, where we also estimate typical field strength to observe DC electric-field effects: $\sim 1~\mathrm{MV/cm}$ for inorganic Mott insulators such as transition-metal oxides and $\sim 0.1~\mathrm{MV/cm}$ for organic ones. Next, we apply these results to geometrically frustrated quantum spin systems. Our theory widely applies to (quasi-)two-dimensional and thin-film systems and one-dimensional quantum spin systems on various lattices such as square, honeycomb, triangular, and kagome ones. In this paper, we give our attention to those on the square lattice and on the chain. For the square lattice, we show that DC electric fields can control a ratio of the nearest-neighbor and next-nearest-neighbor exchange interactions. In some realistic cases, DC electric fields make the two next-nearest-neighbor interactions nonequivalent and eventually turns the square-lattice quantum spin system into a deformed triangular-lattice one. For the chain, DC electric fields can induce singlet-dimer and Haldane-dimer orders. We show that the DC electric-field-induced spin gap $\propto |\boldsymbol E|^{2/3}$ in the Heisenberg antiferromagnetic chain will reach $\sim 10~\%$ of the dominant superexchange interaction in the case of a spin-chain compound $\mathrm{KCuMoO_4(OH)}$ when the DC electric field of $\sim 1~\mathrm{MV/cm}$ is applied.


title: Certifying dimension of quantum systems by sequential projective measurements

abstract: This work analyzes correlations arising from quantum systems subject to sequential projective measurements to certify that the system in question has a quantum dimension greater than some $d$. We refine previous known methods and show that dimension greater than two can be certified in scenarios which are considerably simpler than the ones presented before and, for the first time in this sequential projective scenario, we certify quantum systems with dimension strictly greater than three. We also perform a systematic numerical analysis in terms of robustness and conclude that performing random projective measurements on random pure qutrit states allows a robust certification of quantum dimensions with very high probability.


title: Nonequilibrium dynamics in deconfined quantum critical point revealed by imaginary-time evolution

abstract: As proposed to describe putative continuous phase transitions between two ordered phases, the deconfined quantum critical point (DQCP) goes beyond the prevalent Landau-Ginzburg-Wilson (LGW) paradigm since its critical theory is not expressed in terms of the order parameters characterizing either state, but involves fractionalized degrees of freedom and an emergent symmetry. So far, great efforts have been spent on its equilibrium properties, but the nonequilibrium properties therein are largely unknown. Here we study the nonequilibrium dynamics of the DQCP via the imaginary-time evolution in the two-dimensional (2D) J-Q$_3$ model. We discover fascinating nonequilibrium scaling behaviors hinging on the process of fractionization and the dynamics of emergent symmetry associated with two length scales. Our findings not only constitute a new realm of nonequilibrium criticality in DQCP, but also offer a controllable knob by which to investigate the dynamics in strongly correlated systems.


title: Joint Intent Detection and Slot Filling with Wheel-Graph Attention Networks

abstract: Intent detection and slot filling are two fundamental tasks for building a spoken language understanding (SLU) system. Multiple deep learning-based joint models have demonstrated excellent results on the two tasks. In this paper, we propose a new joint model with a wheel-graph attention network (Wheel-GAT) which is able to model interrelated connections directly for intent detection and slot filling. To construct a graph structure for utterances, we create intent nodes, slot nodes, and directed edges. Intent nodes can provide utterance-level semantic information for slot filling, while slot nodes can also provide local keyword information for intent. Experiments show that our model outperforms multiple baselines on two public datasets. Besides, we also demonstrate that using Bidirectional Encoder Representation from Transformer (BERT) model further boosts the performance in the SLU task.


title: Eigenvalues for the Clamped Plate Problem of $\mathfrak{L}^{2}_{\nu}$ Operator on Complete Riemannian manifolds

abstract: $\mathfrak{L}_{\nu}$ operator is an important extrinsic differential operator of divergence type and has profound geometric settings. In this paper, we consider the clamped plate problem of $\mathfrak{L}^{2}_{\nu}$ operator on a bounded domain of the complete Riemannian manifolds. A general formula of eigenvalues of $\mathfrak{L}^{2}_{\nu}$ operator is established. Applying this general formula, we obtain some estimates for the eigenvalues with higer order on the complete Riemannian manifolds. As several fascinating applications, we discuss this eigenvalue problem on the complete translating solitons, minimal submanifolds on the Euclidean space, submanifolds on the unit sphere and projective spaces. In particular, we get a universal inequality with respect to the $\mathcal{L}_{II}$ operator on the translating solitons. Usually, it is very difficult to get universal inequalities for weighted Laplacian and even Laplacian on the complete Riemannian manifolds. Therefore, this work can be viewed as a new contribution to universal inequality.


title: Successive destruction of charge density wave states by pressure in LaAgSb$_2$

abstract: We comprehensively studied the magnetotransport properties of LaAgSb$_2$ under high pressure up to 4 GPa, which showed unique successive charge density wave (CDW) transitions at $T_{CDW1}\sim 210$ K and $T_{CDW2}\sim 190$ K at ambient pressure. With the application of pressure, both $T_{CDW1}$ and $T_{CDW2}$ were suppressed and disappeared at the critical pressures of $P_{CDW1}=3.0$--3.4 GPa and $P_{CDW2}=1.5$--1.9 GPa, respectively. At $P_{CDW1}$, the Hall conductivity showed a step-like increase, which is consistently understood by the emergence of two-dimensional hollow Fermi surface at $P_{CDW1}$. We also observed a significant negative magnetoresistance effect when the magnetic field and current were applied parallel to the $c$ axis. Shubnikov--de Haas (SdH) oscillation measurements under pressure directly showed the changes in the Fermi surface across the CDW phase boundaries. In $P<P_{CDW2}$, three major oscillation components, $\alpha$, $\beta$, and $\gamma$, were identified, whose frequencies were increased by application of pressure. The increment rate of these frequencies was considerably larger than that expected from the shrinkage of lattice constant, indicating the unignorable band modification under pressure. In the normal metallic phase above $P>P_{CDW1}$, we observed a single frequency of $\sim 48$ T with a cyclotron effective mass of 0.066 $m_0$, whose cross section in the reciprocal space corresponded to only 0.22\% of the first Brillouin zone. Besides, we observed another oscillation component with frequency of $\sim 9.2$ T, which is significantly enhanced in the limited pressure range of $P_{CDW2}<P<P_{CDW1}$. The amplitude of this oscillation was anomalously suppressed in the high-field and low-temperature region, which cannot be explained by the conventional Lifshitz--Kosevich formula.


title: A New Framework for Variance-Reduced Hamiltonian Monte Carlo

abstract: We propose a new framework of variance-reduced Hamiltonian Monte Carlo (HMC) methods for sampling from an $L$-smooth and $m$-strongly log-concave distribution, based on a unified formulation of biased and unbiased variance reduction methods. We study the convergence properties for HMC with gradient estimators which satisfy the Mean-Squared-Error-Bias (MSEB) property. We show that the unbiased gradient estimators, including SAGA and SVRG, based HMC methods achieve highest gradient efficiency with small batch size under high precision regime, and require $\tilde{O}(N + \kappa^2 d^{\frac{1}{2}} \varepsilon^{-1} + N^{\frac{2}{3}} \kappa^{\frac{4}{3}} d^{\frac{1}{3}} \varepsilon^{-\frac{2}{3}} )$ gradient complexity to achieve $\epsilon$-accuracy in 2-Wasserstein distance. Moreover, our HMC methods with biased gradient estimators, such as SARAH and SARGE, require $\tilde{O}(N+\sqrt{N} \kappa^2 d^{\frac{1}{2}} \varepsilon^{-1})$ gradient complexity, which has the same dependency on condition number $\kappa$ and dimension $d$ as full gradient method, but improves the dependency of sample size $N$ for a factor of $N^\frac{1}{2}$. Experimental results on both synthetic and real-world benchmark data show that our new framework significantly outperforms the full gradient and stochastic gradient HMC approaches. The earliest version of this paper was submitted to ICML 2020 with three weak accept but was not finally accepted.


title: Antineutrino Energy Spectrum Unfolding Based on the Daya Bay Measurement and Its Applications

abstract: The prediction of reactor antineutrino spectra will play a crucial role as reactor experiments enter the precision era. The positron energy spectrum of 3.5 million antineutrino inverse beta decay reactions observed by the Daya Bay experiment, in combination with the fission rates of fissile isotopes in the reactor, is used to extract the positron energy spectra resulting from the fission of specific isotopes. This information can be used to produce a precise, data-based prediction of the antineutrino energy spectrum in other reactor antineutrino experiments with different fission fractions than Daya Bay. The positron energy spectra are unfolded to obtain the antineutrino energy spectra by removing the contribution from detector response with the Wiener-SVD unfolding method. Consistent results are obtained with other unfolding methods. A technique to construct a data-based prediction of the reactor antineutrino energy spectrum is proposed and investigated. Given the reactor fission fractions, the technique can predict the energy spectrum to a 2% precision. In addition, we illustrate how to perform a rigorous comparison between the unfolded antineutrino spectrum and a theoretical model prediction that avoids the input model bias of the unfolding method.


title: Benford's law: what does it say on adversarial images?

abstract: Convolutional neural networks (CNNs) are fragile to small perturbations in the input images. These networks are thus prone to malicious attacks that perturb the inputs to force a misclassification. Such slightly manipulated images aimed at deceiving the classifier are known as adversarial images. In this work, we investigate statistical differences between natural images and adversarial ones. More precisely, we show that employing a proper image transformation and for a class of adversarial attacks, the distribution of the leading digit of the pixels in adversarial images deviates from Benford's law. The stronger the attack, the more distant the resulting distribution is from Benford's law. Our analysis provides a detailed investigation of this new approach that can serve as a basis for alternative adversarial example detection methods that do not need to modify the original CNN classifier neither work on the raw high-dimensional pixels as features to defend against attacks.


title: The Boundary-Spanning Mechanisms of Nobel Prize Winning Papers

abstract: The breakthrough potentials of research papers can be explained by their boundary-spanning qualities. Here, for the first time, we apply the structural variation analysis (SVA) model and its affiliated metrics to investigate the extent to which such qualities characterize a group of Nobel Prize winning papers. We find that these papers share remarkable boundary-spanning traits, marked by exceptional abilities to connect disparate and topically-diverse clusters of research papers. Further, their publications exert structural variations on the scale that significantly alters the betweenness centrality distributions of existing intellectual space. Overall, SVA not only provides a set of leading indicators for describing future Nobel Prize winning papers, but also broadens our understanding of the similar prize-winning properties that may have been overlooked among other regular publications.


title: Minimal scenario of Criticality for Electroweak scale, Neutrino Masses, Dark Matter, and Inflation

abstract: We propose a minimal model that can explain the electroweak scale, neutrino masses, Dark Matter (DM), and successful inflation all at once based on the multicritical-point principle (MPP). The model has two singlet scalar fields that realize an analogue of the Coleman-Weinberg mechanism, in addition to the Standard Model with heavy Majorana right-handed neutrinos. By assuming a $Z_2 $ symmetry, one of the scalars becomes a DM candidate whose property is almost the same as the minimal Higgs-portal scalar DM. In this model, the MPP can naturally realize a saddle point in the Higgs potential at high energy scales. By the renormalization-group analysis, we study the critical Higgs inflation with non-minimal coupling $\xi |H|^2 R$ that utilizes the saddle point of the Higgs potential. We find that it is possible to realize successful inflation even for $\xi=25$ and that the heaviest right-handed neutrino is predicted to have a mass around $10^{14}$ GeV to meet the current cosmological observations. Such a small value of $\xi$ can be realized by the Higgs-portal coupling $\lambda_{SH}\simeq 0.32$ and the vacuum expectation value of the additional neutral scalar $\langle\phi\rangle\simeq 2.7$ TeV, which correspond to the dark matter mass 2.0 TeV, its spin-independent cross section $1.8\times10^{-9}$ pb, and the mass of additional neutral scalar 190 GeV.


title: Optimal singularities of initial data for solvability of the Hardy parabolic equation

abstract: We consider the Cauchy problem for the Hardy parabolic equation $\partial_t u-\Delta u=|x|^{-\gamma}u^p$ with initial data $u_0$ singular at some point $z$. Our main results show that, if $z\neq 0$, then the optimal strength of the singularity of $u_0$ at $z$ for the solvability of the equation is the same as that of the Fujita equation $\partial_t u-\Delta u=u^p$. Moreover, if $z=0$, then the optimal singularity for the Hardy parabolic equation is weaker than that of the Fujita equation. We also obtain analogous results for a fractional case $\partial_t u+(-\Delta)^{\theta/2} u=|x|^{-\gamma}u^p$ with $0<\theta<2$.


title: An Ultra-High Time Resolution Cosmic Ray Detection Mode for the Murchison Widefield Array

abstract: The radio-wavelength detection of extensive air showers (EAS) initiated by cosmic-ray interactions in the Earth's atmosphere is a promising technique for investigating the origin of these particles and the physics of their interactions. The Low Frequency Array (LOFAR) and the Owens Valley Long Wavelength Array (OVRO-LWA) have both demonstrated that the dense cores of low frequency radio telescope arrays yield detailed information on the radiation ground pattern, which can be used to reconstruct key EAS properties and infer the primary cosmic-ray composition. Here, we demonstrate a new observation mode of the Murchison Widefield Array (MWA), tailored to the observation of the sub-microsecond coherent bursts of radiation produced by EAS. We first show how an aggregate 30.72 MHz bandwidth (3072x 10 kHz frequency channels) recorded at 0.1 ms resolution with the MWA's voltage capture system (VCS) can be synthesised back to the full bandwidth Nyquist resolution of 16.3 ns. This process, which involves `inverting' two sets of polyphase filterbanks, retains 90.5% of the signal-to-noise of a cosmic ray signal. We then demonstrate the timing and positional accuracy of this mode by resolving the location of a calibrator pulse to within 5 m. Finally, preliminary observations show that the rate of nanosecond radio-frequency interference (RFI) events is 0.1 Hz, much lower than that found at the sites of other radio telescopes that study cosmic rays. We conclude that the identification of cosmic rays at the MWA, and hence with the low-frequency component of the Square Kilometre Array, is feasible with minimal loss of efficiency due to RFI.


title: How does the Polar Dust affect the Correlation between Dust Covering Factor and Eddington Ratio in Type 1 Quasars Selected from the Sloan Digital Sky Survey Data Release 16?

abstract: We revisit the dependence of covering factor (CF) of dust torus on physical properties of active galactic nuclei (AGNs) by taking into account an AGN polar dust emission. The CF is converted from a ratio of infrared (IR) luminosity contributed from AGN dust torus ($L_{\rm IR}^{\rm torus}$) and AGN bolometric luminosity ($L_{\rm bol}$), by assuming a non-linear relation between luminosity ratio and intrinsic CF. We select 37,181 type 1 quasars at $z < 0.7$ from the Sloan Digital Sky Survey Data Release 16 quasar catalog. Their $L_{\rm bol}$, black hole mass ($M_{\rm BH}$), and Eddington ratio ($\lambda_{\rm Edd}$) are derived by spectral fitting with QSFit. We conduct spectral energy distribution decomposition by using X-CIGALE with clumpy torus and polar dust model to estimate $L_{\rm IR}^{\rm torus}$ without being affected by the contribution of stellar and AGN polar dust to IR emission. For 5720 quasars whose physical quantities are securely determined, we perform a correlation analysis on CF and (i) $L_{\rm bol}$, (ii) $M_{\rm BH}$, and (iii) $\lambda_{\rm Edd}$. As a result, anti-correlations for CF-$L_{\rm bol}$, CF-$M_{\rm BH}$, and CF-$\lambda_{\rm Edd}$ are confirmed. We find that incorporating the AGN polar dust emission makes those anti-correlations stronger which are compared to those without considering it. This indicates that polar dust wind provably driven by AGN radiative pressure is one of the key components to regulate obscuring material of AGNs.


title: TraND: Transferable Neighborhood Discovery for Unsupervised Cross-domain Gait Recognition

abstract: Gait, i.e., the movement pattern of human limbs during locomotion, is a promising biometric for the identification of persons. Despite significant improvement in gait recognition with deep learning, existing studies still neglect a more practical but challenging scenario -- unsupervised cross-domain gait recognition which aims to learn a model on a labeled dataset then adapts it to an unlabeled dataset. Due to the domain shift and class gap, directly applying a model trained on one source dataset to other target datasets usually obtains very poor results. Therefore, this paper proposes a Transferable Neighborhood Discovery (TraND) framework to bridge the domain gap for unsupervised cross-domain gait recognition. To learn effective prior knowledge for gait representation, we first adopt a backbone network pre-trained on the labeled source data in a supervised manner. Then we design an end-to-end trainable approach to automatically discover the confident neighborhoods of unlabeled samples in the latent space. During training, the class consistency indicator is adopted to select confident neighborhoods of samples based on their entropy measurements. Moreover, we explore a high-entropy-first neighbor selection strategy, which can effectively transfer prior knowledge to the target domain. Our method achieves state-of-the-art results on two public datasets, i.e., CASIA-B and OU-LP.


title: The New Charm-Strange Resonances in the D^- K^+ Channel

abstract: We evaluate the masses and decay constants of the $0^+$ and $1^-$ open-charm $(\bar{c}\bar{d})(us)$ tetraquarks and molecular states from QCD spectral sum rules (QSSR) by using QCD Laplace sum rule (LSR). This method takes into account the stability criteria where the factorized perturbative NLO corrections and the contributions of quark and gluon condensates up to dimension-6 in the OPE are included. We confront our results with the $D^- K^+$ invariant mass recently reported by LHCb from $B^+ \to D^+(D^- K^+)$ decays. We expect that the resonance near the $D^- K^+$ threshold can be originated from the $0^{+}(D^-K^+)$ molecule and/or $D^- K^+$ scattering. The $X_0(2900)$ scalar state and the resonance $X_J(3150)$ (if $J = 0$) can emerge from a minimal mixing model, with a tiny mixing angle $\theta_0 \simeq (5.2 \pm 1.9)^0$, between a scalar Tetramole $({\cal T}_{\!\!{\cal M}0})$ (superposition of nearly degenerated hypothetical molecules and compact tetraquarks states with the same quantum numbers), having a mass $M_{{\cal T}_{\!\!{\cal M}0}} = 2743(18)$ MeV, and the first radial excitation of the $D^- K^+$ molecule with mass $M_{(DK)_1} = 3678(310)$ MeV. In an analogous way, the $X_1(2900)$ and the $X_J(3350)$ (if $J = 1$) could be a mixture between the vector Tetramole $({\cal T}_{\!\!{\cal M}1})$, with a mass $M_{{\cal T}_{\!\!{\cal M}1}} = 2656(20)$ MeV, and its first radial excitation having a mass $M_{{\cal T}_{\!\!{\cal M}1}} = 4592(141)$ MeV with an angle $\theta_0 \simeq (9.1 \pm 0.6)^0$. A (non)-confirmation of these statements requires experimental findings of the quantum numbers of the resonances at $3150$ and $3350$ MeV.


title: On connection between perturbation theory and semiclassical expansion in quantum mechanics

abstract: It is shown that for the one-dimensional anharmonic oscillator with potential $V(x)= a x^2 + b g x^3 +\ldots=\frac{1}{g^2}\,\hat{V}(gx)$, as well as for the radial oscillator $V(r)=\frac{1}{g^2}\,\hat{V}(gr)$ and for the perturbed Coulomb problem $V(r)=\frac{\alpha}{r}+ \beta g r + \ldots = g\,\tilde{V}(gr)$, the Perturbation Theory in powers of the coupling constant $g$ (weak coupling regime) and the semiclassical expansion in powers of $\hbar^{1/2}$ for the energies coincide. This is related to the fact that the dynamics developed in two spaces: $x\ (r)$-space and $gx\ (gr)$-space, lead to the same energy spectra. The equations which govern dynamics in these two spaces, the Riccati-Bloch equation and the Generalized Bloch equation, respectively, are presented. It is shown that the perturbation theory for the logarithmic derivative of the wavefunction in $gx\ (gr)$- space leads to (true) semiclassical expansion in powers of $\hbar^{1/2}$; for the one-dimensional case this corresponds to the flucton calculus for the density matrix in the path integral formalism in Euclidean (imaginary) time proposed by one of the authors, Shuryak(1988). Matching the perturbation theory in powers of $g$ and the semiclassical expansion in powers of $\hbar^{1/2}$ for the wavefunction leads to a highly accurate local approximation in the entire coordinate space, its expectation value for the Hamiltonian provides a prescription for the summation of the perturbative (trans)-series.


title: Nevanlinna Pair and Algebraic Hyperbolicity

abstract: We introduce the notion of the $\textit{Nevanlinna pair}$ for a pair $(X, D)$, where $X$ is a projective variety and $D$ is an effective Cartier divisor on $X$. This notion links and unifies the Nevanlinna theory, the complex hyperbolicity (Brody and Kobayashi hyperbolicity), the big Picard type extension theorem (more generally the Borel hyperbolicity), as well as the algebraic hyperbolicity. The key is to use the Nevanlinna theory on parabolic Riemann surfaces recently developed by P\v{a}un and Sibony.


title: WheaCha: A Method for Explaining the Predictions of Models of Code

abstract: Attribution methods have emerged as a popular approach to interpreting model predictions based on the relevance of input features. Although the feature importance ranking can provide insights of how models arrive at a prediction from a raw input, they do not give a clear-cut definition of the key features models use for the prediction. In this paper, we present a new method, called WheaCha, for explaining the predictions of code models. Although WheaCha employs the same mechanism of tracing model predictions back to the input features, it differs from all existing attribution methods in crucial ways. Specifically, WheaCha divides an input program into "wheat" (i.e., the defining features that are the reason for which models predict the label that they predict) and the rest "chaff" for any prediction of a learned code model. We realize WheaCha in a tool, HuoYan, and use it to explain four prominent code models: code2vec, seq-GNN, GGNN, and CodeBERT. Results show (1) HuoYan is efficient - taking on average under twenty seconds to compute the wheat for an input program in an end-to-end fashion (i.e., including model prediction time); (2) the wheat that all models use to predict input programs is made of simple syntactic or even lexical properties (i.e., identifier names); (3) Based on wheat, we present a novel approach to explaining the predictions of code models through the lens of training data.


title: Physics-informed neural networks with hard constraints for inverse design

abstract: Inverse design arises in a variety of areas in engineering such as acoustic, mechanics, thermal/electronic transport, electromagnetism, and optics. Topology optimization is a major form of inverse design, where we optimize a designed geometry to achieve targeted properties and the geometry is parameterized by a density function. This optimization is challenging, because it has a very high dimensionality and is usually constrained by partial differential equations (PDEs) and additional inequalities. Here, we propose a new deep learning method -- physics-informed neural networks with hard constraints (hPINNs) -- for solving topology optimization. hPINN leverages the recent development of PINNs for solving PDEs, and thus does not rely on any numerical PDE solver. However, all the constraints in PINNs are soft constraints, and hence we impose hard constraints by using the penalty method and the augmented Lagrangian method. We demonstrate the effectiveness of hPINN for a holography problem in optics and a fluid problem of Stokes flow. We achieve the same objective as conventional PDE-constrained optimization methods based on adjoint methods and numerical PDE solvers, but find that the design obtained from hPINN is often simpler and smoother for problems whose solution is not unique. Moreover, the implementation of inverse design with hPINN can be easier than that of conventional methods.


title: SCARLET: Explainable Attention based Graph Neural Network for Fake News spreader prediction

abstract: False information and true information fact checking it, often co-exist in social networks, each competing to influence people in their spread paths. An efficient strategy here to contain false information is to proactively identify if nodes in the spread path are likely to endorse false information (i.e. further spread it) or refutation information (thereby help contain false information spreading). In this paper, we propose SCARLET (truSt and Credibility bAsed gRaph neuraL nEtwork model using aTtention) to predict likely action of nodes in the spread path. We aggregate trust and credibility features from a node's neighborhood using historical behavioral data and network structure and explain how features of a spreader's neighborhood vary. Using real world Twitter datasets, we show that the model is able to predict false information spreaders with an accuracy of over 87%.


title: Steady-state joint distribution for first-order stochastic reaction kinetics

abstract: While the analytical solution for the marginal distribution of a stochastic chemical reaction network has been extensively studied, its joint distribution, i.e. the solution of a high-dimensional chemical master equation, has received much less attention. Here we develop a novel method of computing the exact joint distributions of a wide class of first-order stochastic reaction systems in steady-state conditions. The effectiveness of our method is validated by applying it to four gene expression models of biological significance, including models with 2A peptides, nascent mRNA, gene regulation, translational bursting, and alternative splicing.


title: Real-time Monaural Speech Enhancement With Short-time Discrete Cosine Transform

abstract: Speech enhancement algorithms based on deep learning have been improved in terms of speech intelligibility and perceptual quality greatly. Many methods focus on enhancing the amplitude spectrum while reconstructing speech using the mixture phase. Since the clean phase is very important and difficult to predict, the performance of these methods will be limited. Some researchers attempted to estimate the phase spectrum directly or indirectly, but the effect is not ideal. Recently, some studies proposed the complex-valued model and achieved state-of-the-art performance, such as deep complex convolution recurrent network (DCCRN). However, the computation of the model is huge. To reduce the complexity and further improve the performance, we propose a novel method using discrete cosine transform as the input in this paper, called deep cosine transform convolutional recurrent network (DCTCRN). Experimental results show that DCTCRN achieves state-of-the-art performance both on objective and subjective metrics. Compared with noisy mixtures, the mean opinion score (MOS) increased by 0.46 (2.86 to 3.32) absolute processed by the proposed model with only 2.86M parameters.


title: A quantitative rigidity result for a two-dimensional Frenkel-Kontorova model

abstract: We consider a Frenkel-Kontorova system of harmonic oscillators in a two-dimensional Euclidean lattice and we obtain a quantitative estimate on the angular function of the equilibria. The proof relies on a PDE method related to a classical conjecture by E. De Giorgi, also in view of an elegant technique based on complex variables that was introduced by A. Farina. In the discrete setting, a careful analysis of the reminders is needed to exploit this type of methodologies inspired by continuum models.


title: Stability for an inverse source problem of the biharmonic operator

abstract: In this paper, we study for the first time the stability of the inverse source problem for the biharmonic operator with a compactly supported potential in $\mathbb R^3$. Firstly, to connect the boundary data with the unknown source, we shall consider an eigenvalue problem for the bi-Schr$\ddot{\rm o}$dinger operator $\Delta^2 + V(x)$ on a ball which contains the support of the potential $V$. We prove a Weyl-type law for the upper bounds of spherical normal derivatives of both the eigenfunctions $\phi$ and their Laplacian $\Delta\phi$ corresponding to the bi-Schr$\ddot{\rm o}$dinger operator. This type of upper bounds was proved by Hassell and Tao for the Schr$\ddot{\rm o}$dinger operator. Secondly, we investigate the meromorphic continuation of the resolvent of the bi-Schr$\ddot{\rm o}$dinger operator and prove the existence of a resonance-free region and an estimate of $L^2_{\rm comp} - L^2_{\rm loc}$ type for the resolvent. As an application, we prove a bound of the analytic continuation of the data from the given data to the higher frequency data. Finally, we derive the stability estimate which consists of the Lipschitz type data discrepancy and the high frequency tail of the source function, where the latter decreases as the upper bound of the frequency increases.


title: Statistically Profiling Biases in Natural Language Reasoning Datasets and Models

abstract: Recent work has indicated that many natural language understanding and reasoning datasets contain statistical cues that may be taken advantaged of by NLP models whose capability may thus be grossly overestimated. To discover the potential weakness in the models, some human-designed stress tests have been proposed but they are expensive to create and do not generalize to arbitrary models. We propose a light-weight and general statistical profiling framework, ICQ (I-See-Cue), which automatically identifies possible biases in any multiple-choice NLU datasets without the need to create any additional test cases, and further evaluates through blackbox testing the extent to which models may exploit these biases.


title: $k$-Equivalence Relations and Associated Algorithms

abstract: Lines and circles pose significant scalability challenges in synthetic geometry. A line with $n$ points implies ${n \choose 3}$ collinearity atoms, or alternatively, when lines are represented as functions, equality among ${n \choose 2}$ different lines. Similarly, a circle with $n$ points implies ${n \choose 4}$ cocyclicity atoms or equality among ${n \choose 3}$ circumcircles. We introduce a new mathematical concept of $k$-equivalence relations, which generalizes equality ($k=1$) and includes both lines ($k=2$) and circles ($k=3$), and present an efficient proof-producing procedure to compute the closure of a $k$-equivalence relation.


title: Naive liftings of DG modules

abstract: Let n be a positive integer, and let A be a strongly commutative differential graded (DG) algebra over a commutative ring R. Assume that (a) B=A[X_1,...,X_n] is a polynomial extension of A, where X_1,...,X_n are variables of positive degrees; or (b) A is a divided power DG R-algebra and B=A<X_1,...,X_n> is a free extension of A obtained by adjunction of variables X_1,...,X_n of positive degrees. In this paper, we study naive liftability of DG modules along the natural injection A-->B using the notions of diagonal ideals and homotopy limits. We prove that if N is a bounded below semifree DG B-module such that Ext_B^i(N, N)=0 for all i>0, then N is naively liftable to A. This implies that N is a direct summand of a DG B-module that is liftable to A. Also, the relation between naive liftability of DG modules and the Auslander-Reiten Conjecture has been described.


title: Federated Deep AUC Maximization for Heterogeneous Data with a Constant Communication Complexity

abstract: Deep AUC (area under the ROC curve) Maximization (DAM) has attracted much attention recently due to its great potential for imbalanced data classification. However, the research on Federated Deep AUC Maximization (FDAM) is still limited. Compared with standard federated learning (FL) approaches that focus on decomposable minimization objectives, FDAM is more complicated due to its minimization objective is non-decomposable over individual examples. In this paper, we propose improved FDAM algorithms for heterogeneous data by solving the popular non-convex strongly-concave min-max formulation of DAM in a distributed fashion, which can also be applied to a class of non-convex strongly-concave min-max problems. A striking result of this paper is that the communication complexity of the proposed algorithm is a constant independent of the number of machines and also independent of the accuracy level, which improves an existing result by orders of magnitude. The experiments have demonstrated the effectiveness of our FDAM algorithm on benchmark datasets, and on medical chest X-ray images from different organizations. Our experiment shows that the performance of FDAM using data from multiple hospitals can improve the AUC score on testing data from a single hospital for detecting life-threatening diseases based on chest radiographs. The proposed method is implemented in our open-sourced library LibAUC (www.libauc.org) whose github address is https://github.com/Optimization-AI/ICML2021_FedDeepAUC_CODASCA.


title: Extensive Benchmarking of DFT+U Calculations for Predicting Band Gaps

abstract: Accurate computational predictions of band gaps are of practical importance to the modeling and development of semiconductor technologies, such as (opto)electronic devices and photoelectrochemical cells. Among available electronic-structure methods, density-functional theory (DFT) with the Hubbard U correction (DFT+U) applied to band edge states is a computationally tractable approach to improve the accuracy of band gap predictions beyond that of DFT calculations based on (semi)local functionals. At variance with DFT approximations, which are not intended to describe optical band gaps and other excited-state properties, DFT+U can be interpreted as an approximate spectral-potential method when U is determined by imposing the piecewise linearity of the total energy with respect to electronic occupations in the Hubbard manifold (thus removing self-interaction errors in this subspace), thereby providing a (heuristic) justification for using DFT+U to predict band gaps. However, it is still frequent in the literature to determine the Hubbard U parameters semiempirically by tuning their values to reproduce experimental band gaps, which ultimately alters the description of other total-energy characteristics. Here, we present an extensive assessment of DFT+U band gaps computed using self-consistent ab initio U parameters obtained from density-functional perturbation theory to impose the aforementioned piecewise linearity of the total energy. The study is carried out on 20 compounds containing transition-metal or p-block (group III-IV) elements, including oxides, nitrides, sulfides, oxynitrides, and oxysulfides...


title: On the theory of charge transport and entropic effects in solvated molecular junctions

abstract: Experimental studies on single-molecule junctions are typically in need of a simple theoretical approach that can reproduce or be fitted to experimentally measured transport data. In this context, the single-level variant of the Landauer approach is most commonly used but methods based on Marcus theory are also gaining in popularity. Recently, a generalized theory unifying these two approaches has also been developed. In the present work, we extend this theory so that it includes entropic effects (which can be important when polar solvents are involved, but are likely minor for solid-state systems). We investigate the temperature-dependence of the electric current and compare it to the behavior predicted by the Landauer and the conventional Marcus theory. We argue that this generalized theory provides a simple yet effective framework for understanding charge transport through molecular junctions. Furthermore, we explore the role of the entropic effects in different transport regimes and suggest experimental criteria for detecting them in solvated molecular junctions. Lastly, in order to account for nuclear tunnelling effects, we also demonstrate how lifetime broadening can be introduced into the Marcus-Levich-Dogonadze-Jortner-type description of electron transport.


title: Adjoint functors on the representation category of $\mathscr{OI}$

abstract: In this paper we study adjunction relations between some natural functors on the representation category of the category of finite linearly ordered sets and order-preserving injections. We also prove that the Nakayama functor induces an equivalence from the Serre quotient of the category of finitely generated modules by the category of finitely generated torsion modules to the category of finite dimensional modules.


title: Absolute 3D Pose Estimation and Length Measurement of Severely Deformed Fish from Monocular Videos in Longline Fishing

abstract: Monocular absolute 3D fish pose estimation allows for efficient fish length measurement in the longline fisheries, where fishes are under severe deformation during the catching process. This task is challenging since it requires locating absolute 3D fish keypoints based on a short monocular video clip. Unlike related works, which either require expensive 3D ground-truth data and/or multiple-view images to provide depth information, or are limited to rigid objects, we propose a novel frame-based method to estimate the absolute 3D fish pose and fish length from a single-view 2D segmentation mask. We first introduce a relative 3D fish template. By minimizing an objective function, our method systematically estimates the relative 3D pose of the target fish and fish 2D keypoints in the image. Finally, with a closed-form solution, the relative 3D fish pose can help locate absolute 3D keypoints, resulting in the frame-based absolute fish length measurement, which is further refined based on the statistical temporal inference for the optimal fish length measurement from the video clip. Our experiments show that this method can accurately estimate the absolute 3D fish pose and further measure the absolute length, even outperforming the state-of-the-art multi-view method.


title: Rethinking the Optimization of Average Precision: Only Penalizing Negative Instances before Positive Ones is Enough

abstract: Optimizing the approximation of Average Precision (AP) has been widely studied for image retrieval. Limited by the definition of AP, such methods consider both negative and positive instances ranking before each positive instance. However, we claim that only penalizing negative instances before positive ones is enough, because the loss only comes from these negative instances. To this end, we propose a novel loss, namely Penalizing Negative instances before Positive ones (PNP), which can directly minimize the number of negative instances before each positive one. In addition, AP-based methods adopt a fixed and sub-optimal gradient assignment strategy. Therefore, we systematically investigate different gradient assignment solutions via constructing derivative functions of the loss, resulting in PNP-I with increasing derivative functions and PNP-D with decreasing ones. PNP-I focuses more on the hard positive instances by assigning larger gradients to them and tries to make all relevant instances closer. In contrast, PNP-D pays less attention to such instances and slowly corrects them. For most real-world data, one class usually contains several local clusters. PNP-I blindly gathers these clusters while PNP-D keeps them as they were. Therefore, PNP-D is more superior. Experiments on three standard retrieval datasets show consistent results with the above analysis. Extensive evaluations demonstrate that PNP-D achieves the state-of-the-art performance. Code is available at https://github.com/interestingzhuo/PNPloss


title: Quadrupole-octupole coupling and the onset of octupole deformation in actinides

abstract: The evolution of quadrupole and octupole collectivity and their coupling is investigated in a series of even-even isotopes of the actinide Ra, Th, U, Pu, Cm, and Cf with neutron number in the interval $130\leqslant N\leqslant 150$. The Hartree-Fock-Bogoliubov approximation, based on the parametrization D1M of the Gogny energy density functional, is employed to generate potential energy surfaces depending upon the axially-symmetric quadrupole and octupole shape degrees of freedom. The mean-field energy surface is then mapped onto the expectation value of the $sdf$ interacting-boson-model Hamiltonian in the boson condensate state as to determine the strength parameters of the boson Hamiltonian. Spectroscopic properties related to the octupole degree of freedom are produced by diagonalizing the mapped Hamiltonian. Calculated low-energy negative-parity spectra, $B(E3;3^{-}_{1}\to 0^{+}_{1})$ reduced transition rates, and effective octupole deformation suggest that the transition from nearly spherical to stable octupole-deformed, and to octupole vibrational states occurs systematically in the actinide region.


title: Frequency-Shift Chirp Spread Spectrum Communications with Index Modulation

abstract: This paper introduces a novel frequency-shift chirp spread spectrum (FSCSS) system with index modulation (IM). By using combinations of orthogonal chirp signals for message representation, the proposed FSCSS-IM system is very flexible to design and can achieve much higher data rates than the conventional FSCSS system under the same bandwidth. The paper presents optimal detection algorithms, both coherently and non-coherently, for the proposed FSCSS-IM system. Furthermore, a low-complexity non-coherent detection algorithm is also developed to reduce the computational complexity of the receiver, which is shown to achieve near-optimal performance. Results are presented to demonstrate that the proposed system, while enabling much higher data rates, enjoys similar bit-error performance as that of the conventional FSCSS system.


title: Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialog

abstract: This paper summarizes our work on the first track of the ninth Dialog System Technology Challenge (DSTC 9), "Beyond Domain APIs: Task-oriented Conversational Modeling with Unstructured Knowledge Access". The goal of the task is to generate responses to user turns in a task-oriented dialog that require knowledge from unstructured documents. The task is divided into three subtasks: detection, selection and generation. In order to be compute efficient, we formulate the selection problem in terms of hierarchical classification steps. We achieve our best results with this model. Alternatively, we employ siamese sequence embedding models, referred to as Dense Knowledge Retrieval, to retrieve relevant documents. This method further reduces the computation time by a factor of more than 100x at the cost of degradation in R@1 of 5-6% compared to the first model. Then for either approach, we use Retrieval Augmented Generation to generate responses based on multiple selected snippets and we show how the method can be used to fine-tune trained embeddings.


title: A new discrete energy technique for multi-step backward difference formulas

abstract: The backward differentiation formula (BDF) is a useful family of implicit methods for the numerical integration of stiff differential equations. It is well noticed that the stability and convergence of the $A$-stable BDF1 and BDF2 schemes for parabolic equations can be directly established by using the standard discrete energy analysis. However, such classical analysis technique seems not directly applicable to the BDF-$\mathbf{k}$ schemes for $3\leq \mathbf{k}\leq 5$. To overcome the difficulty, a powerful analysis tool based on the Nevanlinna-Odeh multiplier technique [Numer. Funct. Anal. Optim., 3:377-423, 1981] was developed by Lubich et al. [IMA J. Numer. Anal., 33:1365-1385, 2013]. In this work, by using the so-called discrete orthogonal convolution kernels technique, we will recover the classical energy analysis so that the stability and convergence of the BDF-$\mathbf{k}$ schemes for $3\leq \mathbf{k}\leq 5$ can be established. One of the theoretical advantages of our analysis technique is that less spacial regularity requirement is needed on the initial data.


title: Rigidity of topological invariants to symmetry breakings

abstract: Symmetry plays an important role in the topological band theory to remedy the eigenstates' gauge obstruction at the cost of a symmetry anomaly and zero-energy boundary modes. One can also make use of the symmetry to enumerate the topological invariants - giving a symmetry classification table. Here we consider various topological phases protected by different symmetries, and examine how the corresponding topological invariants evolve once the protecting symmetry is spontaneously lost. To our surprise, we find that the topological invariants and edge states can sometimes be robust to symmetry breaking quantum orders. This topological robustness persists as long as the mean-field Hamiltonian in a symmetry breaking ordered phase maintains its adiabatic continuity to the non-interacting Hamiltonian. For example, for a time-reversal symmetric topological phase in 2+1D, we show that the Z_2 time-reversal polarization continues to be a good topological invariant even after including distinct time-reversal breaking order parameters. Similar conclusions are drawn for various other symmetry breaking cases. Finally, we discuss that the change in the internal symmetry associated with the spontaneous symmetry breaking has to be accounted for to reinstate the topological invariants into the expected classification table.


title: Stability implies robust convergence of a class of preconditioned parallel-in-time iterative algorithms

abstract: Solving evolutionary equations in a parallel-in-time manner is an attractive topic and many algorithms are proposed in recent two decades. The algorithm based on the block $\alpha$-circulant preconditioning technique has shown promising advantages, especially for wave propagation problems. By fast Fourier transform for factorizing the involved circulant matrices, the preconditioned iteration can be computed efficiently via the so-called diagonalization technique, which yields a direct parallel implementation across all time levels. In recent years, considerable efforts have been devoted to exploring the convergence of the preconditioned iteration by studying the spectral radius of the iteration matrix, and this leads to many case-by-case studies depending on the used time-integrator. In this paper, we propose a unified convergence analysis for the algorithm applied to $u'+Au=f$, where $\sigma(A)\subset\mathbb{C}^+$ with $\sigma(A)$ being the spectrum of $A\in\mathbb{C}^{m\times m}$. For any one-step method (such as the Runge-Kutta methods) with stability function $\mathcal{R}(z)$, we prove that the decay rate of the global error is bounded by $\alpha/(1-\alpha)$, provided the method is stable, i.e., $\max_{\lambda\in\sigma(A)}|\mathcal{R}(\Delta t\lambda)|\leq1$. For any linear multistep method, such a bound becomes $c\alpha/(1-c\alpha)$, where $c\geq1$ is a constant specified by the multistep method itself. Our proof only relies on the stability of the time-integrator and the estimate is independent of the step size $\Delta t$ and the spectrum $\sigma(A)$.


title: A Physics Based Multiscale Compact Model of p-i-n Avalanche Photodiodes

abstract: III-V material based digital alloy Avalanche Photodiodes (APDs) have recently been found to exhibit low noise similar to Silicon APDs. The III-V materials can be chosen to operate at any wavelength in the infrared spectrum. In this work, we present a physics-based SPICE compatible compact model for APDs built from parameters extracted from an Environment-Dependent Tight Binding (EDTB) model calibrated to ab-initio Density Functional Theory (DFT) and Monte Carlo (MC) methods. Using this approach, we can accurately capture the physical characteristics of these APDs in integrated photonics circuit simulations.


title: Characterizing the dust content of disk substructures in TW Hya

abstract: We present Atacama Large Millimeter Array (ALMA) observations of TW Hya at 3.1 mm with $\sim50$ milliarcsecond resolution. These new data were combined with archival high angular resolution ALMA observations at 0.87 mm, 1.3 mm, and 2.1 mm. We analyze these multi-wavelength data to infer a disk radial profile of the dust surface density, maximum particle size, and slope of the particle size distribution. Most previously known annular substructures in the disk of TW Hya are resolved at the four wavelengths. Inside the inner 3 au cavity, the 2.1 mm and 3.1 mm images show a compact source of free-free emission, likely associated with an ionized jet. Our multi-wavelength analysis of the dust emission shows that the maximum particle size in the disk of TW Hya is $>1$ mm. The inner 20 au are completely optically thick at all four bands, which results in the data tracing different disk heights at different wavelengths. Coupled with the effects of dust settling, this prevents the derivation of accurate density and grain size estimates in these regions. At $r>20$ au, we find evidence of the accumulation of large dust particle at the position of the bright rings, indicating that these are working as dust traps. The total dust mass in the disk is between 250 and 330 $M_{\oplus}$, which represents a gas-to-dust mass ratio between 50 and 70. Our mass measurement is a factor of 4.5-5.9 higher than the mass that one would estimate using the typical assumptions of large demographic surveys. Our results indicate that the ring substructures in TW Hya are ideal locations to trigger the streaming instability and form new generations of planetesimals.


title: Four-Dimensional Steady Gradient Ricci Solitons with $3$-Cylindrical Tangent Flows at Infinity

abstract: In this paper we consider $4$-dimensional steady soliton singularity models, i.e., complete steady gradient Ricci solitons that arise as the rescaled limit of a finite time singular solution of the Ricci flow on a closed $4$-manifold. In particular, we study the geometry at infinity of such Ricci solitons under the assumption that their tangent flow at infinity is the product of $\mathbb{R}$ with a $3$-dimensional spherical space form. We also classify the tangent flows at infinity of $4$-dimensional steady soliton singularity models in general.


title: A detailed study of X-ray cavities in the intracluster environment of the cool core cluster Abell 3017

abstract: We present a detailed analysis of a cool-core galaxy cluster Abell 3017, at a redshift of z=0.219, which has been identified to be merging with its companion cluster Abell 3016. This study has made use of X-ray Chandra, UV (GALEX), optical (ESO/VLT), mid-infrared (WISE), and radio uGMRT observations of this cluster. Using various image processing techniques, such as unsharp masking, 2-d fits using Beta models, contour binning and the use of surface brightness profiles, we show the existence of a pair of X-ray cavities, at a projected distance of $\sim$20'' (70 kpc) and $\sim$16'' (57 kpc), respectively from the core of Abell~3017. We also detect an excess of X-ray emission located at 25'' $\sim$(88 kpc) south of the centre of Abell 3017, is likely due to the bulk motions in the ICM either by gas sloshing or ram-pressure striping due to a merger. We find that the radio lobes are responsible for the observed X-ray cavities detected in this system. The lower values of the mid-IR WISE colour [W1-W2] and [W2-W3] imply that the central BCG of Abell~3017 is a star-forming galaxy. The current star formation rate of the central BCG, estimated from the ${\rm H\alpha}$ and GALEX FUV luminosities, are equal to be $\sim 5.06\pm 0.78$ Msun yr$^{-1}$ and $\sim 9.20\pm 0.81$ Msun yr$^{-1}$, respectively. We detect, for the first time, a radio phoenix $\sim$150 kpc away from the radio core, with a spectral index of ($\alpha \!\leq\! -1.8$). We also report the detection of $\rm~Pa_\alpha$ emission in this cluster using ESO VLT SINFONI imaging data.


title: A blurred view of Van der Waerden type theorems

abstract: Let $AP_k=\{a,a+d,\ldots,a+(k-1)d\}$ be an arithmetic progression. For $\epsilon>0$ we call a set $AP_k(\epsilon)=\{x_0,\ldots,x_{k-1}\}$ an $\epsilon$-approximate arithmetic progression if for some $a$ and $d$, $|x_i-(a+id)|<\epsilon d$ holds for all $i\in\{0,1\ldots,k-1\}$. Complementing earlier results of Dumitrescu, in this paper we study numerical aspects of Van der Waerden, Szemeredi and Furstenberg-Katznelson like results in which arithmetic progressions and their higher dimensional extensions are replaced by their $\epsilon$-approximation.


title: Large Scale Long-tailed Product Recognition System at Alibaba

abstract: A practical large scale product recognition system suffers from the phenomenon of long-tailed imbalanced training data under the E-commercial circumstance at Alibaba. Besides product images at Alibaba, plenty of image related side information (e.g. title, tags) reveal rich semantic information about images. Prior works mainly focus on addressing the long tail problem in visual perspective only, but lack of consideration of leveraging the side information. In this paper, we present a novel side information based large scale visual recognition co-training~(SICoT) system to deal with the long tail problem by leveraging the image related side information. In the proposed co-training system, we firstly introduce a bilinear word attention module aiming to construct a semantic embedding over the noisy side information. A visual feature and semantic embedding co-training scheme is then designed to transfer knowledge from classes with abundant training data (head classes) to classes with few training data (tail classes) in an end-to-end fashion. Extensive experiments on four challenging large scale datasets, whose numbers of classes range from one thousand to one million, demonstrate the scalable effectiveness of the proposed SICoT system in alleviating the long tail problem. In the visual search platform Pailitao\footnote{http://www.pailitao.com} at Alibaba, we settle a practical large scale product recognition application driven by the proposed SICoT system, and achieve a significant gain of unique visitor~(UV) conversion rate.


title: Proximal Gradient Descent-Ascent: Variable Convergence under K{\L} Geometry

abstract: The gradient descent-ascent (GDA) algorithm has been widely applied to solve minimax optimization problems. In order to achieve convergent policy parameters for minimax optimization, it is important that GDA generates convergent variable sequences rather than convergent sequences of function values or gradient norms. However, the variable convergence of GDA has been proved only under convexity geometries, and there lacks understanding for general nonconvex minimax optimization. This paper fills such a gap by studying the convergence of a more general proximal-GDA for regularized nonconvex-strongly-concave minimax optimization. Specifically, we show that proximal-GDA admits a novel Lyapunov function, which monotonically decreases in the minimax optimization process and drives the variable sequence to a critical point. By leveraging this Lyapunov function and the K{\L} geometry that parameterizes the local geometries of general nonconvex functions, we formally establish the variable convergence of proximal-GDA to a critical point $x^*$, i.e., $x_t\to x^*, y_t\to y^*(x^*)$. Furthermore, over the full spectrum of the K{\L}-parameterized geometry, we show that proximal-GDA achieves different types of convergence rates ranging from sublinear convergence up to finite-step convergence, depending on the geometry associated with the K{\L} parameter. This is the first theoretical result on the variable convergence for nonconvex minimax optimization.


title: A Note On Determining Projections for Non-Homogeneous Incompressible Fluids

abstract: In this note, we consider a viscous incompressible fluid in a finite domain in both two and three dimensions, and examine the question of determining degrees of freedom (projections, functionals, and nodes). Our particular interest is the case of non-constant viscosity, representing either a fluid with viscosity that changes over time (such as an oil that loses viscosity as it degrades), or a fluid with viscosity varying spatially (as in the case of two-phase or multi-phase fluid models). Our goal is to apply the determining projection framework developed by the second author in previous work for weak solutions to the Navier-Stokes equations, in order to establish bounds on the number of determining functionals for this case, or equivalently, the dimension of a determining set, based on the approximation properties of an underlying determining projection. The results for the case of time-varying viscosity mirror those for weak solutions established in earlier work for constant viscosity. The case of space-varying viscosity, treated within a single-fluid Navier-Stokes model, is quite challenging to analyze, but we explore some preliminary ideas for understanding this case.


title: Training Federated GANs with Theoretical Guarantees: A Universal Aggregation Approach

abstract: Recently, Generative Adversarial Networks (GANs) have demonstrated their potential in federated learning, i.e., learning a centralized model from data privately hosted by multiple sites. A federatedGAN jointly trains a centralized generator and multiple private discriminators hosted at different sites. A major theoretical challenge for the federated GAN is the heterogeneity of the local data distributions. Traditional approaches cannot guarantee to learn the target distribution, which isa mixture of the highly different local distributions. This paper tackles this theoretical challenge, and for the first time, provides a provably correct framework for federated GAN. We propose a new approach called Universal Aggregation, which simulates a centralized discriminator via carefully aggregating the mixture of all private discriminators. We prove that a generator trained with this simulated centralized discriminator can learn the desired target distribution. Through synthetic and real datasets, we show that our method can learn the mixture of largely different distributions where existing federated GAN methods fail.


title: Large-Scale Visual Search with Binary Distributed Graph at Alibaba

abstract: Graph-based approximate nearest neighbor search has attracted more and more attentions due to its online search advantages. Numbers of methods studying the enhancement of speed and recall have been put forward. However, few of them focus on the efficiency and scale of offline graph-construction. For a deployed visual search system with several billions of online images in total, building a billion-scale offline graph in hours is essential, which is almost unachievable by most existing methods. In this paper, we propose a novel algorithm called Binary Distributed Graph to solve this problem. Specifically, we combine binary codes with graph structure to speedup online and offline procedures, and achieve comparable performance with the ones in real-value based scenarios by recalling more binary candidates. Furthermore, the graph-construction is optimized to completely distributed implementation, which significantly accelerates the offline process and gets rid of the limitation of memory and disk within a single machine. Experimental comparisons on Alibaba Commodity Data Set (more than three billion images) show that the proposed method outperforms the state-of-the-art with respect to the online/offline trade-off.


title: Structure vs. Randomness for Bilinear Maps

abstract: We prove that the slice rank of a 3-tensor (a combinatorial notion introduced by Tao in the context of the cap-set problem), the analytic rank (a Fourier-theoretic notion introduced by Gowers and Wolf), and the geometric rank (an algebro-geometric notion introduced by Kopparty, Moshkovitz, and Zuiddam) are all equal up to an absolute constant. As a corollary, we obtain strong trade-offs on the arithmetic complexity of a biased bilinear map, and on the separation between computing a bilinear map exactly and on average. Our result settles open questions of Haramaty and Shpilka [STOC 2010], and of Lovett [Discrete Anal. 2019] for 3-tensors.


title: View about consumption tax and grandchildren

abstract: In Japan, the increase in the consumption tax rate, a measure of balanced public finance, reduces the inequality of fiscal burden between the present and future generations. This study estimates the effect of grandchildren on an older person's view of consumption tax, using independently collected data. The results show that having grandchildren is positively associated with supporting an increase in consumption tax. Further, this association is observed strongly between granddaughters and grandparents. However, the association between grandsons and grandparents depends on the sub-sample. This implies that people of the old generation are likely to accept the tax burden to reduce the burden on their grandchildren, especially granddaughters. In other words, grandparents show intergenerational altruism.


title: Macroscopically entangled light fields: A quantum laser

abstract: A novel method of macroscopically entangled light-pair generation is presented for a quantum laser using randomness-based deterministic phase control of coherent light in a Mach-Zehnder interferometer (MZI). Unlike the particle nature-based quantum correlation in conventional quantum mechanics, the wave nature of photons is applied for collective phase control of coherent fields, resulting in a deterministically controllable nonclassical phenomenon. For the proof of principle, the entanglement between output light fields from an MZI is examined using the Hong-Ou-Mandel-type anticorrelation technique, where the anticorrelation is a direct evidence of the nonclassical features in an interferometric scheme. For the generation of random phase bases between two bipartite input coherent fields, a deterministic control of opposite frequency shifts results in phase sensitive anticorrelation, which is a macroscopic quantum feature.


title: Trustless, privacy-preserving blockchain bridges

abstract: In this paper, we present a protocol for facilitating trust-less cross-chain cryptocurrency transfers that preserve privacy of bridge withdrawals. We leverage zero-knowledge primitives that are commonly used to design cryptocurrency mixing protocols to provide similar functionality but across two or more blockchains. To that end, we receive cryptocurrency mixing for free through the bridge operations and de-scribe how to extend these protocols to incentivise bridge transfers using past ideas. We describe how resulting protocols lead to similar vampire style attacks coined in the Uniswap vs. Sushiswap saga but across chains.


title: Security and Privacy for Artificial Intelligence: Opportunities and Challenges

abstract: The increased adoption of Artificial Intelligence (AI) presents an opportunity to solve many socio-economic and environmental challenges; however, this cannot happen without securing AI-enabled technologies. In recent years, most AI models are vulnerable to advanced and sophisticated hacking techniques. This challenge has motivated concerted research efforts into adversarial AI, with the aim of developing robust machine and deep learning models that are resilient to different types of adversarial scenarios. In this paper, we present a holistic cyber security review that demonstrates adversarial attacks against AI applications, including aspects such as adversarial knowledge and capabilities, as well as existing methods for generating adversarial examples and existing cyber defence models. We explain mathematical AI models, especially new variants of reinforcement and federated learning, to demonstrate how attack vectors would exploit vulnerabilities of AI models. We also propose a systematic framework for demonstrating attack techniques against AI applications and reviewed several cyber defences that would protect AI applications against those attacks. We also highlight the importance of understanding the adversarial goals and their capabilities, especially the recent attacks against industry applications, to develop adaptive defences that assess to secure AI applications. Finally, we describe the main challenges and future research directions in the domain of security and privacy of AI technologies.


title: Hot graphite dust in the inner regime of NGC 4151

abstract: We model the near infrared SED of NGC 4151 with a 3-D radiative transfer SKIRT code, using which torus only (TO) and Ring And Torus (RAT) scenarios are studied. In the RAT models, a graphite ring-like structure (clumpy or smooth), is incorporated between the torus and the accretion disk. We vary the inclination angle $(i)$, inner radius (of the torus and the ring, $R_{\rm in, t}$ and $R_{\rm in, r}$ respectively), torus half-opening angle ($\sigma $), optical depth ($\tau_{9.7, \rm t} $ of the torus and $\tau_{9.7, \rm r} $ of the ring ) and the dust clump size ($R_{\rm clump}$). We perform a statistical analysis of the parameter space and find that all the models are able to explain the flat NIR SED of NGC 4151 with minor differences in the derived parameters. For the TO model, we get, $R_{\rm in, t}=0.1$ pc, $\sigma = 30^\circ $, $i = 53^\circ $, $\tau_{9.7, \rm t}=10$ and the clumpsize, $R_{\rm clump}$ =0.4 pc. For the smooth RAT model, $R_{\rm in, \rm r}=0.04$ pc, $\tau_{9.7, \rm total}$ = 11 and for the clumpy RAT model, $R_{\rm in, r} = 0.04$ pc/0.06 pc and $\tau_{9.7, \rm total}=20$. The $R_{\rm in, t}$ from the TO model does not agree with the NIR observations ($\sim 0.04$ pc). Hence, the most likely scenario is that a hot graphite ring is located at a distance 0.04 pc from the centre, composed of a smooth distribution of dust followed by a dusty torus at 0.1 pc with ISM type of grains.


title: Counting zeros of Dedekind zeta functions

abstract: Given a number field $K$ of degree $n_K$ and with absolute discriminant $d_K$, we obtain an explicit bound for the number $N_K(T)$ of non-trivial zeros (counted with multiplicity), with height at most $T$, of the Dedekind zeta function $\zeta_K(s)$ of $K$. More precisely, we show that for $T \geq 1$, $$ \Big| N_K (T) - \frac{T}{\pi} \log \Big( d_K \Big( \frac{T}{2\pi e}\Big)^{n_K}\Big)\Big| \le 0.228 (\log d_K + n_K \log T) + 23.108 n_K + 4.520, $$ which improves previous results of Kadiri and Ng, and Trudgian. The improvement is based on ideas from the recent work of Bennett $et$ $al.$ on counting zeros of Dirichlet $L$-functions.


title: CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation

abstract: Benchmark datasets have a significant impact on accelerating research in programming language tasks. In this paper, we introduce CodeXGLUE, a benchmark dataset to foster machine learning research for program understanding and generation. CodeXGLUE includes a collection of 10 tasks across 14 datasets and a platform for model evaluation and comparison. CodeXGLUE also features three baseline systems, including the BERT-style, GPT-style, and Encoder-Decoder models, to make it easy for researchers to use the platform. The availability of such data and baselines can help the development and validation of new methods that can be applied to various program understanding and generation problems.


title: Zeros of Green Functions in Topological Insulators

abstract: This study demonstrates that the zeros of the diagonal components of Green functions are key quantities that can detect non-interacting topological insulators. We show that zeros of the Green functions traverse the band gap in the topological phases. The traverses induce the crosses of zeros, and the zeros' surface in the band gap, analogous to the Fermi surface of metals. By calculating the zeros of the microscopic models, we show the traverses of the zeros universally appear in all six classes of conventional non-interacting topological insulators. By utilizing the eigenvector-eigenvalue identity, which is a recently rediscovered relation in linear algebra, we prove that the traverses of the zeros in the bulk Green functions are guaranteed by the band inversions, which occur in the topological phases. The relevance of the zeros to detecting the exotic topological insulators such as the higher-order topological insulators is also discussed. For the Hamiltonians with the nearest-neighbor hoppings, we also show that the gapless edge state guarantees the zeros' surfaces in the band gap. The analysis demonstrates that the zeros can be used to detect a wide range of topological insulators and thus useful for searching new topological materials.


title: Global Climate Model Occultation Lightcurves Tested by August 2018 Ground-Based Stellar Occultation

abstract: Pluto's atmospheric profiles (temperature and pressure) have been studied for decades from stellar occultation lightcurves. In this paper, we look at recent Pluto Global Climate Model (GCM) results (3D temperature, pressure, and density fields) from Bertrand et al. (2020) and use the results to generate model observer's plane intensity fields (OPIF) and lightcurves by using a Fourier optics scheme to model light passing through Pluto's atmosphere (Young, 2012). This approach can accommodate arbitrary atmospheric structures and 3D distributions of haze. We compared the GCM model lightcurves with the lightcurves observed during the 15-AUG-2018 Pluto stellar occultation. We find that the climate scenario which best reproduces the observed data includes an N2 ice mid-latitude band in the southern hemisphere. We have also studied different haze and P/T ratio profiles: the haze effectively reduces the central flash strength, and a lower P/T ratio both reduces the central flash strength and incurs anomalies in the shoulders of the central flash.


title: Virtual ID Discovery from E-commerce Media at Alibaba: Exploiting Richness of User Click Behavior for Visual Search Relevance

abstract: Visual search plays an essential role for E-commerce. To meet the search demands of users and promote shopping experience at Alibaba, visual search relevance of real-shot images is becoming the bottleneck. Traditional visual search paradigm is usually based upon supervised learning with labeled data. However, large-scale categorical labels are required with expensive human annotations, which limits its applicability and also usually fails in distinguishing the real-shot images. In this paper, we propose to discover Virtual ID from user click behavior to improve visual search relevance at Alibaba. As a totally click-data driven approach, we collect various types of click data for training deep networks without any human annotations at all. In particular, Virtual ID are learned as classification supervision with co-click embedding, which explores image relationship from user co-click behaviors to guide category prediction and feature learning. Concretely, we deploy Virtual ID Category Network by integrating first-clicks and switch-clicks as regularizer. Incorporating triplets and list constraints, Virtual ID Feature Network is trained in a joint classification and ranking manner. Benefiting from exploration of user click data, our networks are more effective to encode richer supervision and better distinguish real-shot images in terms of category and feature. To validate our method for visual search relevance, we conduct an extensive set of offline and online experiments on the collected real-shot images. We consistently achieve better experimental results across all components, compared with alternative and state-of-the-art methods.


title: MALI: A memory efficient and reverse accurate integrator for Neural ODEs

abstract: Neural ordinary differential equations (Neural ODEs) are a new family of deep-learning models with continuous depth. However, the numerical estimation of the gradient in the continuous case is not well solved: existing implementations of the adjoint method suffer from inaccuracy in reverse-time trajectory, while the naive method and the adaptive checkpoint adjoint method (ACA) have a memory cost that grows with integration time. In this project, based on the asynchronous leapfrog (ALF) solver, we propose the Memory-efficient ALF Integrator (MALI), which has a constant memory cost \textit{w.r.t} number of solver steps in integration similar to the adjoint method, and guarantees accuracy in reverse-time trajectory (hence accuracy in gradient estimation). We validate MALI in various tasks: on image recognition tasks, to our knowledge, MALI is the first to enable feasible training of a Neural ODE on ImageNet and outperform a well-tuned ResNet, while existing methods fail due to either heavy memory burden or inaccuracy; for time series modeling, MALI significantly outperforms the adjoint method; and for continuous generative models, MALI achieves new state-of-the-art performance. We provide a pypi package at \url{https://jzkay12.github.io/TorchDiffEqPack/}