title: Accelerated nonlinear primal-dual hybrid gradient methods with applications to supervised machine learning

abstract: The linear primal-dual hybrid gradient (PDHG) method is a first-order method that splits convex optimization problems with saddle-point structure into smaller subproblems. Unlike those obtained in most splitting methods, these subproblems can generally be solved efficiently because they involve simple operations such as matrix-vector multiplications or proximal mappings that are fast to evaluate numerically. This advantage comes at the price that the linear PDHG method requires precise stepsize parameters for the problem at hand to achieve an optimal convergence rate. Unfortunately, these stepsize parameters are often prohibitively expensive to compute for large-scale optimization problems, such as those in machine learning. This issue makes the otherwise simple linear PDHG method unsuitable for such problems, and it is also shared by most first-order optimization methods as well. To address this issue, we introduce accelerated nonlinear PDHG methods that achieve an optimal convergence rate with stepsize parameters that are simple and efficient to compute. We prove rigorous convergence results, including results for strongly convex or smooth problems posed on infinite-dimensional reflexive Banach spaces. We illustrate the efficiency of our methods on $\ell_{1}$-constrained logistic regression and entropy-regularized matrix games. Our numerical experiments show that the nonlinear PDHG methods are considerably faster than competing methods.


title: Abelianization and Quantum Lefschetz for Orbifold Quasimap $I$-Functions

abstract: Let $Y$ be a complete intersection in an affine variety $X$, with action by a complex reductive group $G$. Let $T \subset G$ be a maximal torus. A character $\theta$ of $G$ defines GIT quotients $Y//_\theta G$ and $X//_\theta T$. We prove formulas relating the small quasimap I-function of $Y//_\theta G$ to that of $X//_\theta T$. When $X$ is a vector space, this provides a completely explicit formula for the small $I$-function of $Y//_\theta G$.


title: Minimal quantum thermal machine in a bandgap environment: non-Markovian features and anti-Zeno advantage

abstract: A minimal model of a quantum thermal machine is analyzed, where a driven two level working medium (WM) is embedded in an environment (reservoir) whose spectrum possesses bandgaps. overlap with hot or cold reservoirs whose spectra are separated by a bandgap. Approximate and exact treatments supported by analytical considerations yield a complete characterization of this thermal machine in the deep quantum domain. For slow to moderate modulation, the spectral response of the reservoirs is close to equilibrium, exhibiting sideband (Floquet) resonances in the heat currents and power output. In contrast, for faster modulation, strong-coupling and non-Markovian features give rise to correlations between the WM and the reservoirs and between the two reservoirs. Power boost of strictly quantum origin ('quantum advantage') is then found for both continuous and segmental fast modulation that leads to the anti-Zeno effect of enhanced spectral reservoir response. Such features cannot be captured by standard Markovian treatments.


title: List-GRAND: A practical way to achieve Maximum Likelihood Decoding

abstract: Guessing Random Additive Noise Decoding (GRAND) is a recently proposed universal Maximum Likelihood (ML) decoder for short-length and high-rate linear block-codes. Soft-GRAND (SGRAND) is a prominent soft-input GRAND variant, outperforming the other GRAND variants in decoding performance; nevertheless, SGRAND is not suitable for parallel hardware implementation. Ordered Reliability Bits-GRAND (ORBGRAND) is another soft-input GRAND variant that is suitable for parallel hardware implementation, however it has lower decoding performance than SGRAND. In this paper, we propose List-GRAND (LGRAND), a technique for enhancing the decoding performance of ORBGRAND to match the ML decoding performance of SGRAND. Numerical simulation results show that LGRAND enhances ORBGRAND's decoding performance by $0.5-0.75$ dB for channel-codes of various classes at a target FER of $10^{-7}$. For linear block codes of length $127/128$ and different code-rates, LGRAND's VLSI implementation can achieve an average information throughput of $47.27-51.36$ Gbps. In comparison to ORBGRAND's VLSI implementation, the proposed LGRAND hardware has a $4.84\%$ area overhead.


title: The Influence on Crystal Nucleation of an Order-Disorder Transition among the Subcritical Clusters

abstract: Studies of nucleation generally focus on the properties of the critical cluster, but the presence of defects within the crystal lattice means that the population of nuclei necessarily evolve through a distribution of pre-critical clusters with varying degrees of structural disorder on their way to forming a growing stable crystal. To investigate the role pre-critical clusters play in nucleation, we develop a simple thermodynamic model for crystal nucleation in terms of cluster size and the degree of cluster order that allows us to alter the work of forming the pre-critical clusters without effecting the properties of the critical cluster. The steady state and transient nucleation behaviour of the system are then studied numerically, for different microscopic ordering kinetics. We find that the models exhibits a generic order-disorder transition in the pre-critical clusters. Independent of the type of ordering kinetics, increasing the accessibility of disordered pre-critical clusters decreases both the steady state nucleation rate and the nucleation lag time. Furthermore, the interplay between the free energy surface and the microscopic ordering kinetics leads to three distinct nucleation pathways.


title: Bringing Generalization to Deep Multi-View Pedestrian Detection

abstract: Multi-view Detection (MVD) is highly effective for occlusion reasoning in a crowded environment. While recent works using deep learning have made significant advances in the field, they have overlooked the generalization aspect, which makes them impractical for real-world deployment. The key novelty of our work is to formalize three critical forms of generalization and propose experiments to evaluate them: generalization with i) a varying number of cameras, ii) varying camera positions, and finally, iii) to new scenes. We find that existing state-of-the-art models show poor generalization by overfitting to a single scene and camera configuration. To address the concerns: (a) we propose a novel Generalized MVD (GMVD) dataset, assimilating diverse scenes with changing daytime, camera configurations, varying number of cameras, and (b) we discuss the properties essential to bring generalization to MVD and propose a barebones model to incorporate them. We perform a comprehensive set of experiments on the WildTrack, MultiViewX, and the GMVD datasets to motivate the necessity to evaluate the generalization abilities of MVD methods and to demonstrate the efficacy of the proposed approach. The code and the proposed dataset can be found at https://github.com/jeetv/GMVD


title: Normal ordered exponential approach to thermal properties and time-correlation functions: General theory and simple examples

abstract: A normal ordered exponential parametrization is used to obtain equations for thermal one-and two-particle reduced density matrices, as well as free energies, partition functions and entropy for both Fermionic (electronic) and Bosonic (vibrational) Hamiltonians. A first principles derivation of the equations, relying only on a simple Wick's theorem and starting from the differential equation $\frac{d \hat{D}}{d \beta}= - (\hat{H}-\mu \hat{N})\hat{D}$, is presented that yields a differential equation for the amplitudes representing density cumulants, as well as the grand potential. In contrast to other approaches reported in the literature the theory does not use perturbation theory in the interaction picture and an integral formulation as a starting point, but rather requires a propagation of the resulting differential equation for the amplitudes. While the theory is applicable to general classes of many-body problems in principle, here, the theory is illustrated using simple model systems. For one-body Fermionic Hamiltonians, Fermi-Dirac one-body reduced density matrices are recovered for the grand-canonical formulation. For multidimensional harmonic oscillators numerically exact results are obtained using the thermal normal ordered exponential (TNOE) approach. As an application of the related time-dependent formulation numerically exact time-autocorrelation functions and absorption spectra are obtained for harmonic Franck Condon problems. These examples illustrate the basic soundness of the scheme and are used for pedagogical purposes. Other approaches in the literature are only discussed briefly and no detailed comparative discussion is attempted.


title: An anisotropic Kantowski-Sachs universe with radiation, dust and a phantom fluid

abstract: In the present work, we study the dynamical evolution of an homogeneous and anisotropic KS cosmological model, considering general relativity as the gravitational theory, such that there are three different perfect fluids in the matter sector. They are radiation, dust and phantom fluid. Our main motivation is determining if the present model tends to an homogeneous and isotropic FRW model, during its evolution. Also, we want to establish how the parameters and initial conditions of the model, quantitatively, influence the isotropization of the present model. In order to simplify our task, we use the Misner parametrization of the KS metric. In terms of that parametrization the KS metric has two metric functions: the scale factor $a(t)$ and $\beta(t)$, which measures the spatial anisotropy of the model. We solve, numerically, the Einstein's equations of the model and find a solution where the universe starts to expand from a, small, initial size and continues to expand until it ends in a {\it Big Rip} singularity. We explicitly show that for the expansive solution, after same time, the universe becomes isotropic. Based on that result, we can speculate that the expansive solution may represent an initial, anisotropic, stage of our Universe, that later, due to the expansion, became isotropic.


title: Parity functors

abstract: A parity is a rule to assign labels to the crossings of knot diagrams in a way compatible with Reidemeister moves. Parity functors can be viewed as parities which provide to each knot diagram its own coefficient group that contains parities of the crossings. In the article we describe the universal oriented parity functors for free knots and for knots in a fixed surface.


title: Phase diagram of semi-hard-core bosons on a square lattice

abstract: Phase diagrams of charged semi-hard-core bosons are studied in the mean field approximation. An increase in the parameter of local correlations is shown to lead to the transformation of the phase diagram of the system from the form characteristic of hard-core bosons to the limiting form with a parabolic dependence of the critical temperature of charge ordering on the boson concentration. The evolution between these limiting cases is dependent on the ratio between the model parameters and is accompanied by various effects, such as the change in the phase transition type, the appearance of new order-order transition, and the appearance of new critical points.


title: Higher-order exceptional point in a pseudo-Hermitian cavity optomechanical system

abstract: Higher-order exceptional points (EPs), resulting from non-Hermitian degeneracies, have shown greater advantages in sensitive enhancement than second-order EPs (EP2s). Therefore, seeking higher-order EPs in various quantum systems is important for quantum information science. Here we propose a benchmark cavity optomechanical (COM) system consisting of a mechanical resonator (MR) coupled to two cavities via radiation pressure for predicting the third-order exceptional point (EP3). We first give the pseudo-Hermitian condition for the non-Hermitian COM system by taking the bath effects into account. Then we consider the mechanical gain effect and we find that the pseudo-Hermitian COM system without $\mathcal{PT}$ symmetry can host both the EP3 and EP2 for symmetric and asymmetric cavities. In the symmetric case, only the EP3 or EP2 can be predicted in the parameter space, but the EP3 and EP2 can be transformed into each other by tuning the COM coupling strength in the asymmetric case. We further consider the case of one cavity with gain. For this case, the pseudo-Hermitian COM system is $\mathcal{PT}$-symmetric and can also host the EP3 or EP2. The influence of system parameters on them are discussed. Our proposal provides a potential way to realize sensitive detection and study other physical phenomena {around} higher-order EP3 in non-Hermitian COM systems.


title: Higher semiadditive Grothendieck-Witt theory and the $K(1)$-local sphere

abstract: We develop a higher semiadditive version of Grothendieck-Witt theory. We then apply the theory in the case of a finite field to study the higher semiadditive structure of the $K(1)$-local sphere at the prime $2$. As a further application, we compute and clarify certain power operations in the homotopy of the $K(1)$-local sphere.


title: Low Cost Bin Picking Solution for E-Commerce Warehouse Fulfillment Centers

abstract: In recent years, the throughput requirements of e-commerce fulfillment warehouses have seen a steep increase. This has resulted in various automation solutions being developed for item picking and movement. In this paper, we address the problem of manipulators picking heterogeneous items placed randomly in a bin. Traditional solutions require that the items be picked to be placed in an orderly manner in the bin and that the exact dimensions of the items be known beforehand. Such solutions do not perform well in the real world since the items in a bin are seldom placed in an orderly manner and new products are added almost every day by e-commerce suppliers. We propose a cost-effective solution that handles both the aforementioned challenges. Our solution comprises of a dual sensor system comprising of a regular RGB camera and a 3D ToF depth sensor. We propose a novel algorithm that fuses data from both these sensors to improve object segmentation while maintaining the accuracy of pose estimation, especially in occluded environments and tightly packed bins. We experimentally verify the performance of our system by picking boxes using an ABB IRB 1200 robot. We also show that our system maintains a high level of accuracy in pose estimation that is independent of the dimensions of the box, texture, occlusion or orientation. We further show that our system is computationally less expensive and maintains a consistent detection time of 1 second. We also discuss how this approach can be easily extended to objects of all shapes.


title: Numerical computation of critical surfaces for the breakup of invariant tori in Hamiltonian systems

abstract: We compute the critical surface for the existence of invariant tori of a family of Hamiltonian systems with two and three degrees of freedom. We use and compare two methods to compute the critical surfaces: renormalization-group transformations and conjugation in configuration space. We unveil the presence of cusps in the critical surface for the breakup of three-dimensional invariant tori, whereas the critical surface of two-dimensional invariant tori is expected to be smooth.


title: Development and application of CATCH: A cylindrical active tracker and calorimeter system for hyperon-proton scattering experiments

abstract: In this study, we developed a new proton detector system called CATCH, which was designed for a scattering experiment involving a $\Sigma$ hyperon and a proton (J-PARC E40). CATCH is a cylindrical detector system covering an inner target that can be used to measure the trajectory and energy of a proton emitted from the target for the kinematic identification of a $\Sigma$p scattering event. It comprises a cylindrical fiber tracker (CFT), a bismuth germanate (BGO) calorimeter, and a plastic scintillator hodoscope (PiID), which are coaxially arranged from the inner to the outer sides. The CFT is a tracking detector consisting of 5,000 scintillation fibers, and it has two types of cylindrical layers in which the fibers are arranged in straight and spiral configurations. 24 BGO crystals are placed around the CFT to measure the kinetic energy of the recoil proton. The PiID is used to determine whether the recoil proton is stopped in the BGO calorimeter. We performed proton-proton (pp) and proton-carbon (pC) scattering experiments using an 80 MeV proton beam to evaluate the performance of CATCH. The total energy resolution for the recoil proton was 2.8 MeV in $\sigma$ for the entire angular region after the energy calibrations of the BGO calorimeter and the CFT. The angular resolution of the CFT was 1.27 degrees in $\sigma$ for the proton, and the time resolution was more than 1.8 ns in $\sigma$. We also developed an analysis method for deriving the cross section of the pp scattering using CATCH. The obtained relative differential cross section for the pp elastic scattering was consistent with that obtained by reliable partial wave analysis, and the systematic error was maintained at below 10%. These performance results satisfy our requirements for a reliable detection system for the $\Sigma$p scattering experiment conducted at J-PARC .


title: High precision differential clock comparisons with a multiplexed optical lattice clock

abstract: Rapid progress in the precision and accuracy of optical atomic clocks over the last decade has advanced the frontiers of timekeeping, metrology, and quantum science. However, the stabilities of most optical clocks remain limited by the local oscillator rather than the atoms themselves, leaving room for further progress. Here we implement a "multiplexed" one-dimensional optical lattice clock, in which spatially-resolved, movable ensembles of ultra-cold strontium atoms are trapped in the same optical lattice, interrogated simultaneously by a shared clock laser, and read-out in parallel. By performing synchronized Ramsey interrogations of ensemble pairs we observe atom-atom coherence times up to 26 seconds, a 270-fold improvement over the atom-laser coherence time, demonstrate a relative stability of $9.7(4)\times10^{-18}/\sqrt{\tau}$ (where $\tau$ is the averaging time in seconds), and reach a fractional uncertainty of $8.9(3)\times 10^{-20}$ after 3.3 hours of averaging. These results demonstrate that applications requiring ultra-high-precision comparisons between optical atomic clocks need not be limited by the stability of the local oscillator. With multiple ensemble pairs, we realize a miniaturized clock network consisting of 6 atom ensembles, resulting in 15 unique pairwise clock comparisons with relative stabilities below $3\times10^{-17}/\sqrt{\tau}$. Finally, we demonstrate the capability to simultaneously load spatially-resolved, heterogeneous ensemble pairs of all four stable isotopes of strontium in a lattice. The unique capabilities offered by this platform pave the way for future studies of precision isotope shift measurements, spatially resolved characterization of limiting clock systematics, development of clock-based gravitational wave and dark matter detectors, and novel tests of relativity including measurements of the gravitational redshift at sub-centimeter scales.


title: Resolving the gravitational redshift within a millimeter atomic sample

abstract: Einstein's theory of general relativity states that clocks at different gravitational potentials tick at different rates - an effect known as the gravitational redshift. As fundamental probes of space and time, atomic clocks have long served to test this prediction at distance scales from 30 centimeters to thousands of kilometers. Ultimately, clocks will study the union of general relativity and quantum mechanics once they become sensitive to the finite wavefunction of quantum objects oscillating in curved spacetime. Towards this regime, we measure a linear frequency gradient consistent with the gravitational redshift within a single millimeter scale sample of ultracold strontium. Our result is enabled by improving the fractional frequency measurement uncertainty by more than a factor of 10, now reaching 7.6$\times 10^{-21}$. This heralds a new regime of clock operation necessitating intra-sample corrections for gravitational perturbations.


title: Fast Successive-Cancellation List Flip Decoding of Polar Codes

abstract: This work presents a fast successive-cancellation list flip (Fast-SCLF) decoding algorithm for polar codes that addresses the high latency issue associated with the successive-cancellation list flip (SCLF) decoding algorithm. We first propose a bit-flipping strategy tailored to the state-of-the-art fast successive-cancellation list (FSCL) decoding that avoids tree-traversal in the binary tree representation of SCLF, thus reducing the latency of the decoding process. We then derive a parameterized path selection error model to accurately estimate the bit index at which the correct decoding path is eliminated from the initial FSCL decoding. The trainable parameter is optimized online based on an efficient supervised learning framework. Simulation results show that for a polar code of length 512 with 256 information bits, with similar error-correction performance and memory consumption, the proposed Fast-SCLF decoder reduces up to $73.4\%$ of the average decoding latency of the SCLF decoder with the same list size at the frame error rate of $10^{-4}$, while incurring a maximum computational complexity overhead of $27.6\%$. For the same polar code of length 512 with 256 information bits and at practical signal-to-noise ratios, the proposed decoder with list size 4 reduces $89.3\%$ and $43.7\%$ of the average complexity and decoding latency of the FSCL decoder with list size 32 (FSCL-32), respectively, while also reducing $83.2\%$ of the memory consumption of FSCL-32. The significant improvements of the proposed decoder come at the cost of $0.07$ dB error-correction performance degradation compared with FSCL-32.


title: Logical Credal Networks

abstract: This paper introduces Logical Credal Networks, an expressive probabilistic logic that generalizes many prior models that combine logic and probability. Given imprecise information represented by probability bounds and conditional probability bounds of logic formulas, this logic specifies a set of probability distributions over all interpretations. On the one hand, our approach allows propositional and first-order logic formulas with few restrictions, e.g., without requiring acyclicity. On the other hand, it has a Markov condition similar to Bayesian networks and Markov random fields that is critical in real-world applications. Having both these properties makes this logic unique, and we investigate its performance on maximum a posteriori inference tasks, including solving Mastermind games with uncertainty and detecting credit card fraud. The results show that the proposed method outperforms existing approaches, and its advantage lies in aggregating multiple sources of imprecise information.


title: Onset of transient convection in a porous medium with an embedded low-permeability layer

abstract: Deep saline aquifers used for CO$_2$ sequestration are commonly made of sedimentary formations consisting of several layers of distinguishable permeability. In this work, the effect of a non-monotonic, vertically varying permeability profile on the onset of convective instability is studied theoretically using linear stability analyses. The onset time depends on the interaction between the permeability profile and the location of the concentration perturbation peak beyond which the concentration of CO$_2$ decays. A thin low-permeability layer can either accelerate or delay the onset time of the convective instability depending on the nature of the permeability variation - whether the permeability transition is smooth or layered, the Rayleigh number (Ra), and the location of the permeability change ($\hat{a}$) relative to the perturbation peak ($\hat{a}_{c^{*}}$), which scales as $\hat{a}_{c^{*}}\approx 14Ra^{-1}$ for homogeneous systems. However, the low permeable layer has no effect on the onset time when it is near the lower boundary of a medium with sufficiently large Ra ($\hat{a}_{c^{*}} \ll \hat{a}$). This nontrivial dependence highlights the implication of ignoring geological features of a small spatial extent, indicating the importance of a detailed characterization of CO$_2$ storage sites.


title: Weakly Supervised Contrastive Learning for Chest X-Ray Report Generation

abstract: Radiology report generation aims at generating descriptive text from radiology images automatically, which may present an opportunity to improve radiology reporting and interpretation. A typical setting consists of training encoder-decoder models on image-report pairs with a cross entropy loss, which struggles to generate informative sentences for clinical diagnoses since normal findings dominate the datasets. To tackle this challenge and encourage more clinically-accurate text outputs, we propose a novel weakly supervised contrastive loss for medical report generation. Experimental results demonstrate that our method benefits from contrasting target reports with incorrect but semantically-close ones. It outperforms previous work on both clinical correctness and text generation metrics for two public benchmarks.


title: Systematic Generalization on gSCAN: What is Nearly Solved and What is Next?

abstract: We analyze the grounded SCAN (gSCAN) benchmark, which was recently proposed to study systematic generalization for grounded language understanding. First, we study which aspects of the original benchmark can be solved by commonly used methods in multi-modal research. We find that a general-purpose Transformer-based model with cross-modal attention achieves strong performance on a majority of the gSCAN splits, surprisingly outperforming more specialized approaches from prior work. Furthermore, our analysis suggests that many of the remaining errors reveal the same fundamental challenge in systematic generalization of linguistic constructs regardless of visual context. Second, inspired by this finding, we propose challenging new tasks for gSCAN by generating data to incorporate relations between objects in the visual environment. Finally, we find that current models are surprisingly data inefficient given the narrow scope of commands in gSCAN, suggesting another challenge for future work.


title: Inverse mass cascade in dark matter flow and effects on halo deformation, energy, size, and density profiles

abstract: Inverse mass cascade is a key feature of the intermediate statistically steady state for self-gravitating collisionless dark matter flow (SG-CFD). This paper focus on effects of mass cascade on halo energy, momentum, dispersion, size, and density. Halo with fast mass accretion has an expanding core. Mass cascade forms a new layer of mass that deforms the original halo and induces nonzero radial flow (outwards in core and inwards in outer regions). The inward/outward flow leads to an extra length scale (scale radius) that is not present in isothermal profile. Halo concentration c=3.5 can be derived for fast growing halos. For cusp-core controversy, a double-power-law density is proposed as a result of nonzero radial flow. The inner/outer density are controlled by halo deformation rate and halo growth, respectively. The slower deformation at center, the steeper density. For fast growing halos, radial flow at center is simply Hubble flow that leads to the existence of central core. Mass cascade leads to nonzero halo surface energy/tension and radial flow that enhances dispersion in outer region. An effective exponent of gravity $n_e$=-1.3 (not -1) is obtained due to halo surface energy. Halo size follows a geometric Brownian motion and lognormal distribution. Brownian motion of particles in evolving halos leads to Fokker-Planck equations for particle distribution that is dependent on the radial and osmotic flow. Complete solutions of particle distribution are presented based on a simple model of osmotic flow. The proposed model agrees with N-body simulation for various halo group sizes. With reference pressure/density defined at center, equation of state can be established for relative pressure/density. Pressure, density, and dispersion at halo center are presented. The core size $x_c$ is obtained where Hubble flow is dominant. Simple closures are proposed for self-consistent halo density.


title: Phenomenology of a Born-Infeld extension of the $U(1)_{\rm Y}$ sector at lepton colliders

abstract: In this work we perform a non-linear extension of the $U(1)_{\rm Y}$ sector of the Standard Model leading to novel quartic effective interactions between the neutral gauge bosons. We study the induced effects through high-energy processes resulting in three photons, namely, Z-boson decay and electron-positron annihilation. Available experimental data on these processes do not yield viable lower bounds on the mass parameter $\sqrt{\beta}$, but we estimate that the range $\sqrt{\beta} \lesssim m_Z$ could be reliably excluded with better statistics in future $e^- e^+$ colliders. We also discuss neutral gauge-boson scatterings, contextualizing our findings with recent results on anomalous quartic gauge couplings.


title: Reducing the LQG Cost with Minimal Communication

abstract: We study the linear quadratic Gaussian (LQG) control problem, in which the controller's observation of the system state is such that a desired cost is unattainable. To achieve the desired LQG cost, we introduce a communication link from the observer (encoder) to the controller. We investigate the optimal trade-off between the improved LQG cost and the consumed communication (information) resources, measured with the conditional directed information, across all encoding-decoding policies. The main result is a semidefinite programming formulation for that optimization problem in the finite-horizon scenario, which applies to time-varying linear dynamical systems. This result extends a seminal work by Tanaka et al., where the only information the controller knows about the system state arrives via a communication channel, to the scenario where the controller has also access to a noisy observation of the system state. As part of our derivation to show the optimiality of an encoder that transmits a memoryless Gaussian measurement of the state, we show that the presence of the controller's observations at the encoder can not reduce the minimal directed information. For time-invariant systems, where the optimal policy may be time-varying, we show in the infinite-horizon scenario that the optimal policy is time-invariant and can be computed explicitly from a solution of a finite-dimensional semidefinite programming. The results are demonstrated via examples that show that even low-quality measurements can have a significant impact on the required communication resources.


title: Analysis and Methods to Mitigate Effects of Under-reporting in Count Data

abstract: Under-reporting of count data poses a major roadblock for prediction and inference. In this paper, we focus on the Pogit model, which deconvolves the generating Poisson process from the censuring process controlling under-reporting using a generalized linear modeling framework. We highlight the limitations of the Pogit model and address them by adding constraints to the estimation framework. We also develop uncertainty quantification techniques that are robust to model mis-specification. Our approach is evaluated using synthetic data and applied to real healthcare datasets, where we treat in-patient data as `reported' counts and use held-out total injuries to validate the results. The methods make it possible to separate the Poisson process from the under-reporting process, given sufficient expert information. Codes to implement the approach are available via an open source Python package.


title: Integrated scalable metalens array for optical addressing

abstract: The scalability of optical addressing is one of the key challenges for the large-scale trapped-ion quantum computing (QC). Metasurfaces is a promising solution due to excellent optical performance, integration, and miniaturization. Here, we propose and numerically demonstrate a design of integrated scalable metalens array (ISMA) working in the UV 350nm range for optical addressing. These ISMAs can focus the collimated individual addressing beams array into diffraction-limited spots array, featuring crosstalk below 0.82%, focusing efficiency as high as 36.90%. For various applications, the x-polarized, polarization-insensitive and right-handed circularly polarized ISMA are designed. The design proposed in this paper can also find applications in optical trapping.


title: A general alternating-direction implicit framework with Gaussian process regression parameter prediction for large sparse linear systems

abstract: This paper proposes an efficient general alternating-direction implicit (GADI) framework for solving large sparse linear systems. The convergence property of the GADI framework is discussed. Most of the existing ADI methods can be viewed as particular schemes of the developed framework. Meanwhile the GADI framework can derive new ADI methods. Moreover, as the algorithm efficiency is sensitive to the splitting parameters, we offer a data-driven approach, the Gaussian process regression (GPR) method based on the Bayesian inference, to predict the GADI framework's relatively optimal parameters. The GPR method requires a small training data set to learn the regression prediction mapping, which has sufficient accuracy and high generalization capability. It allows us to efficiently solve linear systems with a one-shot computation, and does not require any repeated computations to obtain relatively optimal splitting parameters. Finally, we use the three-dimensional convection-diffusion equation and continuous Sylvester matrix equation to examine the performance of our proposed methods. Numerical results demonstrate that the proposed framework is faster tens to thousands of times than the existing ADI methods, such as (inexact) Hermitian and skew-Hermitian splitting type methods in which the consumption of obtaining relatively optimal splitting parameters is ignored. Due to the efficiency of the developed methods, we can solve much larger linear systems which these existing ADI methods have been not reached.


title: Differential Cohomology: Categories, Characteristic Classes, and Connections

abstract: We give an overview of differential cohomology from a modern, homotopy-theoretic perspective in terms of sheaves on manifolds. Although modern techniques are used, we base our discussion in the classical precursors to this modern approach, such as Chern-Weil theory and differential characters, and include the necessary background to increase accessibility. Special treatment is given to differential characteristic classes, including a differential lift of the first Pontryagin class. Multiple applications, including to configuration spaces, invertible field theories, and conformal immersions, are also discussed. This book is based on talks given at MIT's Juvitop seminar jointly with UT Austin in the Fall of 2019.


title: Spatially Resolving the Star Formation Histories of Three Nearby Nuclear Star Clusters

abstract: The formation of nuclear star clusters (NSCs) remains an open question. In this work, we use spatially resolved HST/STIS spectroscopic observations of three nearby NSCs (hosted by NGC 5102, NGC 5206, and NGC 205) to constrain their formation histories by exploring radial variations of the stellar populations within each cluster. Utilizing full-spectrum fitting, we find substantial age and metallicity gradients within the central 0."9 (16~pc) of the NSC in NGC 5102 where populations near the center are young/metal-rich (age ~400~Myr and [M/H] ~-0.4) and become older/metal-poor at larger radii (mean age ~1~Gyr and mean [M/H] ~-1.6 in the radial range [0."3, 0."9]). This behavior suggests that the young/metal-rich population at the center was formed from a period of in situ formation, while the older/metal-poor populations were likely formed by inspiraled globular clusters. The two broad populations observed in the NGC 5102 NSC (young/metal-rich and old/metal-poor) appear to be linked to the transition between the two morphological components of the NSC derived from the surface-brightness profile in Nguyen et al. (2018)(arXiv:1711.04314). The radial ranges explored in NGC 5206 and NGC 205 were much smaller due to poor data quality; in NGC 5206 we find a similar metallicity gradient to NGC 5102 (but with much lower significance), while the data for NGC 205 is too poor to reach any conclusions. Overall, this data highlights the links between the morphological and stellar population complexity of NSCs and their formation mechanisms.


title: Long-Range Feature Propagating for Natural Image Matting

abstract: Natural image matting estimates the alpha values of unknown regions in the trimap. Recently, deep learning based methods propagate the alpha values from the known regions to unknown regions according to the similarity between them. However, we find that more than 50\% pixels in the unknown regions cannot be correlated to pixels in known regions due to the limitation of small effective reception fields of common convolutional neural networks, which leads to inaccurate estimation when the pixels in the unknown regions cannot be inferred only with pixels in the reception fields. To solve this problem, we propose Long-Range Feature Propagating Network (LFPNet), which learns the long-range context features outside the reception fields for alpha matte estimation. Specifically, we first design the propagating module which extracts the context features from the downsampled image. Then, we present Center-Surround Pyramid Pooling (CSPP) that explicitly propagates the context features from the surrounding context image patch to the inner center image patch. Finally, we use the matting module which takes the image, trimap and context features to estimate the alpha matte. Experimental results demonstrate that the proposed method performs favorably against the state-of-the-art methods on the AlphaMatting and Adobe Image Matting datasets.


title: Development of Safety Monitoring System of Connected and Automated Vehicles considering the Trade-off between Communication Efficiency and Data Reliability

abstract: The safety of urban transportation systems is considered a public health issue worldwide, and many researchers have contributed to improving it. Connected automated vehicles (CAVs) and cooperative intelligent transportation systems (C-ITSs) are considered solutions to ensure urban transportation systems' safety using various sensors and communication devices. However, it is found difficult to deploy the C-ITS framework in South Korea, because CAVs produce a massive amount of data every minute but it cannot be transmitted via existing communication network. Thus, raw data must be sampled to reduce the size of the data over communication network and transmitted to the server for further processing. On the other hand, the sampled data must be highly accurate to ensure the safety of different agents in C-ITS. Thus, in this study, we designed and developed a C-ITS architecture and data flow, including messages and protocols for the safety monitoring system of CAVs, and determined the optimal sampling interval for data transmission while considering the trade-off between communication efficiency and reliability of safety performance indicators. Three safety performance indicators were introduced: severe deceleration, lateral position variance, and inverse time to collision. A field test is conducted to collect data from various sensors installed in the CAV, determining the optimal sampling interval. Kolmogorov-Smirnov test is conducted to ensure statistical consistency between sampled and raw datasets. The effects of the sampling interval on message delay, data accuracy, and communication efficiency were analyzed.


title: Real-space numerical renormalization-group computation of transport properties in the side-coupled geometry

abstract: The equilibrium transport properties of an elementary nanostructured device with side-coupled geometry are computed and related to universal functions. The computation relies on a real-space formulation of the numerical renormalization-group (NRG) procedure. The real-space construction, dubbed eNRG, is more straightforward than the NRG discretization and allows more faithful description of the coupling between quantum dots and conduction states. The procedure is applied to an Anderson-model description of a quantum wire side-coupled to a single quantum dot. A gate potential controls the dot occupation. In the Kondo regime, the electrical conductance through this device is known to map linearly onto a universal function of the temperature scaled by the Kondo temperature. Here, the energy moments from which the Seebeck coefficient and the thermal conductance can be computed are shown to map linearly onto universal functions also. The moments and transport properties computed by the eNRG procedure are shown to agree very well with these analytical developments. Algorithms facilitating comparison with experimental results are discussed. As an illustration, one of the algorithms is applied to thermal dependence of the thermopower measured by K\"{o}hler [PhD Thesis, TUD, Dresden, 2007] in Lu$_{0.9}$Yb$_{0.1}$Rh$_{2}$Si$_{2}$.


title: Constrained Attack-Resilient Estimation of Stochastic Cyber-Physical Systems

abstract: In this paper, a constrained attack-resilient estimation algorithm (CARE) is developed for stochastic cyber-physical systems. The proposed CARE can simultaneously estimate the compromised system states and attack signals. It has improved estimation accuracy and attack detection performance when physical constraints and operational limitations are available. In particular, CARE is designed for simultaneous input and state estimation that provides minimum-variance unbiased estimates, and these estimates are projected onto the constrained space restricted by inequality constraints subsequently. We prove that the estimation errors and their covariances from CARE are less than those from unconstrained algorithms and confirm that this property can further reduce the false negative rate in attack detection. We show that estimation errors of CARE are practically exponentially stable in mean square. Finally, an illustrative example of attacks on a vehicle is given to demonstrate the improved estimation accuracy and detection performance compared to an existing unconstrained algorithm.


title: Algebraic sheaves of Floer homology groups via algebraic torus actions on the Fukaya category

abstract: Let $(M,\omega_M)$ be a monotone or negatively monotone symplectic manifold, or a Weinstein manifold. One can construct an "action" of $H^1(M,\mathbb{G}_m)$ on the Fukaya category (wrapped Fukaya category in the exact case) that reflects the action of $Symp^0(M,\omega_M)$ on the set of Lagrangian branes. A priori this action is only analytic. The purpose of this work is to show the algebraicity of this action under some assumptions. We use this to prove a tameness result for the sheaf of Lagrangian Floer homology groups obtained by moving one of the Lagrangians via global symplectic isotopies. We also show the algebraicity of the locus of $z\in H^1(M,\mathbb{G}_m)$ that fix a Lagrangian brane in the Fukaya category. The latter has applications to Lagrangian flux. Finally, we prove a statement in mirror symmetry: in the Weinstein case, assume that $M$ is mirror to an affine or projective variety $X$, that there exists an exact Lagrangian torus $L\subset M$ such that $H^1(M)\to H^1(L)$ is surjective, and that $L$ is sent to a smooth point of $x\in X$ under the mirror equivalence. Then we construct a Zariski chart of $X$ containing $x$, that is isomorphic to $H^1(L,\mathbb{G}_m)$, and such that other points of this chart correspond to non-exact deformations of $L$ (possibly equipped with unitary local systems). In particular, this implies rationality of the irreducible component containing $x$; however, it is stronger. Under our assumptions, one can construct an algebraic action of $H^1(M,\mathbb{G}_m)$, namely the action by non-unitary local systems. By combining techniques from family Floer homology and non-commutative geometry, we prove that this action coincides with the geometric action mentioned in the first paragraph. We use this to deduce the theorems above.


title: Tensor Full Feature Measure and Its Nonconvex Relaxation Applications to Tensor Recovery

abstract: Tensor sparse modeling as a promising approach, in the whole of science and engineering has been a huge success. As is known to all, various data in practical application are often generated by multiple factors, so the use of tensors to represent the data containing the internal structure of multiple factors came into being. However, different from the matrix case, constructing reasonable sparse measure of tensor is a relatively difficult and very important task. Therefore, in this paper, we propose a new tensor sparsity measure called Tensor Full Feature Measure (FFM). It can simultaneously describe the feature information of each dimension of the tensor and the related features between two dimensions, and connect the Tucker rank with the tensor tube rank. This measurement method can describe the sparse features of the tensor more comprehensively. On this basis, we establish its non-convex relaxation, and apply FFM to low rank tensor completion (LRTC) and tensor robust principal component analysis (TRPCA). LRTC and TRPCA models based on FFM are proposed, and two efficient Alternating Direction Multiplier Method (ADMM) algorithms are developed to solve the proposed model. A variety of real numerical experiments substantiate the superiority of the proposed methods beyond state-of-the-arts.


title: Pushing on Text Readability Assessment: A Transformer Meets Handcrafted Linguistic Features

abstract: We report two essential improvements in readability assessment: 1. three novel features in advanced semantics and 2. the timely evidence that traditional ML models (e.g. Random Forest, using handcrafted features) can combine with transformers (e.g. RoBERTa) to augment model performance. First, we explore suitable transformers and traditional ML models. Then, we extract 255 handcrafted linguistic features using self-developed extraction software. Finally, we assemble those to create several hybrid models, achieving state-of-the-art (SOTA) accuracy on popular datasets in readability assessment. The use of handcrafted features help model performance on smaller datasets. Notably, our RoBERTA-RF-T1 hybrid achieves the near-perfect classification accuracy of 99%, a 20.3% increase from the previous SOTA.


title: NUMA-aware FFT-based Convolution on ARMv8 Many-core CPUs

abstract: Convolutional Neural Networks (CNNs), one of the most representative algorithms of deep learning, are widely used in various artificial intelligence applications. Convolution operations often take most of the computational overhead of CNNs. The FFT-based algorithm can improve the efficiency of convolution by reducing its algorithm complexity, there are a lot of works about the high-performance implementation of FFT-based convolution on many-core CPUs. However, there is no optimization for the non-uniform memory access (NUMA) characteristics in many-core CPUs. In this paper, we present a NUMA-aware FFT-based convolution implementation on ARMv8 many-core CPUs with NUMA architectures. The implementation can reduce a number of remote memory access through the data reordering of FFT transformations and the three-level parallelization of the complex matrix multiplication. The experiment results on a ARMv8 many-core CPU with NUMA architectures demonstrate that our NUMA-aware implementation has much better performance than the state-of-the-art work in most cases.


title: Quantum Cherenkov transition of finite momentum Bose polarons

abstract: We investigate the behavior of a finite-momentum impurity immersed in a weakly interacting three-dimensional Bose-Einstein condensate (BEC) of ultra-cold atoms, giving a detailed account of the dynamical quantum Cherenkov transition discussed in Ref. [arXiv:2101.00030]. Using a time-dependent variational approach, we identify a transition in the far-from-equilibrium dynamics of the system after the attractive short-range impurity-boson interaction is quenched on. The transition occurs as the impurity's velocity crosses an interaction-dependent critical value, and manifests in the long-time behavior of the Loschmidt echo and average impurity velocity. This behavior is also reflected in the finite momentum ground state of the system, where the group velocity of the interaction-dressed impurity loses it's dependence on the total momentum of the system as the critical point is crossed. The transition we discuss should be experimentally observable via a variety of common protocols in ultracold atomic systems such as time-of-flight imaging, RF spectroscopy, Ramsey interferometry, and absorption imaging.


title: An embarrassingly simple comparison of machine learning algorithms for indoor scene classification

abstract: With the emergence of autonomous indoor robots, the computer vision task of indoor scene recognition has gained the spotlight. Indoor scene recognition is a challenging problem in computer vision that relies on local and global features in a scene. This study aims to compare the performance of five machine learning algorithms on the task of indoor scene classification to identify the pros and cons of each classifier. It also provides a comparison of low latency feature extractors versus enormous feature extractors to understand the performance effects. Finally, a simple MnasNet based indoor classification system is proposed, which can achieve 72% accuracy at 23 ms latency.


title: Recent advances on eigenvalues of matrix-valued stochastic processes

abstract: Since the introduction of Dyson's Brownian motion in early 1960's, there have been a lot of developments in the investigation of stochastic processes on the space of Hermitian matrices. Their properties, especially, the properties of their eigenvalues have been studied in great details. In particular, the limiting behaviors of the eigenvalues are found when the dimension of the matrix space tends to infinity, which connects with random matrix theory. This survey reviews a selection of results on the eigenvalues of stochastic processes from the literature of the past three decades. For most recent variations of such processes, such as matrix-valued processes driven by fractional Brownian motion or Brownian sheet, the eigenvalues of them are also discussed in this survey. In the end, some open problems in the area are also proposed.


title: Polarization of the Corona Observed During the 2017 and 2019 Total Solar Eclipses

abstract: We carried out polarimetric observations of the white-light corona during the total solar eclipses that occurred on 2017 August 21 and 2019 July 2, and successfully obtained data at two different sites for both eclipses. After eliminating the sky background, we derived the brightness, polarization brightness, and degree of the polarization of the K+F corona from just above the limb to approximately 4 $R_\odot$. Furthermore, we isolated the K- and F-corona with plausible degree of polarization of the K-corona. The field of view covering up to approximately 4 $R_\odot$ enabled us to compare the derived brightness and polarization with a wide range of other observations. The results of the comparison show significant scatter; while some of the observations present very good coincidence with our results, the other ones exhibit systematic discrepancy.


title: More Than Reading Comprehension: A Survey on Datasets and Metrics of Textual Question Answering

abstract: Textual Question Answering (QA) aims to provide precise answers to user's questions in natural language using unstructured data. One of the most popular approaches to this goal is machine reading comprehension(MRC). In recent years, many novel datasets and evaluation metrics based on classical MRC tasks have been proposed for broader textual QA tasks. In this paper, we survey 47 recent textual QA benchmark datasets and propose a new taxonomy from an application point of view. In addition, We summarize 8 evaluation metrics of textual QA tasks. Finally, we discuss current trends in constructing textual QA benchmarks and suggest directions for future work.


title: Label-Assemble: Leveraging Multiple Datasets with Partial Labels

abstract: The success of deep learning relies heavily on large labeled datasets, but we often only have access to several small datasets associated with partial labels. To address this problem, we propose a new initiative, "Label-Assemble", that aims to unleash the full potential of partial labels from an assembly of public datasets. We discovered that learning from negative examples facilitates both computer-aided disease diagnosis and detection. This discovery will be particularly crucial in novel disease diagnosis, where positive examples are hard to collect, yet negative examples are relatively easier to assemble. For example, assembling existing labels from NIH ChestX-ray14 (available since 2017) significantly improves the accuracy of COVID-19 diagnosis from 96.3% to 99.3%. In addition to diagnosis, assembling labels can also improve disease detection, e.g., the detection of pancreatic ductal adenocarcinoma (PDAC) can greatly benefit from leveraging the labels of Cysts and PanNets (two other types of pancreatic abnormalities), increasing sensitivity from 52.1% to 84.0% while maintaining a high specificity of 98.0%.


title: Learning Stereopsis from Geometric Synthesis for 6D Object Pose Estimation

abstract: Current monocular-based 6D object pose estimation methods generally achieve less competitive results than RGBD-based methods, mostly due to the lack of 3D information. To make up this gap, this paper proposes a 3D geometric volume based pose estimation method with a short baseline two-view setting. By constructing a geometric volume in the 3D space, we combine the features from two adjacent images to the same 3D space. Then a network is trained to learn the distribution of the position of object keypoints in the volume, and a robust soft RANSAC solver is deployed to solve the pose in closed form. To balance accuracy and cost, we propose a coarse-to-fine framework to improve the performance in an iterative way. The experiments show that our method outperforms state-of-the-art monocular-based methods, and is robust in different objects and scenes, especially in serious occlusion situations.


title: CHANG-ES XXIII: Influence of a galactic wind in NGC 5775

abstract: We present new radio continuum images of the edge-on starburst galaxy NGC 5775, from LOFAR (140 MHz) and the Karl G. Jansky Very Large Array CHANG-ES survey (1500 MHz). We trace the non-thermal radio halo up to 13 kpc from the disc, measuring the non-thermal spectral index and estimating the total equipartition magnetic field strength ($\approx13\mu$G in the disc and $\approx7\mu$G above the plane). The radio halo has a similar extent at both frequencies, displays evidence for localized cosmic ray streaming coinciding with prominent H$\alpha$ filaments and vertical extensions of the regular magnetic field, and exhibits a boxy morphology especially at 140 MHz. In order to understand the nature of the disc-halo flow, we extend our previous model of cosmic ray propagation by implementing an iso-thermal wind with a tunable `flux tube' (approximately hyperboloidal) geometry. This updated model is successful in matching the vertical distribution of non-thermal radio emission, and the vertical steepening of the associated spectral index, in a consistent conceptual framework with few free parameters. Our new model provides the opportunity to estimate the mass outflow driven by the star formation process, and we find an implied rate of $\dot{M}\approx3-6\,\mathrm{M_{\odot}\,yr^{-1}}$ ($\approx40-80$ per cent of the star formation rate) if the escape velocity is reached, with substantial uncertainty arising from the poorly-understood distribution of ISM material entrained in the vertical flow. The wind may play a role in influencing the vertical gradient in rotational velocity.


title: Extreme-Value Statistics of the Spin of Primordial Black Holes

abstract: How rare are extreme-spin primordial black holes? We show how, from an underlying distribution of PBH spin, extreme-value statistics can be used to quantify the rarity of spinning PBHs with Kerr parameter close to 1. Using the Peaks-Over-Threshold method, we show how the probability that a PBH forms with spin exceeding a sufficiently high threshold can be calculated using the Generalised Pareto Distribution. This allows us to estimate the average number of PBHs amongst which we can find a single PBH which formed with spin exceeding a high threshold. We found that the primordial spin distribution gives rise to exceedingly rare near-extremal spin PBHs at formation time: for typical parameter values, roughly up to one in a hundred million PBHs would be formed with spin exceeding the Thorne limit. We discuss conditions under which even more extreme-spin PBHs may be produced, including modifying the skewness and kurtosis of the spin distribution via a smooth transformation. We deduce from our calculations that, if indeed asteroid-mass PBHs above the current observational limit on evaporating PBHs of mass ~10^{17} g contribute significantly to the dark matter, it is likely that some of them could be near-extremal PBHs.


title: Integrating Recurrent Neural Networks with Data Assimilation for Scalable Data-Driven State Estimation

abstract: Data assimilation (DA) is integrated with machine learning in order to perform entirely data-driven online state estimation. To achieve this, recurrent neural networks (RNNs) are implemented as surrogate models to replace key components of the DA cycle in numerical weather prediction (NWP), including the conventional numerical forecast model, the forecast error covariance matrix, and the tangent linear and adjoint models. It is shown how these RNNs can be initialized using DA methods to directly update the hidden/reservoir state with observations of the target system. The results indicate that these techniques can be applied to estimate the state of a system for the repeated initialization of short-term forecasts, even in the absence of a traditional numerical forecast model. Further, it is demonstrated how these integrated RNN-DA methods can scale to higher dimensions by applying domain localization and parallelization, providing a path for practical applications in NWP.

categories: cs.LG cs.AI math.DS math.OC physics.geo-ph


title: Search for Gamma-Ray Bursts and Gravitational Wave Electromagnetic Counterparts with High Energy X-ray Telescope of \textit{Insight}-HXMT

abstract: The High Energy X-ray telescope (HE) on-board the Hard X-ray Modulation Telescope (\textit{Insight}-HXMT) can serve as a wide Field of View (FOV) gamma-ray monitor with high time resolution ($\mu$s) and large effective area (up to thousands cm$^2$). We developed a pipeline to search for Gamma-Ray Bursts (GRBs), using the traditional signal-to-noise ratio (SNR) method for blind search and the coherent search method for targeted search. By taking into account the location and spectrum of the burst and the detector response, the targeted coherent search is more powerful to unveil weak and sub-threshold bursts, especially those in temporal coincidence with Gravitational Wave (GW) events. Based on the original method in literature, we further improved the coherent search to filter out false triggers caused by spikes in light curves, which are commonly seen in gamma-ray instruments (e.g. \textit{Fermi}/GBM, \textit{POLAR}). We show that our improved targeted coherent search method could eliminate almost all false triggers caused by spikes. Based on the first two years of \textit{Insight}-HXMT/HE data, our targeted search recovered 40 GRBs, which were detected by either \textit{Swift}/BAT or \textit{Fermi}/GBM but too weak to be found in our blind search. With this coherent search pipeline, the GRB detection sensitivity of \textit{Insight}-HXMT/HE is increased to about 1.5E-08 erg/cm$^2$ (200 keV$-$3 MeV). We also used this targeted coherent method to search \textit{Insight}-HXMT/HE data for electromagnetic (EM) counterparts of LIGO-Virgo GW events (including O2 and O3a runs). However, we did not find any significant burst associated with GW events.


title: BiTr-Unet: a CNN-Transformer Combined Network for MRI Brain Tumor Segmentation

abstract: Convolutional neural networks (CNNs) have achieved remarkable success in automatically segmenting organs or lesions on 3D medical images. Recently, vision transformer networks have exhibited exceptional performance in 2D image classification tasks. Compared with CNNs, transformer networks have an appealing advantage of extracting long-range features due to their self-attention algorithm. Therefore, we propose a CNN-Transformer combined model, called BiTr-Unet, with specific modifications for brain tumor segmentation on multi-modal MRI scans. Our BiTr-Unet achieves good performance on the BraTS2021 validation dataset with median Dice score 0.9335, 0.9304 and 0.8899, and median Hausdorff distance 2.8284, 2.2361 and 1.4142 for the whole tumor, tumor core, and enhancing tumor, respectively. On the BraTS2021 testing dataset, the corresponding results are 0.9257, 0.9350 and 0.8874 for Dice score, and 3, 2.2361 and 1.4142 for Hausdorff distance. The code is publicly available at https://github.com/JustaTinyDot/BiTr-Unet.


title: Jackstraw Inference for AJIVE Data Integration

abstract: In the age of big data, data integration is a critical step especially in the understanding of how diverse data types work together and work separately. Among data integration methods, the Angle-Based Joint and Individual Variation Explained (AJIVE) approach is particularly attractive because it not only studies joint behavior but also individual behavior. Typically AJIVE scores indicate important relationships between data objects, such as clusters. An important challenge is understanding which features, i.e. variables, are associated with those relationships. This challenge is addressed by the proposal of a hypothesis test for assessing statistical significance of features. The new test is inspired by the related jackstraw method developed for Principal Component Analysis. We use a high-dimensional muti-genomic cancer data set as our strong motivation and deep illustration of the methodology.


title: FedProc: Prototypical Contrastive Federated Learning on Non-IID data

abstract: Federated learning allows multiple clients to collaborate to train high-performance deep learning models while keeping the training data locally. However, when the local data of all clients are not independent and identically distributed (i.e., non-IID), it is challenging to implement this form of efficient collaborative learning. Although significant efforts have been dedicated to addressing this challenge, the effect on the image classification task is still not satisfactory. In this paper, we propose FedProc: prototypical contrastive federated learning, which is a simple and effective federated learning framework. The key idea is to utilize the prototypes as global knowledge to correct the local training of each client. We design a local network architecture and a global prototypical contrastive loss to regulate the training of local models, which makes local objectives consistent with the global optima. Eventually, the converged global model obtains a good performance on non-IID data. Experimental results show that, compared to state-of-the-art federated learning methods, FedProc improves the accuracy by $1.6\%\sim7.9\%$ with acceptable computation cost.


title: The emission properties, structure and stability of ionic liquid menisci undergoing electrically-assisted ion evaporation

abstract: The properties and structure of electrically-stressed ionic liquid menisci experiencing ion evaporation are simulated using an electrohydrodynamic model with field-enhanced thermionic emission in steady state for an axially-symmetric geometry. Solutions are explored as a function of the external background field, meniscus dimension, hydraulic impedance and liquid temperature. Statically stable solutions for emitting menisci are found to be constrained to a set of conditions: a minimum hydraulic impedance, a maximum current output, and a narrow range of background fields that maximizes at menisci sizes of 0.5-3 microns in radius. Static stability is lost when the electric field adjacent to the electrode that holds the meniscus corresponds to an electric pressure that exceeds twice the surface tension stress of a sphere of the same size as the meniscus. Preliminary investigations suggest this limit to be universal, therefore independent of most ionic liquid properties, reservoir pressure, hydraulic impedance or temperature and could explain the experimentally observed bifurcation of a steady ion source into two or more emission sites. Ohmic heating near the emission region increases the liquid temperature, which is found to be important to accurately describe stability boundaries. Temperature increase does not affect the current output when the hydraulic impedance is constant. This phenomenon is thought to be due to an improved interface charge relaxation enhanced by the higher electrical conductivity. Dissipated Ohmic energy is mostly conducted to the electrode wall. The higher thermal diffusivity of the wall versus the liquid, allows the ion source to run in steady state without heating.


title: A Variational Bayesian Inference-Inspired Unrolled Deep Network for MIMO Detection

abstract: The great success of deep learning (DL) has inspired researchers to develop more accurate and efficient symbol detectors for multi-input multi-output (MIMO) systems. Existing DL-based MIMO detectors, however, suffer several drawbacks. To address these issues, in this paper, we develop a model-driven DL detector based on variational Bayesian inference. Specifically, the proposed unrolled DL architecture is inspired by an inverse-free variational Bayesian learning framework which circumvents matrix inversion via maximizing a relaxed evidence lower bound. Two networks are respectively developed for independent and identically distributed (i.i.d.) Gaussian channels and arbitrarily correlated channels. The proposed networks, referred to as VBINet, have only a few learnable parameters and thus can be efficiently trained with a moderate amount of training samples. The proposed VBINet-based detectors can work in both offline and online training modes. An important advantage of our proposed networks over state-of-the-art MIMO detection networks such as OAMPNet and MMNet is that the VBINet can automatically learn the noise variance from data, thus yielding a significant performance improvement over the OAMPNet and MMNet in the presence of noise variance uncertainty. Simulation results show that the proposed VBINet-based detectors achieve competitive performance for both i.i.d. Gaussian and realistic 3GPP MIMO channels.


title: Cardiac Complication Risk Profiling for Cancer Survivors via Multi-View Multi-Task Learning

abstract: Complication risk profiling is a key challenge in the healthcare domain due to the complex interaction between heterogeneous entities (e.g., visit, disease, medication) in clinical data. With the availability of real-world clinical data such as electronic health records and insurance claims, many deep learning methods are proposed for complication risk profiling. However, these existing methods face two open challenges. First, data heterogeneity relates to those methods leveraging clinical data from a single view only while the data can be considered from multiple views (e.g., sequence of clinical visits, set of clinical features). Second, generalized prediction relates to most of those methods focusing on single-task learning, whereas each complication onset is predicted independently, leading to suboptimal models. We propose a multi-view multi-task network (MuViTaNet) for predicting the onset of multiple complications to tackle these issues. In particular, MuViTaNet complements patient representation by using a multi-view encoder to effectively extract information by considering clinical data as both sequences of clinical visits and sets of clinical features. In addition, it leverages additional information from both related labeled and unlabeled datasets to generate more generalized representations by using a new multi-task learning scheme for making more accurate predictions. The experimental results show that MuViTaNet outperforms existing methods for profiling the development of cardiac complications in breast cancer survivors. Furthermore, thanks to its multi-view multi-task architecture, MuViTaNet also provides an effective mechanism for interpreting its predictions in multiple perspectives, thereby helping clinicians discover the underlying mechanism triggering the onset and for making better clinical treatments in real-world scenarios.


title: Entanglement resonance in the asymmetric quantum Rabi model

abstract: We investigate the entanglement features in the interacting system of a quantized optical field and a two-level system which is statically driven, known as the asymmetric quantum Rabi model (AsymQRM). Intriguing entanglement resonance valleys with the increase of the photon-atom coupling strength and peaks with the increase of the driving amplitude are found. It is revealed that both of these two kinds of entanglement resonance are caused by the avoided level crossing of the associated eigenenergies. In sharp contrast to the quantum Rabi model, the entanglement of the AsymQRM collapses to zero in the strong coupling regime except when the driving amplitude equals to $m\omega/2$, with $m$ being an integer and $\omega$ being the photon frequency. Our analysis demonstrates that such entanglement reappearance is induced by the hidden symmetry of the AsymQRM. Supplying an insightful understanding on the AsymQRM, our results will be helpful in exploring the hidden symmetry and in preparing photon-atom entanglement in light-matter coupled systems.


title: Universal quantum computation with optical four-component cat qubits

abstract: We propose a teleportation-based scheme to implement a universal set of quantum gates with a four-component cat code, assisted by appropriate entangled resource states and photon number resolving detection. The four-component cat code features the ability to recover from single photon loss. Here, we propose a concrete procedure to correct the single photon loss, including detecting the single photon loss event and recovering the initial states. By concatenating with standard qubit error correcting codes, we estimate the loss threshold for fault-tolerant quantum computation and obtain a significant improvement over the two-component cat code.


title: Variational Quantum-Based Simulation of Waveguide Modes

abstract: Variational quantum algorithms are one of the most promising methods that can be implemented on noisy intermediate-scale quantum (NISQ) machines to achieve a quantum advantage over classical computers. This article describes the use of a variational quantum algorithm in conjunction with the finite difference method for the calculation of propagation modes of an electromagnetic wave in a hollow metallic waveguide. The two-dimensional (2D) waveguide problem, described by the Helmholtz equation, is approximated by a system of linear equations, whose solutions are expressed in terms of simple quantum expectation values that can be evaluated efficiently on quantum hardware. Numerical examples are presented to validate the proposed method for solving 2D waveguide problems.


title: All-photonic architectural roadmap for scalable quantum computing using Greenberger-Horne-Zeilinger states

abstract: Linear optical quantum computing is beset by the lack of deterministic entangling operations besides photon loss. Motivated by advancements at the experimental front in deterministic generation of various kinds of multiphoton entangled states, we propose an architecture for linear-optical quantum computing that harnesses the availability of three-photon Greenberger-Horne-Zeilinger (GHZ) states. Our architecture and its subvariants use polarized photons in GHZ states, polarization beam splitters, delay lines, optical switches and on-off detectors. We concatenate topological quantum error correction code with three-qubit repetition codes and estimate that our architecture can tolerate remarkably high photon-loss rate of $11.5 \%$; this makes a drastic change that is at least an order higher than those of known proposals. Further, considering three-photon GHZ states as resources, we estimate the resource overheads to perform gate operations with an accuracy of $10^{-6}~(10^{-15})$ to be $2.0\times10^6~(5.6\times10^7)$. Compared to other all-photonic schemes, our architecture is also resource-efficient. In addition, the resource overhead can be even further improved if larger GHZ states are available. Given its striking enhancement in the photon loss threshold and the recent progress in generating multiphoton entanglement, our scheme will make scalable photonic quantum computing a step closer to reality.


title: Tree balance indices: a comprehensive survey

abstract: Tree balance plays an important role in phylogenetics and other research areas, which is why several indices to measure tree balance have been introduced over the years. Nevertheless, a formal definition of what a balance index actually is and what makes it a useful measure of balance (or, in other cases, imbalance), has so far not been introduced in the literature. While the established indices all summarize the (im)balance of a tree in a single number, they vary in their definitions and underlying principles. It is the aim of the present manuscript to introduce formal definitions of balance and imbalance indices that classify desirable properties of such indices and to analyze and categorize established indices accordingly. In this regard, we review 19 established (im)balance indices from the literature, summarize their general, statistical and combinatorial properties (where known), prove numerous additional results and indicate directions for future research by making explicit open questions and gaps in the literature. We also prove that a few tree shape statistics that have been used to measure tree balance in the literature do not fulfill our definition of an (im)balance index, which might indicate that their properties are not as useful for practical purposes. Moreover, we show that five additional tree shape statistics from other contexts actually are tree (im)balance indices according to our definition. The manuscript is accompanied by the website \url{treebalance.wordpress.com} containing fact sheets of the discussed indices. Moreover, we introduce the software package \verb|treebalance| implemented in $\mathsf{R}$ that can be used to calculate all indices discussed.


title: Quantum key distribution over scattering channel

abstract: Scattering of light by cloud, haze, and fog decreases the transmission efficiency of communication channels in quantum key distribution (QKD), reduces the system's practical security, and thus constrains the deployment of free-space QKD. Here, we employ the wavefront shaping technology to compensate distorted optical signals in high-loss scattering quantum channels and fulfill a polarization-encoded BB84 QKD experiment. With this quantum channel compensation technology, we achieve a typical enhancement of about 250 in transmission efficiency and improve the secure key rate from 0 to $1.85\times10^{-6}$ per sifted key. The method and its first time validation show the great potential to expand the territory of QKD systems from lossless channels to highly scattered ones and therefore enhances the deployment ability of global quantum communication network.


title: Scalable deeper graph neural networks for high-performance materials property prediction

abstract: Machine learning (ML) based materials discovery has emerged as one of the most promising approaches for breakthroughs in materials science. While heuristic knowledge based descriptors have been combined with ML algorithms to achieve good performance, the complexity of the physicochemical mechanisms makes it urgently needed to exploit representation learning from either compositions or structures for building highly effective materials machine learning models. Among these methods, the graph neural networks have shown the best performance by its capability to learn high-level features from crystal structures. However, all these models suffer from their inability to scale up the models due to the over-smoothing issue of their message-passing GNN architecture. Here we propose a novel graph attention neural network model DeeperGATGNN with differentiable group normalization and skip-connections, which allows to train very deep graph neural network models (e.g. 30 layers compared to 3-9 layers in previous works). Through systematic benchmark studies over six benchmark datasets for energy and band gap predictions, we show that our scalable DeeperGATGNN model needs little costly hyper-parameter tuning for different datasets and achieves the state-of-the-art prediction performances over five properties out of six with up to 10\% improvement. Our work shows that to deal with the high complexity of mapping the crystal materials structures to their properties, large-scale very deep graph neural networks are needed to achieve robust performances.


title: Continuity and bi-Lipschitz properties of the Hurwitz and its invariant metrics

abstract: This paper attempts to study the continuity of the Hurwitz metric in arbitrary proper subdomains of the complex plane and to introduce a new invariant metric bi-Lipschitz equivalent to the Hurwitz metric in hyperbolic domains. The lower semi-continuity and other basic properties of this invariant metric are also presented.


title: Surface dimension, tiles, and synchronising automata

abstract: We study the surface regularity of compact sets $G \subset R^n$ which is equal to the supremum of numbers $s\ge 0$ such that the measure of the set $G_{\varepsilon}\setminus G$ does not exceed $C\varepsilon^{s}, \varepsilon > 0$, where $G_{\varepsilon}$ denotes the $\varepsilon$-neighbourhood of~$G$. The surface dimension is by definition the difference between~$n$ and the surface regularity. Those values provide a natural characterisation of regularity for sets of positive measure. We show that for self-affine attractors and tiles those characteristics are explicitly computable and find them for some popular tiles. This, in particular, gives a refined regularity scale for the multivariate Haar wavelets. The classification of attractors of the highest possible regularity is addressed. The relation between the surface regularity and the H\"older regularity of multivariate refinable functions and wavelets is found. Finally, the surface regularity is applied to the theory of synchronising automata, where it corresponds to the concept of parameter of synchronisation.


title: Stackelberg Actor-Critic: Game-Theoretic Reinforcement Learning Algorithms

abstract: The hierarchical interaction between the actor and critic in actor-critic based reinforcement learning algorithms naturally lends itself to a game-theoretic interpretation. We adopt this viewpoint and model the actor and critic interaction as a two-player general-sum game with a leader-follower structure known as a Stackelberg game. Given this abstraction, we propose a meta-framework for Stackelberg actor-critic algorithms where the leader player follows the total derivative of its objective instead of the usual individual gradient. From a theoretical standpoint, we develop a policy gradient theorem for the refined update and provide a local convergence guarantee for the Stackelberg actor-critic algorithms to a local Stackelberg equilibrium. From an empirical standpoint, we demonstrate via simple examples that the learning dynamics we study mitigate cycling and accelerate convergence compared to the usual gradient dynamics given cost structures induced by actor-critic formulations. Finally, extensive experiments on OpenAI gym environments show that Stackelberg actor-critic algorithms always perform at least as well and often significantly outperform the standard actor-critic algorithm counterparts.


title: Complements of discriminants of simple real function singularities

abstract: All components of complements of discriminant varieties of simple real function singularities are explicitly listed. New invariants of such components (for not necessarily simple singularities) are introduced. A combinatorial algorithm enumerating topological types of morsifications of real function singularities is promoted.


title: Cosmological Dynamics of Cuscuta-Galileon Gravity

abstract: We study cosmological dynamics of the cuscuta-galileon gravity with a potential term by using the dynamical system approach. This model is galileon generalization of the cuscuton gravity where we add a potential term to the theory in order to obtain the radiation and matter dominated eras. The exponential potential can provide the sequence of the thermal history of the Universe correctly, i.e. starting from radiation dominance, passing through matter dominant era, and then approaching de Sitter expansion stage. This model has no ghosts and the Laplacian instability for both scalar and tensor perturbations. We also discuss the observational constraints on the model parameters. It turns out that the model actually has three degrees of freedom unlike the original cuscuton theory.


title: Asynchronous Gathering Algorithms for Autonomous Mobile Robots with Lights

abstract: We consider a Gathering problem for n autonomous mobile robots with persistent memory called light in an asynchronous scheduler (ASYNC). It is well known that Gathering is impossible when robots have no lights in basic common models, if the system is semi-synchronous (SSYNC) or even centralized (only one robot is active in each time). It is known that Gathering can be solved by robots with 10 colors of lights in ASYNC. This result is obtained by combining the following results. (1) The simulation of SSYNC robots with k colors by ASYNC robots with 5k colors, and (2) Gathering is solved by SSYNC robots with 2 colors. In this paper, we improve the result by reducing the number of colors and show that Gathering can be solved by ASYNC robots with 3 colors of lights. We also show that we can construct a simulation algorithm of any unfair SSYNC algorithm using k colors by ASYNC robots with 3k colors, where unfairness does not guarantee that every robot is activated infinitely often. Combining this simulation and the Gathering algorithm by SSYNC robots with 2 colors, we obtain a Gathering algorithm by ASYNC robots with 6 colors. Our main result can be obtained by reducing the number of colors from 6 to 3.


title: Distributed Computation of Stochastic GNE with Partial Information: An Augmented Best-Response Approach

abstract: In this paper, we focus on the stochastic generalized Nash equilibrium problem (SGNEP) which is an important and widely-used model in many different fields. In this model, subject to certain global resource constraints, a set of self-interested players aim to optimize their local objectives that depend on their own decisions and the decisions of others and are influenced by some random factors. We propose a distributed stochastic generalized Nash equilibrium seeking algorithm in a partial-decision information setting based on the Douglas-Rachford operator splitting scheme, which relaxes assumptions in the existing literature. The proposed algorithm updates players' local decisions through augmented best-response schemes and subsequent projections onto the local feasible sets, which occupy most of the computational workload. The projected stochastic subgradient method is applied to provide approximate solutions to the augmented best-response subproblems for each player. The Robbins-Siegmund theorem is leveraged to establish the main convergence results to a true Nash equilibrium using the proposed inexact solver. Finally, we illustrate the validity of the proposed algorithm via two numerical examples, i.e., a stochastic Nash-Cournot distribution game and a multi-product assembly problem with the two-stage model.


title: Obstructions for matroids of path-width at most k and graphs of linear rank-width at most k

abstract: Every minor-closed class of matroids of bounded branch-width can be characterized by a list of excluded minors, but unlike graphs, this list may need to be infinite in general. However, for each fixed finite field $\mathbb F$, the list needs to contain only finitely many $\mathbb F$-representable matroids, due to the well-quasi-ordering of $\mathbb F$-representable matroids of bounded branch-width under taking matroid minors [J. F. Geelen, A. M. H. Gerards, and G. Whittle (2002)]. But this proof is non-constructive and does not provide any algorithm for computing these $\mathbb F$-representable excluded minors in general. We consider the class of matroids of path-width at most $k$ for fixed $k$. We prove that for a finite field $\mathbb F$, every $\mathbb F$-representable excluded minor for the class of matroids of path-width at most $k$ has at most $2^{|\mathbb{F}|^{O(k^2)}}$ elements. We can therefore compute, for any integer $k$ and a fixed finite field $\mathbb F$, the set of $\mathbb F$-representable excluded minors for the class of matroids of path-width $k$, and this gives as a corollary a polynomial-time algorithm for checking whether the path-width of an $\mathbb F$-represented matroid is at most $k$. We also prove that every excluded pivot-minor for the class of graphs having linear rank-width at most $k$ has at most $2^{2^{O(k^2)}}$ vertices, which also results in a similar algorithmic consequence for linear rank-width of graphs.


title: Learning Interpretable BEV Based VIO without Deep Neural Networks

abstract: Monocular visual-inertial odometry (VIO) is a critical problem in robotics and autonomous driving. Traditional methods solve this problem based on filtering or optimization. While being fully interpretable, they rely on manual interference and empirical parameter tuning. On the other hand, learning-based approaches allow for end-to-end training but require a large number of training data to learn millions of parameters. However, the non-interpretable and heavy models hinder the generalization ability. In this paper, we propose a fully differentiable, and interpretable, bird-eye-view (BEV) based VIO model for robots with local planar motion that can be trained without deep neural networks. Specifically, we first adopt Unscented Kalman Filter as a differentiable layer to predict the pitch and roll, where the covariance matrices of noise are learned to filter out the noise of the IMU raw data. Second, the refined pitch and roll are adopted to retrieve a gravity-aligned BEV image of each frame using differentiable camera projection. Finally, a differentiable pose estimator is utilized to estimate the remaining 3 DoF poses between the BEV frames: leading to a 5 DoF pose estimation. Our method allows for learning the covariance matrices end-to-end supervised by the pose estimation loss, demonstrating superior performance to empirical baselines. Experimental results on synthetic and real-world datasets demonstrate that our simple approach is competitive with state-of-the-art methods and generalizes well on unseen scenes.


title: Adaptive video transmission using QUBO method and Digital Annealer based on Ising machine

abstract: With the dramatically increasing video streaming in the total network traffic, it is critical to develop effective algorithms to promote the content delivery service of high quality. Adaptive bitrate (ABR) control is the most essential technique which determines the proper bitrate to be chosen based on network conditions, thus realize high-quality video streaming. In this paper, a novel ABR strategy is proposed based on Ising machine by using the quadratic unconstrained binary optimization (QUBO) method and Digital Annealer (DA) for the first time. The proposed method is evaluated by simulation with the real-world measured throughput, and compared with other state-of-the-art methods. Experiment results show that the proposed QUBO-based method can outperform the existing methods, which demonstrating the superior of the proposed QUBO-based method.


title: Revisiting Pre-analysis Information Based Rate Control in x265

abstract: Due to the excellent compression and high real-time performance, x265 is widely used in practical applications. Combined with CU-tree based pre-analysis, x265 rate control can obtain high rate-distortion (R-D) performance. However, the pre-analysis information is not fully utilized, and the accuracy of rate control is not satisfactory in x265 because of an empirical linear model. In this paper, we propose an improved cost-guided rate control scheme for x265. Firstly, the pre-analysis information is further used to refine the bit allocation. Secondly, CU-tree is combined with the lambda-domain model for more accurate rate control and higher R-D performance. Experimental results show that compared with the original x265, our method can achieve 10.3\% BD-rate gain with only 0.22\textperthousand bitrate error.


title: Ensemble-variational assimilation of statistical data in large eddy simulation

abstract: A non-intrusive data assimilation methodology is developed to improve the statistical predictions of large-eddy simulations (LES). The ensemble-variational (EnVar) approach aims to minimize a cost function that is defined as the discrepancy between LES predictions and reference statistics from experiments or, in the present demonstration, independent direct numerical simulations (DNS). This methodology is applied to adjust the Smagorinsky subgrid model and obtain data assimilated LES (DA-LES) which accurately estimate the statistics of turbulent channel flow. To separately control the mean and fluctuations of the modeled subgrid tensor, and ultimately the first- and second-order flow statistics, two types of model corrections are considered. The first one optimizes the wall-normal profile of the Smagorinsky coefficient, while the second one introduces an adjustable steady forcing in the momentum equations to independently act on the mean flow. Using these two elements, the data assimilation procedure can satisfactorily modify the subgrid model and accurately recover reference flow statistics. The retrieved subgrid model significantly outperforms more elaborate baseline models such as dynamic and mixed models, in a posteriori testing. The robustness of the present data assimilation methodology is assessed by changing the Reynolds number and considering grid resolutions that are away from usual recommendations. Taking advantage of the stochastic formulation of EnVar, the developed framework also provides the uncertainty of the retrieved model.


title: Jointly Learning to Repair Code and Generate Commit Message

abstract: We propose a novel task of jointly repairing program codes and generating commit messages. Code repair and commit message generation are two essential and related tasks for software development. However, existing work usually performs the two tasks independently. We construct a multilingual triple dataset including buggy code, fixed code, and commit messages for this novel task. We provide the cascaded models as baseline, which are enhanced with different training approaches, including the teacher-student method, the multi-task method, and the back-translation method. To deal with the error propagation problem of the cascaded method, the joint model is proposed that can both repair the code and generate the commit message in a unified framework. Experimental results show that the enhanced cascaded model with teacher-student method and multitask-learning method achieves the best score on different metrics of automated code repair, and the joint model behaves better than the cascaded model on commit message generation.


title: A Primal Decomposition Approach to Globally Coupled Aggregative Optimization over Networks

abstract: We consider a class of multi-agent optimization problems, where each agent has a local objective function that depends on its own decision variables and the aggregate of others, and is willing to cooperate with other agents to minimize the sum of the local objectives. After associating each agent with an auxiliary variable and the related local estimates, we conduct primal decomposition to the globally coupled problem and reformulate it so that it can be solved distributedly. Based on the Douglas-Rachford method, an algorithm is proposed which ensures the exact convergence to a solution of the original problem. The proposed method enjoys desirable scalability by only requiring each agent to keep local estimates whose number grows linearly with the number of its neighbors. We illustrate our proposed algorithm by numerical simulations on a commodity distribution problem over a transport network.


title: Opacus: User-Friendly Differential Privacy Library in PyTorch

abstract: We introduce Opacus, a free, open-source PyTorch library for training deep learning models with differential privacy (hosted at opacus.ai). Opacus is designed for simplicity, flexibility, and speed. It provides a simple and user-friendly API, and enables machine learning practitioners to make a training pipeline private by adding as little as two lines to their code. It supports a wide variety of layers, including multi-head attention, convolution, LSTM, GRU (and generic RNN), and embedding, right out of the box and provides the means for supporting other user-defined layers. Opacus computes batched per-sample gradients, providing higher efficiency compared to the traditional "micro batch" approach. In this paper we present Opacus, detail the principles that drove its implementation and unique features, and benchmark it against other frameworks for training models with differential privacy as well as standard PyTorch.


title: A Novel Patch Convolutional Neural Network for View-based 3D Model Retrieval

abstract: Recently, many view-based 3D model retrieval methods have been proposed and have achieved state-of-the-art performance. Most of these methods focus on extracting more discriminative view-level features and effectively aggregating the multi-view images of a 3D model, but the latent relationship among these multi-view images is not fully explored. Thus, we tackle this problem from the perspective of exploiting the relationships between patch features to capture long-range associations among multi-view images. To capture associations among views, in this work, we propose a novel patch convolutional neural network (PCNN) for view-based 3D model retrieval. Specifically, we first employ a CNN to extract patch features of each view image separately. Secondly, a novel neural network module named PatchConv is designed to exploit intrinsic relationships between neighboring patches in the feature space to capture long-range associations among multi-view images. Then, an adaptive weighted view layer is further embedded into PCNN to automatically assign a weight to each view according to the similarity between each view feature and the view-pooling feature. Finally, a discrimination loss function is employed to extract the discriminative 3D model feature, which consists of softmax loss values generated by the fusion lassifier and the specific classifier. Extensive experimental results on two public 3D model retrieval benchmarks, namely, the ModelNet40, and ModelNet10, demonstrate that our proposed PCNN can outperform state-of-the-art approaches, with mAP alues of 93.67%, and 96.23%, respectively.


title: Finetuning Transformer Models to Build ASAG System

abstract: Research towards creating systems for automatic grading of student answers to quiz and exam questions in educational settings has been ongoing since 1966. Over the years, the problem was divided into many categories. Among them, grading text answers were divided into short answer grading, and essay grading. The goal of this work was to develop an ML-based short answer grading system. I hence built a system which uses finetuning on Roberta Large Model pretrained on STS benchmark dataset and have also created an interface to show the production readiness of the system. I evaluated the performance of the system on the Mohler extended dataset and SciEntsBank Dataset. The developed system achieved a Pearsons Correlation of 0.82 and RMSE of 0.7 on the Mohler Dataset which beats the SOTA performance on this dataset which is correlation of 0.805 and RMSE of 0.793. Additionally, Pearsons Correlation of 0.79 and RMSE of 0.56 was achieved on the SciEntsBank Dataset, which only reconfirms the robustness of the system. A few observations during achieving these results included usage of batch size of 1 produced better results than using batch size of 16 or 32 and using huber loss as loss function performed well on this regression task. The system was tried and tested on train and validation splits using various random seeds and still has been tweaked to achieve a minimum of 0.76 of correlation and a maximum 0.15 (out of 1) RMSE on any dataset.