title: Synchrony and Oscillatory Dynamics for a 2-D PDE-ODE Model of Diffusion-Sensing with Small Signaling Compartments

abstract: We analyze a class of cell-bulk coupled PDE-ODE models, motivated by quorum and diffusion sensing phenomena in microbial systems, that characterize communication between localized spatially segregated dynamically active signaling compartments that have a permeable boundary. Each cell secretes a signaling chemical into the bulk region at a constant rate and receives a feedback of the bulk chemical from the entire collection of cells. This global feedback, which activates signaling pathways within the cells, modifies the intracellular dynamics according to the external environment. The cell secretion and global feedback are regulated by permeability parameters across the cell membrane. For arbitrary reaction-kinetics within each cell, the method of matched asymptotic expansions is used in the limit of small cell radius to construct steady-state solutions of the PDE-ODE model, and to derive a globally coupled nonlinear matrix eigenvalue problem (GCEP) that characterizes the linear stability properties of the steady-states. In the limit of large bulk diffusivity an asymptotic analysis of the PDE-ODE model leads to a limiting ODE system for the spatial average of the concentration in the bulk region that is coupled to the intracellular dynamics within the cells. Results from the linear stability theory and ODE dynamics are illustrated for Sel'kov reaction-kinetics, where the kinetic parameters are chosen so that each cell is quiescent when uncoupled from the bulk medium. For various specific spatial configurations of cells, the linear stability theory is used to construct phase diagrams in parameter space characterizing where a switch-like emergence of intracellular oscillations can occur through a Hopf bifurcation.


title: Gravitational wave detectors with broadband high frequency sensitivity

abstract: The binary neutron star coalescence GW170817 was observed by gravitational wave detectors during the inspiral phase but sensitivity in the 1-5 kHz band was insufficient to observe the expected nuclear matter signature of the merger itself, and the process of black hole formation. This provides strong motivation for improving 1--5 kHz sensitivity which is currently limited by photon shot noise. Resonant enhancement by signal recycling normally improves the signal to noise ratio at the expense of bandwidth. The concept of optomechanical white light signal recycling (WLSR) has been proposed, but all schemes to date have been reliant on the development of suitable ultra-low mechanical loss components. Here for the first time we show demonstrated optomechanical resonator structures that meet the loss requirements for a WLSR interferometer with strain sensitivity below 10$^{-24}$ Hz$^{-1/2}$ at a few kHz. Experimental data for two resonators are combined with analytic models of 4km interferometers similar to LIGO, to demonstrate sensitivity enhancement across a much broader band of neutron star coalescence frequencies than dual-recycled Fabry-Perot Michelson detectors of the same length. One candidate resonator is a silicon nitride membrane acoustically isolated from the environment by a phononic crystal. The other is a single-crystal quartz lens that supports bulk acoustic longitudinal waves. Optical power requirements could prefer the membrane resonator, although the bulk acoustic wave resonator gives somewhat better thermal noise performance. Both could be implemented as add-on components to existing detectors.


title: Spatial-Spectral Manifold Embedding of Hyperspectral Data

abstract: In recent years, hyperspectral imaging, also known as imaging spectroscopy, has been paid an increasing interest in geoscience and remote sensing community. Hyperspectral imagery is characterized by very rich spectral information, which enables us to recognize the materials of interest lying on the surface of the Earth more easier. We have to admit, however, that high spectral dimension inevitably brings some drawbacks, such as expensive data storage and transmission, information redundancy, etc. Therefore, to reduce the spectral dimensionality effectively and learn more discriminative spectral low-dimensional embedding, in this paper we propose a novel hyperspectral embedding approach by simultaneously considering spatial and spectral information, called spatial-spectral manifold embedding (SSME). Beyond the pixel-wise spectral embedding approaches, SSME models the spatial and spectral information jointly in a patch-based fashion. SSME not only learns the spectral embedding by using the adjacency matrix obtained by similarity measurement between spectral signatures, but also models the spatial neighbours of a target pixel in hyperspectral scene by sharing the same weights (or edges) in the process of learning embedding. Classification is explored as a potential strategy to quantitatively evaluate the performance of learned embedding representations. Classification is explored as a potential application for quantitatively evaluating the performance of these hyperspectral embedding algorithms. Extensive experiments conducted on the widely-used hyperspectral datasets demonstrate the superiority and effectiveness of the proposed SSME as compared to several state-of-the-art embedding methods.


title: Effective Theory of Freeze-in Dark Matter

abstract: We perform a model independent study of freeze-in of massive particle dark matter (DM) by adopting an effective field theory framework. Considering the dark matter to be a gauge singlet Majorana fermion, odd under a stabilising symmetry $Z_2$ under which all standard model (SM) fields are even, we write down all possible DM-SM operators upto and including mass dimension eight. For simplicity of the numerical analysis we restrict ourselves only to the scalar operators in SM as well as in the dark sector. We calculate the DM abundance for each such dimension of operator considering both UV and IR freeze-in contributions which can arise before and after the electroweak symmetry breaking respectively. After constraining the cut-off scale and reheat temperature of the universe from the requirement of correct DM relic abundance, we also study the possibility of connecting the origin of neutrino mass to the same cut-off scale by virtue of lepton number violating Weinberg operators. We thus compare the bounds on such cut-off scale and corresponding reheat temperature required for UV freeze-in from the origin of light neutrino mass as well as from the requirement of correct DM relic abundance. We also briefly comment upon the possibilities of realising such DM-SM effective operators in a UV complete model.


title: Plasmonic tweezers based on connected nanoring apertures

abstract: The manipulation of microparticles using optical forces has led to many applications in the life and physical sciences. To extend optical trapping towards the nano-regime, in this work we demonstrate trapping of single nanoparticles in arrays of plasmonic coaxial nano-apertures with various inner disk configurations and theoretically estimate the associated forces. A high normalised experimental trap stiffness of 3.50fN/nm/mW for 20nm polystyrene particles is observed for an optimum design of 149nm for the nanodisk diameter at a trapping wavelength of 980nm. Theoretical simulations are used to interpret the enhancement of the observed trap stiffness. A quick particle trapping time of less than 8sec is obtained at a concentration of 14$\times$10$^{11}$ particles/ml with low incident laser intensity of 0.59mW/$\mu$m$^{2}$. This good trapping performance with fast delivery of nanoparticles to multiple trapping sites emerges from a combination of the enhanced electromagnetic near-field and spatial temperature increase. This work has applications in nanoparticle delivery and trapping with high accuracy, and bridges the gap between optical manipulation and nanofluidics.


title: Optical quantum memory with optically inaccessible noble-gas spins

abstract: Optical quantum memories, which store and preserve the quantum state of photons, rely on a coherent mapping of the photonic state onto matter states that are optically accessible. Here we outline a new physical mechanism to map the state of photons onto the long-lived but optically inaccessible collective state of noble-gas spins. The mapping employs the coherent spin-exchange interaction arising from random collisions with alkali vapor. We analyze optimal strategies for high-efficiency storage and retrieval of non-classical light at various parameter regimes. Based on these strategies, we identify feasible experimental conditions for realizing efficient quantum memories with noble-gas spins having hours-long coherence times at room temperature and above


title: Asymptotic dimension of minor-closed families and beyond

abstract: The asymptotic dimension of metric spaces is an important notion in geometric group theory introduced by Gromov. The metric spaces considered in this paper are the ones whose underlying spaces are the vertex-sets of graphs and whose metrics are the distance functions in graphs. A standard compactness argument shows that it suffices to consider the asymptotic dimension of classes of finite graphs. In this paper we prove that the asymptotic dimension of any proper minor-closed family, any class of graphs of bounded tree-width, and any class of graphs of bounded layered tree-width are at most 2, 1, and 2, respectively. The first result solves a question of Fujiwara and Papasoglu; the second and third results solve a number of questions of Bonamy, Bousquet, Esperet, Groenland, Pirot and Scott. These bounds for asymptotic dimension are optimal and improve a number of results in the literature. Our proofs can be transformed into linear or quadratic time algorithms for finding coverings witnessing the asymptotic dimension which is equivalent to finding weak diameter colorings for graphs. The key ingredient of our proof is a unified machinery about the asymptotic dimension of classes of graphs that have tree-decompositions of bounded adhesion over hereditary classes with known asymptotic dimension, which might be of independent interest.


title: Task-Level Curriculum Learning for Non-Autoregressive Neural Machine Translation

abstract: Non-autoregressive translation (NAT) achieves faster inference speed but at the cost of worse accuracy compared with autoregressive translation (AT). Since AT and NAT can share model structure and AT is an easier task than NAT due to the explicit dependency on previous target-side tokens, a natural idea is to gradually shift the model training from the easier AT task to the harder NAT task. To smooth the shift from AT training to NAT training, in this paper, we introduce semi-autoregressive translation (SAT) as intermediate tasks. SAT contains a hyperparameter k, and each k value defines a SAT task with different degrees of parallelism. Specially, SAT covers AT and NAT as its special cases: it reduces to AT when k = 1 and to NAT when k = N (N is the length of target sentence). We design curriculum schedules to gradually shift k from 1 to N, with different pacing functions and number of tasks trained at the same time. We called our method as task-level curriculum learning for NAT (TCL-NAT). Experiments on IWSLT14 De-En, IWSLT16 En-De, WMT14 En-De and De-En datasets show that TCL-NAT achieves significant accuracy improvements over previous NAT baselines and reduces the performance gap between NAT and AT models to 1-2 BLEU points, demonstrating the effectiveness of our proposed method.


title: Generating X-rays with orbital angular momentum in free-electron laser oscillator

abstract: The generation of light beams carrying orbital angular momentum (OAM) from a free-electron laser at short wavelengths has attracted considerable attention as a key resource in several fields and applications. Herein, we present a facile method to generate intense and coherent OAM beams from an X-ray free-electron laser oscillator (XFELO). We use the Bragg crystal as both a reflector as well as mode selector, in both longitudinal and transverse modes, which enables the specified resonance deviation that maximizes the single-pass gain of the high-order OAM mode of interest. This can allow the amplification and saturation of OAM beams in a typical XFELO configuration. Our results show that 150~$\mu$J fully coherent, hard-X-ray pulses carrying first-order OAM can be generated without utilizing any external elements such as optical mode converters or elliptically polarized undulators. This simple and straightforward method can pave the way for the further customization of the transverse-mode operation of X-ray free-electron laser oscillators.


title: Approximated solution of a differential-difference equation arising in number theory and applications to the linear sieve

abstract: We provide elementary and accurate numerical solutions to the differential-difference equation, which improves an explicit version of the linear sieve given by Nathanson.


title: A Privacy-Preserving Machine Learning Scheme Using EtC Images

abstract: We propose a privacy-preserving machine learning scheme with encryption-then-compression (EtC) images, where EtC images are images encrypted by using a block-based encryption method proposed for EtC systems with JPEG compression. In this paper, a novel property of EtC images is first discussed, although EtC ones was already shown to be compressible as a property. The novel property allows us to directly apply EtC images to machine learning algorithms non-specialized for computing encrypted data. In addition, the proposed scheme is demonstrated to provide no degradation in the performance of some typical machine learning algorithms including the support vector machine algorithm with kernel trick and random forests under the use of z-score normalization. A number of facial recognition experiments with are carried out to confirm the effectiveness of the proposed scheme.


title: Decompositions of the space of Riemannian metrics on a compact manifold with boundary

abstract: In this paper, for a compact manifold $M$ with non-empty boundary, we give a Koiso-type decomposition theorem, as well as an Ebin-type slice theorem, for the space of all Riemannian metrics on $M$ endowed with a fixed conformal class on the boundary. As a corollary, we give a characterization of relative Einstein metrics.


title: A direct reconstruction algorithm for the anisotropic inverse conductivity problem based on Calder\'on's method in the plane

abstract: A direct reconstruction algorithm based on Calder\'on's linearization method for the reconstruction of isotropic conductivities is proposed for anisotropic conductivities in two-dimensions. To overcome the non-uniqueness of the anisotropic inverse conductivity problem, the entries of the unperturbed anisotropic tensors are assumed known \emph{a priori}, and it remains to reconstruct the multiplicative scalar field. The quasi-conformal map in the plane facilitates the Calder\'on-based approach for anisotropic conductivities. The method is demonstrated on discontinuous radially symmetric conductivities of high and low contrast.


title: Complex Langevin calculations in QCD at finite density

abstract: We demonstrate that the complex Langevin method (CLM) enables calculations in QCD at finite density in a parameter regime in which conventional methods, such as the density of states method and the Taylor expansion method, are not applicable due to the severe sign problem. Here we use the plaquette gauge action with $\beta = 5.7$ and four-flavor staggered fermions with degenerate quark mass $m a = 0.01$ and nonzero quark chemical potential $\mu$. We confirm that a sufficient condition for correct convergence is satisfied for $\mu /T = 5.2 - 7.2$ on a $8^3 \times 16$ lattice and $\mu /T = 1.6 - 9.6$ on a $16^3 \times 32$ lattice. In particular, the expectation value of the quark number is found to have a plateau with respect to $\mu$ with the height of 24 for both lattices. This plateau can be understood from the Fermi distribution of quarks, and its height coincides with the degrees of freedom of a single quark with zero momentum, which is 3 (color) $\times$ 4 (flavor) $\times$ 2 (spin) $=24$. Our results may be viewed as the first step towards the formation of the Fermi sphere, which plays a crucial role in color superconductivity conjectured from effective theories.


title: Progressive Multi-stage Feature Mix for Person Re-Identification

abstract: Image features from a small local region often give strong evidence in person re-identification task. However, CNN suffers from paying too much attention on the most salient local areas, thus ignoring other discriminative clues, e.g., hair, shoes or logos on clothes. %BDB proposes to randomly drop one block in a batch to enlarge the high response areas. Although BDB has achieved remarkable results, there still room for improvement. In this work, we propose a Progressive Multi-stage feature Mix network (PMM), which enables the model to find out the more precise and diverse features in a progressive manner. Specifically, 1. to enforce the model to look for different clues in the image, we adopt a multi-stage classifier and expect that the model is able to focus on a complementary region in each stage. 2. we propose an Attentive feature Hard-Mix (A-Hard-Mix) to replace the salient feature blocks by the negative example in the current batch, whose label is different from the current sample. 3. extensive experiments have been carried out on reID datasets such as the Market-1501, DukeMTMC-reID and CUHK03, showing that the proposed method can boost the re-identification performance significantly.


title: Kinetic functions for nonclassical shocks, entropy stability, and discrete summation by parts

abstract: We study nonlinear hyperbolic conservation laws with non-convex flux in one space dimension and, for a broad class of numerical methods based on summation by parts operators, we compute numerically the kinetic functions associated with each scheme. As established by LeFloch and collaborators, kinetic functions (for continuous or discrete models) uniquely characterize the macro-scale dynamics of small-scale dependent, undercompressive, nonclassical shock waves. We show here that various entropy-dissipative numerical schemes can yield nonclassical solutions containing classical shocks, including Fourier methods with (super-) spectral viscosity, finite difference schemes with artificial dissipation, discontinuous Galerkin schemes with or without modal filtering, and TeCNO schemes. We demonstrate numerically that entropy stability does not imply uniqueness of the limiting numerical solutions for scalar conservation laws in one space dimension, and we compute the associated kinetic functions in order to distinguish between these schemes. In addition, we design entropy-dissipative schemes for the Keyfitz-Kranzer system whose solutions are measures with delta shocks. This system illustrates the fact that entropy stability does not imply boundedness under grid refinement.


title: Mixing Real and Synthetic Data to Enhance Neural Network Training -- A Review of Current Approaches

abstract: Deep neural networks have gained tremendous importance in many computer vision tasks. However, their power comes at the cost of large amounts of annotated data required for supervised training. In this work we review and compare different techniques available in the literature to improve training results without acquiring additional annotated real-world data. This goal is mostly achieved by applying annotation-preserving transformations to existing data or by synthetically creating more data.


title: Distinguishing level-1 phylogenetic networks on the basis of data generated by Markov processes

abstract: Phylogenetic networks can represent evolutionary events that cannot be described by phylogenetic trees. These networks are able to incorporate reticulate evolutionary events such as hybridization, introgression, and lateral gene transfer. Recently, network-based Markov models of DNA sequence evolution have been introduced along with model-based methods for reconstructing phylogenetic networks. For these methods to be consistent, the network parameter needs to be identifiable from data generated under the model. Here, we show that the semi-directed network parameter of a triangle-free, level-1 network model with any fixed number of reticulation vertices is generically identifiable under the Jukes-Cantor, Kimura 2-parameter, or Kimura 3-parameter constraints.


title: Deep Learning Based Traffic Surveillance System For Missing and Suspicious Car Detection

abstract: Vehicle theft is arguably one of the fastest-growing types of crime in India. In some of the urban areas, vehicle theft cases are believed to be around 100 each day. Identification of stolen vehicles in such precarious scenarios is not possible using traditional methods like manual checking and radio frequency identification(RFID) based technologies. This paper presents a deep learning based automatic traffic surveillance system for the detection of stolen/suspicious cars from the closed circuit television(CCTV) camera footage. It mainly comprises of four parts: Select-Detector, Image Quality Enhancer, Image Transformer, and Smart Recognizer. The Select-Detector is used for extracting the frames containing vehicles and to detect the license plates much efficiently with minimum time complexity. The quality of the license plates is then enhanced using Image Quality Enhancer which uses pix2pix generative adversarial network(GAN) for enhancing the license plates that are affected by temporal changes like low light, shadow, etc. Image Transformer is used to tackle the problem of inefficient recognition of license plates which are not horizontal(which are at an angle) by transforming the license plate to different levels of rotation and cropping. Smart Recognizer recognizes the license plate number using Tesseract optical character recognition(OCR) and corrects the wrongly recognized characters using Error-Detector. The effectiveness of the proposed approach is tested on the government's CCTV camera footage, which resulted in identifying the stolen/suspicious cars with an accuracy of 87%.


title: Optimal Algorithm for the Planar Two-Center Problem

abstract: We study a fundamental problem in Computational Geometry, the planar two-center problem. In this problem, the input is a set $S$ of $n$ points in the plane and the goal is to find two smallest congruent disks whose union contains all points of $S$. A longstanding open problem has been to obtain an $O(n\log n)$-time algorithm for planar two-center, matching the $\Omega(n\log n)$ lower bound given by Eppstein [SODA'97]. Towards this, researchers have made a lot of efforts over decades. The previous best algorithm, given by Wang [SoCG'20], solves the problem in $O(n\log^2 n)$ time. In this paper, we present an $O(n\log n)$-time (deterministic) algorithm for planar two-center, which completely resolves this open problem.


title: Learning Posterior and Prior for Uncertainty Modeling in Person Re-Identification

abstract: Data uncertainty in practical person reID is ubiquitous, hence it requires not only learning the discriminative features, but also modeling the uncertainty based on the input. This paper proposes to learn the sample posterior and the class prior distribution in the latent space, so that not only representative features but also the uncertainty can be built by the model. The prior reflects the distribution of all data in the same class, and it is the trainable model parameters. While the posterior is the probability density of a single sample, so it is actually the feature defined on the input. We assume that both of them are in Gaussian form. To simultaneously model them, we put forward a distribution loss, which measures the KL divergence from the posterior to the priors in the manner of supervised learning. In addition, we assume that the posterior variance, which is essentially the uncertainty, is supposed to have the second-order characteristic. Therefore, a $\Sigma-$net is proposed to compute it by the high order representation from its input. Extensive experiments have been carried out on Market1501, DukeMTMC, MARS and noisy dataset as well.


title: Cross-Identity Motion Transfer for Arbitrary Objects through Pose-Attentive Video Reassembling

abstract: We propose an attention-based networks for transferring motions between arbitrary objects. Given a source image(s) and a driving video, our networks animate the subject in the source images according to the motion in the driving video. In our attention mechanism, dense similarities between the learned keypoints in the source and the driving images are computed in order to retrieve the appearance information from the source images. Taking a different approach from the well-studied warping based models, our attention-based model has several advantages. By reassembling non-locally searched pieces from the source contents, our approach can produce more realistic outputs. Furthermore, our system can make use of multiple observations of the source appearance (e.g. front and sides of faces) to make the results more accurate. To reduce the training-testing discrepancy of the self-supervised learning, a novel cross-identity training scheme is additionally introduced. With the training scheme, our networks is trained to transfer motions between different subjects, as in the real testing scenario. Experimental results validate that our method produces visually pleasing results in various object domains, showing better performances compared to previous works.


title: Adaptive Exact Learning in a Mixed-Up World: Dealing with Periodicity, Errors and Jumbled-Index Queries in String Reconstruction

abstract: We study the query complexity of exactly reconstructing a string from adaptive queries, such as substring, subsequence, and jumbled-index queries. Such problems have applications, e.g., in computational biology. We provide a number of new and improved bounds for exact string reconstruction for settings where either the string or the queries are "mixed-up". For example, we show that a periodic (i.e., "mixed-up") string, $S=p^kp'$, of smallest period $p$, where $|p'|<|p|$, can be reconstructed using $O(\sigma|p|+\lg n)$ substring queries, where $\sigma$ is the alphabet size, if $n=|S|$ is unknown. We also show that we can reconstruct $S$ after having been corrupted by a small number of errors $d$, measured by Hamming distance. In this case, we give an algorithm that uses $O(d\sigma|p| + d|p|\lg \frac{n}{d+1})$ queries. In addition, we show that a periodic string can be reconstructed using $2\sigma\lceil\lg n\rceil + 2|p|\lceil\lg \sigma\rceil$ subsequence queries, and that general strings can be reconstructed using $2\sigma\lceil\lg n\rceil + n\lceil\lg \sigma\rceil$ subsequence queries, without knowledge of $n$ in advance. This latter result improves the previous best, decades-old result, by Skiena and Sundaram. Finally, we believe we are the first to study the exact-learning query complexity for string reconstruction using jumbled-index queries, which are a "mixed-up" typeA of query that have received much attention of late.


title: Puzzling bubble rise speed increase in dense granular suspensions

abstract: We present an anomalous experimental observation on the rising speed of air bubbles in a Hele-Shaw cell containing a suspension of spherical, neutrally-buoyant, non-Brownian particles. Strikingly, bubbles rise faster in suspensions as compared to particle-less liquids of the same effective viscosity. By carefully measuring this bubble speed increase at various particle volume fraction and via velocity field imaging, we demonstrate that this strange bubble dynamics is linked to a reduction in the bulk dissipation rate. A good match between our experimental data and computations based on Suspension Balance Model illustrates that the underlying mechanism for this dissipation-rate-deficit is related to a non-uniform particle distribution in the direction perpendicular to the channel walls due to shear-induced particle migration.


title: An ensemble classifier for vibration-based quality monitoring

abstract: Vibration-based quality monitoring of manufactured components often employs pattern recognition methods. Albeit developing several classification methods, they usually provide high accuracy for specific types of datasets, but not for general cases. In this paper, this issue has been addressed by developing a novel ensemble classifier based on the Dempster-Shafer theory of evidence. To deal with conflicting evidences, three remedies are proposed prior to combination: (i) selection of proper classifiers by evaluating the relevancy between the predicted and target outputs, (ii) devising an optimization method to minimize the distance between the predicted and target outputs, (iii) utilizing five different weighting factors, including a new one, to enhance the fusion performance. The effectiveness of the proposed framework is validated by its application to 15 UCI and KEEL machine learning datasets. It is then applied to two vibration-based datasets to detect defected samples: one synthetic dataset generated from the finite element model of a dogbone cylinder, and one real experimental dataset generated by collecting broadband vibrational response of polycrystalline Nickel alloy first-stage turbine blades. The investigation is made through statistical analysis in presence of different levels of noise-to-signal ratio. Comparing the results with those of four state-of-the-art fusion techniques reveals the good performance of the proposed ensemble method.


title: Explanation-Guided Training for Cross-Domain Few-Shot Classification

abstract: Cross-domain few-shot classification task (CD-FSC) combines few-shot classification with the requirement to generalize across domains represented by datasets. This setup faces challenges originating from the limited labeled data in each class and, additionally, from the domain shift between training and test sets. In this paper, we introduce a novel training approach for existing FSC models. It leverages on the explanation scores, obtained from existing explanation methods when applied to the predictions of FSC models, computed for intermediate feature maps of the models. Firstly, we tailor the layer-wise relevance propagation (LRP) method to explain the predictions of FSC models. Secondly, we develop a model-agnostic explanation-guided training strategy that dynamically finds and emphasizes the features which are important for the predictions. Our contribution does not target a novel explanation method but lies in a novel application of explanations for the training phase. We show that explanation-guided training effectively improves the model generalization. We observe improved accuracy for three different FSC models: RelationNet, cross attention network, and a graph neural network-based formulation, on five few-shot learning datasets: miniImagenet, CUB, Cars, Places, and Plantae. The source code is available at https://github.com/SunJiamei/few-shot-lrp-guided


title: Spatial Resolution Enhancement of Remote Sensing Mine Images using Deep Learning Techniques

abstract: Deep learning techniques are applied so as to increase the spatial resolution of Sentinel2 satellite imagery, depicting the Amynteo lignite mine in Ptolemaida, Greece. Resolution enhancement by factors 2 and 4 as well as by factors 2 and 6 using Very-Deep SuperResolution (VDSR) and DSen2 networks, respectively, provides fairly well results on Amynteo lignite mine images.


title: Uncertainty Quantification and Deep Ensembles

abstract: Deep Learning methods are known to suffer from calibration issues: they typically produce over-confident estimates. These problems are exacerbated in the low data regime. Although the calibration of probabilistic models is well studied, calibrating extremely over-parametrized models in the low-data regime presents unique challenges. We show that deep-ensembles do not necessarily lead to improved calibration properties. In fact, we show that standard ensembling methods, when used in conjunction with modern techniques such as mixup regularization, can lead to less calibrated models. This text examines the interplay between three of the most simple and commonly used approaches to leverage deep learning when data is scarce: data-augmentation, ensembling, and post-processing calibration methods. Although standard ensembling techniques certainly help boost accuracy, we demonstrate that the calibration of deep ensembles relies on subtle trade-offs. We also find that calibration methods such as temperature scaling need to be slightly tweaked when used with deep-ensembles and, crucially, need to be executed after the averaging process. Our simulations indicate that this simple strategy can halve the Expected Calibration Error (ECE) on a range of benchmark classification problems compared to standard deep-ensembles in the low data regime.


title: Towards Enabling Critical mMTC: A Review of URLLC within mMTC

abstract: Massive machine-type communication (mMTC) and ultra-reliable and low-latency communication (URLLC) are two key service types in the fifth-generation (5G) communication systems, pursuing scalability and reliability with low-latency, respectively. These two extreme services are envisaged to agglomerate together into \emph{critical mMTC} shortly with emerging use cases (e.g., wide-area disaster monitoring, wireless factory automation), creating new challenges to designing wireless systems beyond 5G. While conventional network slicing is effective in supporting a simple mixture of mMTC and URLLC, it is difficult to simultaneously guarantee the reliability, latency, and scalability requirements of critical mMTC (e.g., < 4ms latency, $10^6$ devices/km$^2$ for factory automation) with limited radio resources. Furthermore, recently proposed solutions to scalable URLLC (e.g., machine learning aided URLLC for driverless vehicles) are ill-suited to critical mMTC whose machine type users have minimal energy budget and computing capability that should be (tightly) optimized for given tasks. To this end, our paper aims to characterize promising use cases of critical mMTC and search for their possible solutions. To this end, we first review the state-of-the-art (SOTA) technologies for separate mMTC and URLLC services and then identify key challenges from conflicting SOTA requirements, followed by potential approaches to prospective critical mMTC solutions at different layers.


title: Discovering Reinforcement Learning Algorithms

abstract: Reinforcement learning (RL) algorithms update an agent's parameters according to one of several possible rules, discovered manually through years of research. Automating the discovery of update rules from data could lead to more efficient algorithms, or algorithms that are better adapted to specific environments. Although there have been prior attempts at addressing this significant scientific challenge, it remains an open question whether it is feasible to discover alternatives to fundamental concepts of RL such as value functions and temporal-difference learning. This paper introduces a new meta-learning approach that discovers an entire update rule which includes both 'what to predict' (e.g. value functions) and 'how to learn from it' (e.g. bootstrapping) by interacting with a set of environments. The output of this method is an RL algorithm that we call Learned Policy Gradient (LPG). Empirical results show that our method discovers its own alternative to the concept of value functions. Furthermore it discovers a bootstrapping mechanism to maintain and use its predictions. Surprisingly, when trained solely on toy environments, LPG generalises effectively to complex Atari games and achieves non-trivial performance. This shows the potential to discover general RL algorithms from data.


title: INDRA: Intrusion Detection using Recurrent Autoencoders in Automotive Embedded Systems

abstract: Today's vehicles are complex distributed embedded systems that are increasingly being connected to various external systems. Unfortunately, this increased connectivity makes the vehicles vulnerable to security attacks that can be catastrophic. In this work, we present a novel Intrusion Detection System (IDS) called INDRA that utilizes a Gated Recurrent Unit (GRU) based recurrent autoencoder to detect anomalies in Controller Area Network (CAN) bus-based automotive embedded systems. We evaluate our proposed framework under different attack scenarios and also compare it with the best known prior works in this area.


title: Projected WIMP Sensitivity of the XENONnT Dark Matter Experiment

abstract: XENONnT is a dark matter direct detection experiment, utilizing 5.9 t of instrumented liquid xenon, located at the INFN Laboratori Nazionali del Gran Sasso. In this work, we predict the experimental background and project the sensitivity of XENONnT to the detection of weakly interacting massive particles (WIMPs). The expected average differential background rate in the energy region of interest, corresponding to (1, 13) keV and (4, 50) keV for electronic and nuclear recoils, amounts to $12.3 \pm 0.6$ (keV t y)$^{-1}$ and $(2.2\pm 0.5)\times 10^{-3}$ (keV t y)$^{-1}$, respectively, in a 4 t fiducial mass. We compute unified confidence intervals using the profile construction method, in order to ensure proper coverage. With the exposure goal of 20 t$\,$y, the expected sensitivity to spin-independent WIMP-nucleon interactions reaches a cross-section of $1.4\times10^{-48}$ cm$^2$ for a 50 GeV/c$^2$ mass WIMP at 90% confidence level, more than one order of magnitude beyond the current best limit, set by XENON1T. In addition, we show that for a 50 GeV/c$^2$ WIMP with cross-sections above $2.6\times10^{-48}$ cm$^2$ ($5.0\times10^{-48}$ cm$^2$) the median XENONnT discovery significance exceeds 3$\sigma$ (5$\sigma$). The expected sensitivity to the spin-dependent WIMP coupling to neutrons (protons) reaches $2.2\times10^{-43}$ cm$^2$ ($6.0\times10^{-42}$ cm$^2$).


title: Long-time behavior and darwinian optimality for an asymmetric size-structured branching process

abstract: We study the long time behavior of an asymmetric size-structured measure-valued growth-fragmentation branching process that models the dynamics of a population of cells taking into account physiological and morphological asymmetry at division. We show that the process exhibits a Malthusian behavior; that is that the global population size grows exponentially fast and that the trait distribution of individuals converges to some stable distribution. The proof is based on a generalization of Lyapunov function techniques for non-conservative semi-groups. We then investigate the fluctuations of the growth rate with respect to the parameters guiding asymmetry. In particular, we exhibit that, under some special assumptions, asymmetric division is optimal in a Darwinian sense.


title: On cosets weight distributions of the doubly-extended Reed-Solomon codes of codimension 4

abstract: We consider the $[q+1,q-3,5]_q3$ generalized doubly-extended Reed-Solomon code of codimension $4$ as the code associated with the twisted cubic in the projective space $\mathrm{PG}(3,q)$. Basing on the point-plane incidence matrix of $\mathrm{PG}(3,q)$, we obtain the number of weight 3 vectors in all the cosets of the considered code. This allows us to classify the cosets by their weight distributions and to obtain these distributions. The weight of a coset is the smallest Hamming weight of any vector in the coset. For the cosets of equal weight having distinct weight distributions, we prove that the difference between the $w$-th components, $3<w\le q+1$, of the distributions is uniquely determined by the difference between the $3$-rd components. This implies an interesting (and in some sense unexpected) symmetry of the obtained distributions.


title: Self-Supervised Bernoulli Autoencoders for Semi-Supervised Hashing

abstract: Semantic hashing is an emerging technique for large-scale similarity search based on representing high-dimensional data using similarity-preserving binary codes used for efficient indexing and search. It has recently been shown that variational autoencoders, with Bernoulli latent representations parametrized by neural nets, can be successfully trained to learn such codes in supervised and unsupervised scenarios, improving on more traditional methods thanks to their ability to handle the binary constraints architecturally. However, the scenario where labels are scarce has not been studied yet. This paper investigates the robustness of hashing methods based on variational autoencoders to the lack of supervision, focusing on two semi-supervised approaches currently in use. The first augments the variational autoencoder's training objective to jointly model the distribution over the data and the class labels. The second approach exploits the annotations to define an additional pairwise loss that enforces consistency between the similarity in the code (Hamming) space and the similarity in the label space. Our experiments show that both methods can significantly increase the hash codes' quality. The pairwise approach can exhibit an advantage when the number of labelled points is large. However, we found that this method degrades quickly and loses its advantage when labelled samples decrease. To circumvent this problem, we propose a novel supervision method in which the model uses its label distribution predictions to implement the pairwise objective. Compared to the best baseline, this procedure yields similar performance in fully supervised settings but improves the results significantly when labelled data is scarce. Our code is made publicly available at https://github.com/amacaluso/SSB-VAE.


title: Turns in Hamilton cycles of rectangular grids

abstract: For a Hamilton cycle in a rectangular $m \times n$ grid, what is the greatest number of turns that can occur? We give the exact answer in several cases and an answer up to an additive error of $2$ in all other cases. In particular, we give a new proof of the result of Beluhov for the case of a square $n \times n$ grid. Our main method is a surprising link between the problem of 'greatest number of turns' and the problem of 'least number of turns'.


title: Learning to Combine: Knowledge Aggregation for Multi-Source Domain Adaptation

abstract: Transferring knowledges learned from multiple source domains to target domain is a more practical and challenging task than conventional single-source domain adaptation. Furthermore, the increase of modalities brings more difficulty in aligning feature distributions among multiple domains. To mitigate these problems, we propose a Learning to Combine for Multi-Source Domain Adaptation (LtC-MSDA) framework via exploring interactions among domains. In the nutshell, a knowledge graph is constructed on the prototypes of various domains to realize the information propagation among semantically adjacent representations. On such basis, a graph model is learned to predict query samples under the guidance of correlated prototypes. In addition, we design a Relation Alignment Loss (RAL) to facilitate the consistency of categories' relational interdependency and the compactness of features, which boosts features' intra-class invariance and inter-class separability. Comprehensive results on public benchmark datasets demonstrate that our approach outperforms existing methods with a remarkable margin. Our code is available at \url{https://github.com/ChrisAllenMing/LtC-MSDA}


title: Learn to Propagate Reliably on Noisy Affinity Graphs

abstract: Recent works have shown that exploiting unlabeled data through label propagation can substantially reduce the labeling cost, which has been a critical issue in developing visual recognition models. Yet, how to propagate labels reliably, especially on a dataset with unknown outliers, remains an open question. Conventional methods such as linear diffusion lack the capability of handling complex graph structures and may perform poorly when the seeds are sparse. Latest methods based on graph neural networks would face difficulties on performance drop as they scale out to noisy graphs. To overcome these difficulties, we propose a new framework that allows labels to be propagated reliably on large-scale real-world data. This framework incorporates (1) a local graph neural network to predict accurately on varying local structures while maintaining high scalability, and (2) a confidence-based path scheduler that identifies outliers and moves forward the propagation frontier in a prudent way. Experiments on both ImageNet and Ms-Celeb-1M show that our confidence guided framework can significantly improve the overall accuracies of the propagated labels, especially when the graph is very noisy.


title: Privacy-Preserving Distributed Learning in the Analog Domain

abstract: We consider the critical problem of distributed learning over data while keeping it private from the computational servers. The state-of-the-art approaches to this problem rely on quantizing the data into a finite field, so that the cryptographic approaches for secure multiparty computing can then be employed. These approaches, however, can result in substantial accuracy losses due to fixed-point representation of the data and computation overflows. To address these critical issues, we propose a novel algorithm to solve the problem when data is in the analog domain, e.g., the field of real/complex numbers. We characterize the privacy of the data from both information-theoretic and cryptographic perspectives, while establishing a connection between the two notions in the analog domain. More specifically, the well-known connection between the distinguishing security (DS) and the mutual information security (MIS) metrics is extended from the discrete domain to the continues domain. This is then utilized to bound the amount of information about the data leaked to the servers in our protocol, in terms of the DS metric, using well-known results on the capacity of single-input multiple-output (SIMO) channel with correlated noise. It is shown how the proposed framework can be adopted to do computation tasks when data is represented using floating-point numbers. We then show that this leads to a fundamental trade-off between the privacy level of data and accuracy of the result. As an application, we also show how to train a machine learning model while keeping the data as well as the trained model private. Then numerical results are shown for experiments on the MNIST dataset. Furthermore, experimental advantages are shown comparing to fixed-point implementations over finite fields.


title: Pricing equity-linked life insurance contracts with multiple risk factors by neural networks

abstract: This paper considers the pricing of equity-linked life insurance contracts with death and survival benefits in a general model with multiple stochastic risk factors: interest rate, equity, volatility, unsystematic and systematic mortality. We price the equity-linked contracts by assuming that the insurer hedges the risks to reduce the local variance of the net asset value process and requires a compensation for the non-hedgeable part of the liability in the form of an instantaneous standard deviation risk margin. The price can then be expressed as the solution of a system of non-linear partial differential equations. We reformulate the problem as a backward stochastic differential equation with jumps and solve it numerically by the use of efficient neural networks. Sensitivity analysis is performed with respect to initial parameters and an analysis of the accuracy of the approximation of the true price with our neural networks is provided.


title: Fundamental Scale Invariance

abstract: We propose fundamental scale invariance as a new theoretical principle beyond renormalizability. Quantum field theories with fundamental scale invariance admit a scale-free formulation of the functional integral and effective action in terms of scale invariant fields. They correspond to exact scaling solutions of functional renormalization flow equations. Such theories are highly predictive since all relevant parameters for deviations from the exact scaling solution vanish. Realistic particle physics and quantum gravity are compatible with this setting. The non-linear restrictions for scaling solutions can explain properties as an asymptotically vanishing cosmological constant or dynamical dark energy that would seem to need fine tuning of parameters from a perturbative viewpoint. As an example we discuss a pregeometry based on a diffeomorphism invariant Yang-Mills theory. It is a candidate for an ultraviolet completion of quantum gravity with a well behaved graviton propagator at short distances.


title: Large random matrix approach for testing independence of a large number of Gaussian time series

abstract: The asymptotic behaviour of Linear Spectral Statistics (LSS) of the smoothed periodogram estimator of the spectral coherency matrix of a complex Gaussian high-dimensional time series $(\y_n)_{n \in \mathbb{Z}}$ with independent components is studied under the asymptotic regime where the sample size $N$ converges towards $+\infty$ while the dimension $M$ of $\y$ and the smoothing span of the estimator grow to infinity at the same rate in such a way that $\frac{M}{N} \rightarrow 0$. It is established that, at each frequency, the estimated spectral coherency matrix is close from the sample covariance matrix of an independent identically $\mathcal{N}_{\mathbb{C}}(0,\I_M)$ distributed sequence, and that its empirical eigenvalue distribution converges towards the Marcenko-Pastur distribution. This allows to conclude that each LSS has a deterministic behaviour that can be evaluated explicitly. Using concentration inequalities, it is shown that the order of magnitude of the supremum over the frequencies of the deviation of each LSS from its deterministic approximation is of the order of $\frac{1}{M} + \frac{\sqrt{M}}{N}+ (\frac{M}{N})^{3}$ where $N$ is the sample size. Numerical simulations supports our results.


title: On the frequency domain detection of high dimensional time series

abstract: In this paper, we address the problem of detection, in the frequency domain, of a M-dimensional time series modeled as the output of a M x K MIMO filter driven by a K-dimensional Gaussian white noise, and disturbed by an additive M-dimensional Gaussian colored noise. We consider the study of test statistics based of the Spectral Coherence Matrix (SCM) obtained as renormalization of the smoothed periodogram matrix of the observed time series over N samples, and with smoothing span B. To that purpose, we consider the asymptotic regime in which M, B, N all converge to infinity at certain specific rates, while K remains fixed. We prove that the SCM may be approximated in operator norm by a correlated Wishart matrix, for which Random Matrix Theory (RMT) provides a precise description of the asymptotic behaviour of the eigenvalues. These results are then exploited to study the consistency of a test based on the largest eigenvalue of the SCM, and provide some numerical illustrations to evaluate the statistical performance of such a test.


title: A highly accurate boundary integral method for the elastic obstacle scattering problem

abstract: Consider the scattering of a time-harmonic plane wave by a rigid obstacle embedded in a homogeneous and isotropic elastic medium in two dimensions. In this paper, a novel boundary integral formulation is proposed and its highly accurate numerical method is developed for the elastic obstacle scattering problem. More specifically, based on the Helmholtz decomposition, the model problem is reduced to a coupled boundary integral equation with singular kernels. A regularized system is constructed in order to handle the degenerated integral operators. The semi-discrete and full-discrete schemes are studied for the boundary integral system by using the trigonometric collocation method. Convergence is established for the numerical schemes in some appropriate Sobolev spaces. Numerical experiments are presented for both smooth and nonsmooth obstacles to demonstrate the superior performance of the proposed method.


title: SumGraph: Video Summarization via Recursive Graph Modeling

abstract: The goal of video summarization is to select keyframes that are visually diverse and can represent a whole story of an input video. State-of-the-art approaches for video summarization have mostly regarded the task as a frame-wise keyframe selection problem by aggregating all frames with equal weight. However, to find informative parts of the video, it is necessary to consider how all the frames of the video are related to each other. To this end, we cast video summarization as a graph modeling problem. We propose recursive graph modeling networks for video summarization, termed SumGraph, to represent a relation graph, where frames are regarded as nodes and nodes are connected by semantic relationships among frames. Our networks accomplish this through a recursive approach to refine an initially estimated graph to correctly classify each node as a keyframe by reasoning the graph representation via graph convolutional networks. To leverage SumGraph in a more practical environment, we also present a way to adapt our graph modeling in an unsupervised fashion. With SumGraph, we achieved state-of-the-art performance on several benchmarks for video summarization in both supervised and unsupervised manners.


title: A H\"olderian backtracking method for min-max and min-min problems

abstract: We present a new algorithm to solve min-max or min-min problems out of the convex world. We use rigidity assumptions, ubiquitous in learning, making our method applicable to many optimization problems. Our approach takes advantage of hidden regularity properties and allows us to devise a simple algorithm of ridge type. An original feature of our method is to come with automatic step size adaptation which departs from the usual overly cautious backtracking methods. In a general framework, we provide convergence theoretical guarantees and rates. We apply our findings on simple GAN problems obtaining promising numerical results.


title: Parameterized Complexity of Graph Burning

abstract: Graph Burning asks, given a graph $G = (V,E)$ and an integer $k$, whether there exists $(b_{0},\dots,b_{k-1}) \in V^{k}$ such that every vertex in $G$ has distance at most $i$ from some $b_{i}$. This problem is known to be NP-complete even on connected caterpillars of maximum degree $3$. We study the parameterized complexity of this problem and answer all questions arose by Kare and Reddy [IWOCA 2019] about parameterized complexity of the problem. We show that the problem is W[2]-complete parameterized by $k$ and that it does no admit a polynomial kernel parameterized by vertex cover number unless $\mathrm{NP} \subseteq \mathrm{coNP/poly}$. We also show that the problem is fixed-parameter tractable parameterized by clique-width plus the maximum diameter among all connected components. This implies the fixed-parameter tractability parameterized by modular-width, by treedepth, and by distance to cographs. Although the parameterization by distance to split graphs cannot be handled with the clique-width argument, we show that this is also tractable by a reduction to a generalized problem with a smaller solution size.


title: Latent Instrumental Variables as Priors in Causal Inference based on Independence of Cause and Mechanism

abstract: Causal inference methods based on conditional independence construct Markov equivalent graphs, and cannot be applied to bivariate cases. The approaches based on independence of cause and mechanism state, on the contrary, that causal discovery can be inferred for two observations. In our contribution, we challenge to reconcile these two research directions. We study the role of latent variables such as latent instrumental variables and hidden common causes in the causal graphical structures. We show that the methods based on the independence of cause and mechanism, indirectly contain traces of the existence of the hidden instrumental variables. We derive a novel algorithm to infer causal relationships between two variables, and we validate the proposed method on simulated data and on a benchmark of cause-effect pairs. We illustrate by our experiments that the proposed approach is simple and extremely competitive in terms of empirical accuracy compared to the state-of-the-art methods.


title: Intrusion Detection in Binary Process Data: Introducing the Hamming-distance to Matrix Profiles

abstract: The digitisation of industry provides a plethora of novel applications that increase flexibility and reduce setup and maintenance time as well as cost. Furthermore, novel use cases are created by the digitisation of industry, commonly known as Industry 4.0 or the Industrial Internet of Things, applications make use of communication and computation technology that is becoming available. This enables novel business use cases, such as the digital twin, customer individual production, and data market places. However, the inter-connectivity such use cases rely on also significantly increases the attack surface of industrial enterprises. Sabotage and espionage are aimed at data, which is becoming the most crucial asset of an enterprise. Since the requirements on security solutions in industrial networks are inherently different from office networks, novel approaches for intrusion detection need to be developed. In this work, process data of a real water treatment process that contains attacks is analysed. Analysis is performed by an extension of Matrix Profiles, a motif discovery algorithm for time series. By extending Matrix Profiles with a Hammingdistance metric, binary and tertiary actuators can be integrated into the analysis in a meaningful fashion. This algorithm requires low training effort while providing accurate results. Furthermore, it can be employed in a real-time fashion. Selected actuators in the data set are analysed to highlight the applicability of the extended Matrix Profiles.


title: Visual Relation Grounding in Videos

abstract: In this paper, we explore a novel task named visual Relation Grounding in Videos (vRGV). The task aims at spatio-temporally localizing the given relations in the form of subject-predicate-object in the videos, so as to provide supportive visual facts for other high-level video-language tasks (e.g., video-language grounding and video question answering). The challenges in this task include but not limited to: (1) both the subject and object are required to be spatio-temporally localized to ground a query relation; (2) the temporal dynamic nature of visual relations in videos is difficult to capture; and (3) the grounding should be achieved without any direct supervision in space and time. To ground the relations, we tackle the challenges by collaboratively optimizing two sequences of regions over a constructed hierarchical spatio-temporal region graph through relation attending and reconstruction, in which we further propose a message passing mechanism by spatial attention shifting between visual entities. Experimental results demonstrate that our model can not only outperform baseline approaches significantly, but also produces visually meaningful facts to support visual grounding. (Code is available at https://github.com/doc-doc/vRGV).


title: Limits of random walks with distributionally robust transition probabilities

abstract: We consider a nonlinear random walk which, in each time step, is free to choose its own transition probability within a neighborhood (w.r.t. Wasserstein distance) of the transition probability of a fixed L\'evy process. In analogy to the classical framework we show that, when passing from discrete to continuous time via a scaling limit, this nonlinear random walk gives rise to a nonlinear semigroup. We explicitly compute the generator of this semigroup and corresponding PDE as a perturbation of the generator of the initial L\'evy process.


title: Pressure at infinity and strong positive recurrence in negative curvature

abstract: In the context of geodesic flows of noncompact negatively curved manifolds, we propose three different definitions of entropy and pressure at infinity, through growth of periodic orbits, critical exponents of Poincar\'e series, and entropy (pressure) of invariant measures. We show that these notions coincide. Thanks to these entropy and pressure at infinity, we investigate thoroughly the notion of strong positive recurrence in this geometric context. A potential is said strongly positively recurrent when its pressure at infinity is strictly smaller than the full topological pressure. We show in particular that if a potential is strongly positively recurrent, then it admits a finite Gibbs measure. We also provide easy criteria allowing to build such strong positively recurrent potentials and many examples.


title: Parameter Optimization of Light Outcoupling Structures for High-Efficiency Organic Light-Emitting Diodes

abstract: Organic light-emitting diodes (OLEDs) have successfully entered the display market and continue to be attractive for many other applications. As state-of-the-art OLEDs can reach an internal quantum efficiency (IQE) of almost 100 %, light outcoupling remains one of the major screws left to be turned. The fact that no superior outcoupling structure has been found underlines that further investigations are needed to understand their prospect. In this paper, we use two-dimensional titanium dioxide (2D TiO$_2$) block arrays as a model of an internal light outcoupling structure and investigate the influence of its geometrical parameters on achieving the highest external quantum efficiency (EQE) for OLEDs. The multivariable problem is evaluated with the visual assistance of scatter plots, which enables us to propose an optimal period range and block width-to-distance ratio. The highest EQE achieved is 45.2 % with internal and external structures. This work contributes to the highly desired prediction of ideal light outcoupling structures in the future.


title: Neural Architecture Search For LF-MMI Trained Time Delay Neural Networks

abstract: Deep neural networks (DNNs) based automatic speech recognition (ASR) systems are often designed using expert knowledge and empirical evaluation. In this paper, a range of neural architecture search (NAS) techniques are used to automatically learn two types of hyper-parameters of state-of-the-art factored time delay neural networks (TDNNs): i) the left and right splicing context offsets; and ii) the dimensionality of the bottleneck linear projection at each hidden layer. These include the DARTS method integrating architecture selection with lattice-free MMI (LF-MMI) TDNN training; Gumbel-Softmax and pipelined DARTS reducing the confusion over candidate architectures and improving the generalization of architecture selection; and Penalized DARTS incorporating resource constraints to adjust the trade-off between performance and system complexity. Parameter sharing among candidate architectures allows efficient search over up to $7^{28}$ different TDNN systems. Experiments conducted on the 300-hour Switchboard corpus suggest the auto-configured systems consistently outperform the baseline LF-MMI TDNN systems using manual network design or random architecture search after LHUC speaker adaptation and RNNLM rescoring. Absolute word error rate (WER) reductions up to 1.0\% and relative model size reduction of 28\% were obtained. Consistent performance improvements were also obtained on a UASpeech disordered speech recognition task using the proposed NAS approaches.


title: Commutation of Shintani descent and Jordan decomposition

abstract: Let ${\mathbf G}^F$ be a finite group of Lie type, where ${\mathbf G}$ is a reductive group defined over ${\overline{\mathbb F}_q}$ and $F$ is a Frobenius root. Lusztig's Jordan decomposition parametrises the irreducible characters in a rational series${\mathcal E}({{\mathbf G}^F},(s)_{{\mathbf G}^{*F^*}})$ where $s\in{{\mathbf G}^{*F^*}}$ by the series ${\mathcal E}(C_{{\mathbf G}^*}(s)^{F^*},1)$.We conjecture that the Shintani twisting preserves the space of class functions generated by the union of the ${\mathcal E}({{\mathbf G}^F},(s')_{{\mathbf G}^{*F^*}})$ where$(s')_{{\mathbf G}^{*F^*}}$ runs over the semi-simple classes of ${{\mathbf G}^{*F^*}}$ geometrically conjugate to $s$;further, extending the Jordan decomposition by linearity to this space, we conjecture that there is a way to fix Jordan decomposition such that it maps the Shintani twisting to the Shintani twisting on disconnected groups defined by Deshpande, which acts on the linear span of $\coprod_{s'}{\mathcal E}(C_{{\mathbf G}^*}(s')^{F^*},1)$. We show a non-trivial case of this conjecture, the case where ${\mathbf G}$ is of type $A_{n-1}$with $n$ prime.


title: Independence versus Indetermination: basis of two canonical clustering criteria

abstract: This paper aims at comparing two coupling approaches as basic layers for building clustering criteria, suited for modularizing and clustering very large networks. We briefly use "optimal transport theory" as a starting point, and a way as well, to derive two canonical couplings: "statistical independence" and "logical indetermination". A symmetric list of properties is provided and notably the so called "Monge's properties", applied to contingency matrices, and justifying the $\otimes$ versus $\oplus$ notation. A study is proposed, highlighting "logical indetermination", because it is, by far, lesser known. Eventually we estimate the average difference between both couplings as the key explanation of their usually close results in network clustering.


title: Tackling scalability issues in mining path patterns from knowledge graphs: a preliminary study

abstract: Features mined from knowledge graphs are widely used within multiple knowledge discovery tasks such as classification or fact-checking. Here, we consider a given set of vertices, called seed vertices, and focus on mining their associated neighboring vertices, paths, and, more generally, path patterns that involve classes of ontologies linked with knowledge graphs. Due to the combinatorial nature and the increasing size of real-world knowledge graphs, the task of mining these patterns immediately entails scalability issues. In this paper, we address these issues by proposing a pattern mining approach that relies on a set of constraints (e.g., support or degree thresholds) and the monotonicity property. As our motivation comes from the mining of real-world knowledge graphs, we illustrate our approach with PGxLOD, a biomedical knowledge graph.


title: Effect of Retransmissions on the Performance of C-V2X Communication for 5G

abstract: In recent years, the next generation of wireless communication (5G) plays a significant role in both industry and academy societies. Cellular Vehicle-to-Everything (C-V2X) communication technology has been one of the prominent services for 5G. For C-V2X transmission mode, there is a newly defined communication channel (sidelink) that can support direct C-V2X communication. Direct C-V2X communication is a technology that allows vehicles to communicate and share safety-related information with other traffic participates directly without going through the cellular network. The C-V2X data packet will be delivered to all traffic Users (UE) in the proximity of the Transmitter (Tx). Some UEs might not successfully receive the data packets during one transmission but the sidelink Tx is not able to check whether the Receivers (Rxs) get the information or not due to the lack of feedback channel. For enabling the strict requirements in terms of reliability and latency for C-V2X communication, we propose and evaluate one retransmission scheme and retransmission with different traffic speed scheme. These schemes try to improve the reliability of the safety-related data by one blind retransmission without requiring feedback. Although this retransmission scheme is essential to C-V2X communication, the scheme has a limitation in the performance aspect because of its redundant retransmission. Since radio resources for CV2X communication are limited, we have to detect the effect of retransmission on the performance of the communication system. To the end, the simulator for evaluating the proposed schemes for the C-V2X communication has been implemented, and the performances of the different communication schemes are shown through the Packet Reception Ratio (PRR).


title: The ISCO of charged particles in Reissner-Nordstr\"om, Kerr-Newman and Kerr-Sen spacetime

abstract: In this article we study the innermost stable circular orbit (ISCO) of electrically charged particles in the electrically charged Reissner-Nordstr\"om spacetime, the Kerr-Newman spacetime and the Kerr-Sen spacetime. We find that the radius of the ISCO increases with an increasing particle-black hole charge product $|qQ|$ in the case of attractive Coulomb interaction $qQ<0$. For repulsive Coulomb interaction, the ISCO radius first decreases to a minimum and then increases again, until it diverges as the charge product approaches one. If the charge $Q$ of the black hole is very small, the minimum of the ISCO radius lies at $qQ=0$. Repulsive and attractive Coulomb interactions will always increase the ISCO radius in this limit. Stable bound orbits of charged particles cease to exist in the Reissner-Nordstr\"om and Kerr-Newman spacetime for $qQ\geq 1$. In the Kerr-Sen spacetime the limiting case depends on the charge of the black hole and if dilaton coupling is applied to the test particle. We find $qQ\geq 1+Q^2$ without dilaton-coupling and $qQ\geq 1+\frac{3}{2}Q^2$ with dilaton coupling $\alpha=1$.


title: Goal-oriented adaptivity for a conforming residual minimization method in a dual discontinuous Galerkin norm

abstract: We propose a goal-oriented mesh-adaptive algorithm for a finite element method stabilized via residual minimization on dual discontinuous-Galerkin norms. By solving a saddle-point problem, this residual minimization delivers a stable continuous approximation to the solution on each mesh instance and a residual projection onto a broken polynomial space, which is a robust error estimator to minimize the discrete energy norm via automatic mesh refinement. In this work, we propose and analyze a goal-oriented adaptive algorithm for this stable residual minimization. We solve the primal and adjoint problems considering the same saddle-point formulation and different right-hand sides. By solving a third stable problem, we obtain two efficient error estimates to guide goal-oriented adaptivity. We illustrate the performance of this goal-oriented adaptive strategy on advection-diffusion-reaction problems.


title: Transport and spectral features in non-Hermitian open systems

abstract: We study the transport and spectral properties of a non-Hermitian one-dimensional disordered lattice, the diagonal matrix elements of which are random complex variables taking both positive (loss) and negative (gain) imaginary values: Their distribution is either the usual rectangular one or a binary pair-correlated one possessing, in its Hermitian version, delocalized states, and unusual transport properties. Contrary to the Hermitian case, all states in our non-Hermitian system are localized. In addition, the eigenvalue spectrum, for the binary pair-correlated case, exhibits an unexpected intricate fractallike structure on the complex plane and with increasing non-Hermitian disorder, the eigenvalues tend to coalesce in particular small areas of the complex plane, a feature termed "eigenvalue condensation". Despite the strong Anderson localization of all eigenstates, the system appears to exhibit transport not by diffusion but by a new mechanism through sudden jumps between states located even at distant sites. This seems to be a general feature of open non-Hermitian random systems. The relation of our findings to recent experimental results is also discussed.


title: Revisiting Rubik's Cube: Self-supervised Learning with Volume-wise Transformation for 3D Medical Image Segmentation

abstract: Deep learning highly relies on the quantity of annotated data. However, the annotations for 3D volumetric medical data require experienced physicians to spend hours or even days for investigation. Self-supervised learning is a potential solution to get rid of the strong requirement of training data by deeply exploiting raw data information. In this paper, we propose a novel self-supervised learning framework for volumetric medical images. Specifically, we propose a context restoration task, i.e., Rubik's cube++, to pre-train 3D neural networks. Different from the existing context-restoration-based approaches, we adopt a volume-wise transformation for context permutation, which encourages network to better exploit the inherent 3D anatomical information of organs. Compared to the strategy of training from scratch, fine-tuning from the Rubik's cube++ pre-trained weight can achieve better performance in various tasks such as pancreas segmentation and brain tissue segmentation. The experimental results show that our self-supervised learning method can significantly improve the accuracy of 3D deep learning networks on volumetric medical datasets without the use of extra data.


title: Traffic dynamics and optimal control in a city served by ride-sourcing vehicles

abstract: This paper presents an interactive bathtub model for describing the traffic dynamics of ride-sourcing vehicles including non-shared taxis and ride-pooling cars. A city with a network of undifferentiated streets and solely served by ride-sourcing services is assumed to facilitate the modeling, isolate the congestion contribution, and accordingly develop control strategies. The proposed model is parsimonious with only input information of the total lane length of the network, the in-flux of demand, and the travel distance distributions. The output of the model, however, captures not only the traffic dynamics of vehicles but also the dynamic states of passengers in ride-pooling services in terms of the total number, the remaining travel distances, and the queue of unmatched requests at any system time. Useful system metrics can be exploited for use of the authorities to monitor, predict, and control the traffic, as well as for the TNCs to determine the fleet sizes, dispatch vehicles, and measure the service productivity. For illustration, we propose a robust control rule to manage the traffic efficiently and avoid gridlock, and also present time-varying ride-pooling sizes to eliminate the queue of unmatched requests. Numerical examples demonstrate the effectiveness of the proposed model and the control and operation strategies.


title: Mode matching in the field speckle pattern after graded-index fibers

abstract: We have developed and implemented a new technique of parallel information transmission through a multimode graded-index fiber in real time based on the approach of intensity moments. To do this, it was necessary to measure the spectrum of the mode amplitudes and phases in the Hermite-Gauss basis. At the same time, informational entropy and the degree of spatial coherence were measured.


title: Adjusted Expected Shortfall

abstract: We introduce and study the main properties of a class of convex risk measures that refine Expected Shortfall by simultaneously controlling the expected losses associated with different portions of the tail distribution. The corresponding adjusted Expected Shortfalls quantify risk as the minimum amount of capital that has to be raised and injected into a financial position $X$ to ensure that Expected Shortfall $ES_p(X)$ does not exceed a pre-specified threshold $g(p)$ for every probability level $p\in[0,1]$. Through the choice of the benchmark risk profile $g$ one can tailor the risk assessment to the specific application of interest. We devote special attention to the study of risk profiles defined by the Expected Shortfall of a benchmark random loss, in which case our risk measures are intimately linked to second-order stochastic dominance.


abstract: A polarization camera has great potential for 3D reconstruction since the angle of polarization (AoP) of reflected light is related to an object's surface normal. In this paper, we propose a novel 3D reconstruction method called Polarimetric Multi-View Inverse Rendering (Polarimetric MVIR) that effectively exploits geometric, photometric, and polarimetric cues extracted from input multi-view color polarization images. We first estimate camera poses and an initial 3D model by geometric reconstruction with a standard structure-from-motion and multi-view stereo pipeline. We then refine the initial model by optimizing photometric and polarimetric rendering errors using multi-view RGB and AoP images, where we propose a novel polarimetric rendering cost function that enables us to effectively constrain each estimated surface vertex's normal while considering four possible ambiguous azimuth angles revealed from the AoP measurement. Experimental results using both synthetic and real data demonstrate that our Polarimetric MVIR can reconstruct a detailed 3D shape without assuming a specific polarized reflection depending on the material.


title: Idempotent factorization of matrices over a Pr\"ufer domain of rational functions

abstract: We consider the smallest subring $D$ of $\mathbb{R}(X)$ containing every element of the form $1/(1+x^2)$, with $x\in \mathbb{R}(X)$. $D$ is a Pr\"ufer domain called the minimal Dress ring of $\mathbb{R}(X)$. In this paper, addressing a general open problem for Pr\"ufer non B\'ezout domains, we investigate whether $2\times 2$ singular matrices over $D$ can be decomposed as products of idempotent matrices. We show some conditions that guarantee the idempotent factorization in $M_2(D)$.


title: Deconstructing laws of accessibility and facility distribution in cities

abstract: The era of the automobile has seriously degraded the quality of urban life through costly travel and visible environmental effects. A new urban planning paradigm must be at the heart of our roadmap for the years to come. The one where, within minutes, inhabitants can access their basic living needs by bike or by foot. In this work, we present novel insights of the interplay between the distributions of facilities and population that maximize accessibility over the existing road networks. Results in six cities reveal that travel costs could be reduced in half through redistributing facilities. In the optimal scenario, the average travel distance can be modeled as a functional form of the number of facilities and the population density. As an application of this finding, it is possible to estimate the number of facilities needed for reaching a desired average travel distance given the population distribution in a city.


title: The escape problem for active particles confined to a disc

abstract: We study the escape problem for interacting, self-propelled particles confined to a disc, where particles can exit through one open slot on the circumference. Within a minimal 2D Vicsek model, we numerically study the statistics of escape events when the self-propelled particles can be in a flocking state. We show that while an exponential survival probability is characteristic for non-interaction self-propelled particles at all times, the interacting particles have an initial exponential phase crossing over to a sub-exponential late-time behavior. We propose a new phenomenological model based on non-stationary Poisson processes which includes the Allee effect to explain this sub-exponential trend and perform numerical simulations for various noise intensities.


title: Lepton flavour violation from an anomaly-free leptophilic axion-like particle

abstract: Motivated by the recent Xenon1T result, we study a leptophilic flavour-dependent anomaly-free axion-like particle (ALP) and its effects on charged-lepton flavour violation (CLFV). We present two representative models. The first one considers that the ALP origins from the flavon that generates the charged-lepton masses. The second model assumes a larger flavour symmetry such that more general mixings in the charged-lepton are possible, while maintaining flavour-dependent ALP couplings. We find that a keV ALP explaining the Xenon1T result is still viable for lepton flavour violation and stellar cooling astrophysical limits. On the other hand, if the Xenon1T result is confirmed, future CLFV measurements can be complementary to probe such a possibility.


title: Mode-coupling theory of the glass transition for colloidal liquids in slit geometry

abstract: We provide a detailed derivation of the mode-coupling equations for a colloidal liquid confined by two parallel smooth walls. We introduce irreducible memory kernels for the different relaxation channels thereby extending the projection operator technique to colloidal liquids in slit geometry. Investigating both the collective dynamics as well as the tagged-particle motion, we prove that the mode-coupling functional assumes the same form as in the Newtonian case corroborating the universality of the glass-transition singularity with respect to the microscopic dynamics.


title: Efficient Exact Algorithms for Maximum Balanced Biclique Search in Bipartite Graphs

abstract: Given a bipartite graph, the maximum balanced biclique (\textsf{MBB}) problem, discovering a mutually connected while equal-sized disjoint sets with the maximum cardinality, plays a significant role for mining the bipartite graph and has numerous applications. Despite the NP-hardness of the \textsf{MBB} problem, in this paper, we show that an exact \textsf{MBB} can be discovered extremely fast in bipartite graphs for real applications. We propose two exact algorithms dedicated for dense and sparse bipartite graphs respectively. For dense bipartite graphs, an $\mathcal{O}^{*}( 1.3803^{n})$ algorithm is proposed. This algorithm in fact can find an \textsf{MBB} in near polynomial time for dense bipartite graphs that are common for applications such as VLSI design. This is because, using our proposed novel techniques, the search can fast converge to sufficiently dense bipartite graphs which we prove to be polynomially solvable. For large sparse bipartite graphs typical for applications such as biological data analysis, an $\mathcal{O}^{*}( 1.3803^{\ddot{\delta}})$ algorithm is proposed, where $\ddot{\delta}$ is only a few hundreds for large sparse bipartite graphs with millions of vertices. The indispensible optimizations that lead to this time complexity are: we transform a large sparse bipartite graph into a limited number of dense subgraphs with size up to $\ddot{\delta}$ and then apply our proposed algorithm for dense bipartite graphs on each of the subgraphs. To further speed up this algorithm, tighter upper bounds, faster heuristics and effective reductions are proposed, allowing an \textsf{MBB} to be discovered within a few seconds for bipartite graphs with millions of vertices. Extensive experiments are conducted on synthetic and real large bipartite graphs to demonstrate the efficiency and effectiveness of our proposed algorithms and techniques.


title: Linear Convergence Rate Analysis of a Class of Exact First-Order Distributed Methods for Weight-Balanced Time-Varying Networks and Uncoordinated Step Sizes

abstract: We analyze a class of exact distributed first order methods under a general setting on the underlying network and step-sizes. In more detail, we allow simultaneously for time-varying uncoordinated stepsizes and time-varying directed weight-balanced networks, jointly connected over bounded intervals. The analyzed class of methods subsumes several existing algorithms like the unified Extra and unified DIGing (Jakovetic, 2019), or the exact spectral gradient method (Jakovetic, Krejic, Krklec Jerinkic, 2019) that have been analyzed before under more restrictive assumptions. Under the assumed setting, we establish R-linear convergence of the methods and present several implications that our results have on the literature. Most notably, we show that the unification strategy in (Jakovetic, 2019) and the spectral step-size selection strategy in (Jakovetic, Krejic, Krklec Jerinkic, 2019) exhibit a high degree of robustness to uncoordinated time-varying step sizes and to time-varying networks.


title: Sufficient conditions for local scaling laws for stationary martingale solutions to the 3D Navier-Stokes equations

abstract: The main goal of this paper is to obtain sufficient conditions that allow us to rigorously derive local versions of the 4/5 and 4/3 laws of hydrodynamic turbulence, by which we mean versions of these laws that hold in bounded domains. This is done in the context of stationary martingale solutions of the Navier-Stokes equations driven by an Ornstein-Uhlenbeck process. Specifically, we show that under an assumption of \say{on average} precompactness in $L^3,$ the local structure functions are expressed up to first order in the length scale as nonlinear fluxes, in the vanishing viscosity limit and within an appropriate range of scales. If in addition one assumes local energy equality, this is equivalent to expressing the structure functions in terms of the local dissipation. Our precompactness assumption is also shown to produce stationary martingale solutions of the Euler equations with the same type of forcing in the vanishing viscosity limit.


title: Coarsen entropy inequalities and its applications in quantitative stochastic homogenization

abstract: In this work, we study the validity of Entropy inequalities under decorrelation assumptions at large-scales, and also we study the problem of Weighted Meyers estimate in perforated domains. As a consequence, we obtain the hypercontractivity of correctors with Neumann boundary conditions.


title: Adaptive Gradient Methods for Constrained Convex Optimization and Variational Inequalities

abstract: We provide new adaptive first-order methods for constrained convex optimization. Our main algorithms AdaACSA and AdaAGD+ are accelerated methods, which are universal in the sense that they achieve nearly-optimal convergence rates for both smooth and non-smooth functions, even when they only have access to stochastic gradients. In addition, they do not require any prior knowledge on how the objective function is parametrized, since they automatically adjust their per-coordinate learning rate. These can be seen as truly accelerated Adagrad methods for constrained optimization. We complement them with a simpler algorithm AdaGrad+ which enjoys the same features, and achieves the standard non-accelerated convergence rate. We also present a set of new results involving adaptive methods for unconstrained optimization and monotone operators.


title: Direct and inverse spectral problems for rank-one perturbations of self-adjoint operators

abstract: For a given self-adjoint operator $A$ with discrete spectrum, we completely characterize possible eigenvalues of its rank-one perturbations~$B$ and discuss the inverse problem of reconstructing $B$ from its spectrum.


title: Spin transport in polarization induced two dimensional confinement of carriers in wedge shaped \textit{c}-GaN nanowalls

abstract: Spin transport property of polarization induced two-dimensional electron gas channel formed in the central vertical plane of a wedge-shaped \textit{c}-oriented GaN nanowall is investigated theoretically. Since the confining potential preserves the spatial symmetry between the conduction and valence band, the Rashba effect is suppressed in this system even when the shape of the wedge is asymmetric. It has been found that the relaxation of the electron spin oriented along the direction of the confinement via D'yakonov-Perel' (DP) mechanism, which is the dominant process of relaxation in this high mobility channel, is entirely switched off at low temperatures. Spin relaxation can be turned on by applying a suitable bias at the gate. Exploiting this remarkable effect, a novel all electrically driven spin-transistor has been proposed.


title: Plasmons in anisotropic Dirac systems

abstract: We consider the plasmon excitations in anisotropic two-dimensional Dirac systems, be it either anisotropic graphene or surfaces of topological insulators. Generalizing the exact density-density response function one finds a plasmon dispersion that is anisotropic already at the lowest frequencies. Asymptotic expressions are obtained for the dispersion in this regime. We show that the plasmon properties of the complete material class of anisotropic Dirac systems are characterized by just two dimensionless material parameters. The strong anisotropy can be used to guide the plasmon modes, introducing new functionalities to the field of Dirac plasmonics.


title: Distribution Aligning Refinery of Pseudo-label for Imbalanced Semi-supervised Learning

abstract: While semi-supervised learning (SSL) has proven to be a promising way for leveraging unlabeled data when labeled data is scarce, the existing SSL algorithms typically assume that training class distributions are balanced. However, these SSL algorithms trained under imbalanced class distributions can severely suffer when generalizing to a balanced testing criterion, since they utilize biased pseudo-labels of unlabeled data toward majority classes. To alleviate this issue, we formulate a convex optimization problem to softly refine the pseudo-labels generated from the biased model, and develop a simple algorithm, named Distribution Aligning Refinery of Pseudo-label (DARP) that solves it provably and efficiently. Under various class-imbalanced semi-supervised scenarios, we demonstrate the effectiveness of DARP and its compatibility with state-of-the-art SSL schemes.


title: Open images of the Sorgenfrey line

abstract: We give a description of Hausdorff continuous open images of the Sorgenfrey line: these are precisely those spaces that have a Sorgenfrey base. Using this description we prove that no Hausdorff compact space that contains a copy of the Sorgenfrey line is a continuous open image of it; in particular the double-arrow space is not a continuous open image of the Sorgenfrey line.


title: Stability of syzygy bundles on abelian varieties

abstract: We prove that the kernel of the evaluation morphism of global sections - namely the syzygy bundle - of a sufficiently ample line bundle on an abelian variety is stable. This settles a conjecture of Ein-Lazarsfeld-Mustopa, in the case of abelian varieties.


title: Two-stream Fusion Model for Dynamic Hand Gesture Recognition using 3D-CNN and 2D-CNN Optical Flow guided Motion Template

abstract: The use of hand gestures can be a useful tool for many applications in the human-computer interaction community. In a broad range of areas hand gesture techniques can be applied specifically in sign language recognition, robotic surgery, etc. In the process of hand gesture recognition, proper detection, and tracking of the moving hand become challenging due to the varied shape and size of the hand. Here the objective is to track the movement of the hand irrespective of the shape, size, and color of the hand. And, for this, a motion template guided by optical flow (OFMT) is proposed. OFMT is a compact representation of the motion information of a gesture encoded into a single image. In the experimentation, different datasets using bare hand with an open palm, and folded palm wearing green-glove are used, and in both cases, we could generate the OFMT images with equal precision. Recently, deep network-based techniques have shown impressive improvements as compared to conventional hand-crafted feature-based techniques. Moreover, in the literature, it is seen that the use of different streams with informative input data helps to increase the performance in the recognition accuracy. This work basically proposes a two-stream fusion model for hand gesture recognition and a compact yet efficient motion template based on optical flow. Specifically, the two-stream network consists of two layers: a 3D convolutional neural network (C3D) that takes gesture videos as input and a 2D-CNN that takes OFMT images as input. C3D has shown its efficiency in capturing spatio-temporal information of a video. Whereas OFMT helps to eliminate irrelevant gestures providing additional motion information. Though each stream can work independently, they are combined with a fusion scheme to boost the recognition results. We have shown the efficiency of the proposed two-stream network on two databases.


title: CovidCare: Transferring Knowledge from Existing EMR to Emerging Epidemic for Interpretable Prognosis

abstract: Due to the characteristics of COVID-19, the epidemic develops rapidly and overwhelms health service systems worldwide. Many patients suffer from systemic life-threatening problems and need to be carefully monitored in ICUs. Thus the intelligent prognosis is in an urgent need to assist physicians to take an early intervention, prevent the adverse outcome, and optimize the medical resource allocation. However, in the early stage of the epidemic outbreak, the data available for analysis is limited due to the lack of effective diagnostic mechanisms, rarity of the cases, and privacy concerns. In this paper, we propose a deep-learning-based approach, CovidCare, which leverages the existing electronic medical records to enhance the prognosis for inpatients with emerging infectious diseases. It learns to embed the COVID-19-related medical features based on massive existing EMR data via transfer learning. The transferred parameters are further trained to imitate the teacher model's representation behavior based on knowledge distillation, which embeds the health status more comprehensively in the source dataset. We conduct the length of stay prediction experiments for patients on a real-world COVID-19 dataset. The experiment results indicate that our proposed model consistently outperforms the comparative baseline methods. CovidCare also reveals that, 1) hs-cTnI, hs-CRP and Platelet Counts are the most fatal biomarkers, whose abnormal values usually indicate emergency adverse outcome. 2) Normal values of gamma-GT, AP and eGFR indicate the overall improvement of health. The medical findings extracted by CovidCare are empirically confirmed by human experts and medical literatures.


title: 2nd Place Solution to ECCV 2020 VIPriors Object Detection Challenge

abstract: In this report, we descibe our approach to the ECCV 2020 VIPriors Object Detection Challenge which took place from March to July in 2020. We show that by using state-of-the-art data augmentation strategies, model designs, and post-processing ensemble methods, it is possible to overcome the difficulty of data shortage and obtain competitive results. Notably, our overall detection system achieves 36.6$\%$ AP on the COCO 2017 validation set using only 10K training images without any pre-training or transfer learning weights ranking us 2nd place in the challenge.


title: Radiative Hydrodynamic Simulations of the Spectral Characteristics of Solar White-light Flares

abstract: As one of the most violent activities in the solar atmosphere, white-light flares (WLFs) are generally known for their enhanced white-light (or continuum) emission, which primarily originates in the solar lower atmosphere. However, we know little about how white-light emission is produced. In this study, we aim to investigate the response of the continua at 3600\AA\ and 4250\AA\ and also the H$\alpha$ and Ly$\alpha$ lines during WLFs modeled with radiative hydrodynamics simulations. We take non-thermal electron beams as the energy source for the WLFs in two different initial atmospheres and vary their parameters. Our results show that the model with non-thermal electron beam heating can clearly show enhancements in the continua at 3600\AA\ and 4250\AA\ as well as in the H$\alpha$ and Ly$\alpha$ lines. A larger electron beam flux, a smaller spectral index, or a penumbral initial atmosphere leads to a stronger emission increase at 3600\AA, 4250\AA\ and in the H$\alpha$ line. For the Ly$\alpha$ line, however, it is more preferably enhanced in a quiet-Sun initial atmosphere with a larger spectral index of the electron beam. It is also notable that the continua at 3600\AA\ and 4250\AA\ and the H$\alpha$ line exhibit a dimming at the beginning of the heating and reach their peak emissions later than the peak time of the heating function, while the Ly$\alpha$ line does not show such behaviors. These results can be served as a reference for analyzing future WLF observations.


title: Pressure induced gap modulation and topological transitions in twisted bilayer and double bilayer graphene

abstract: We study the electronic and topological properties of fully relaxed twisted bilayer (TBG) and double bilayer (TDBG) graphene under perpendicular pressure. An approach has been proposed to obtain the equilibrium in-plane structural deformation and out-of-plane corrugation in moir\'{e} superlattices under pressure. We find that the in-plane relaxation becomes much stronger under higher pressure, while the corrugation height in each layer is maintained. The comparison between band structures of relaxed and rigid structures demonstrates that not only the gaps on the electron and hole sides ($\Delta_e$ and $\Delta_h$) are significantly underestimated without relaxation but also the detailed dispersions of the middle bands of rigid structures are rather different from those of relaxed systems. $\Delta_e$ and $\Delta_h$ in TBG reach maximum values around critical pressures with narrowest middle bands. Topological transitions occur in TDBG under pressure with the middle valence and conduction bands in one valley touching and their Chern numbers transferred to each other. The pressure can also tune the gap at the neutrality point of TDBG, which becomes closed for a pressure range and reopened under higher pressure. The behavior of electronic structure of supertlattices under pressure is sensitive to the twist angle $\theta$ with the critical pressures generally increase with $\theta$.