title: ResNet-LDDMM: Advancing the LDDMM Framework using Deep Residual Networks

abstract: In deformable registration, the geometric framework - large deformation diffeomorphic metric mapping or LDDMM, in short - has inspired numerous techniques for comparing, deforming, averaging and analyzing shapes or images. Grounded in flows, which are akin to the equations of motion used in fluid dynamics, LDDMM algorithms solve the flow equation in the space of plausible deformations, i.e. diffeomorphisms. In this work, we make use of deep residual neural networks to solve the non-stationary ODE (flow equation) based on a Euler's discretization scheme. The central idea is to represent time-dependent velocity fields as fully connected ReLU neural networks (building blocks) and derive optimal weights by minimizing a regularized loss function. Computing minimizing paths between deformations, thus between shapes, turns to find optimal network parameters by back-propagating over the intermediate building blocks. Geometrically, at each time step, ResNet-LDDMM searches for an optimal partition of the space into multiple polytopes, and then computes optimal velocity vectors as affine transformations on each of these polytopes. As a result, different parts of the shape, even if they are close (such as two fingers of a hand), can be made to belong to different polytopes, and therefore be moved in different directions without costing too much energy. Importantly, we show how diffeomorphic transformations, or more precisely bilipshitz transformations, are predicted by our algorithm. We illustrate these ideas on diverse registration problems of 3D shapes under complex topology-preserving transformations. We thus provide essential foundations for more advanced shape variability analysis under a novel joint geometric-neural networks Riemannian-like framework, i.e. ResNet-LDDMM.


title: A Survey of Machine Learning for Computer Architecture and Systems

abstract: It has been a long time that computer architecture and systems are optimized for efficient execution of machine learning (ML) models. Now, it is time to reconsider the relationship between ML and systems, and let ML transform the way that computer architecture and systems are designed. This embraces a twofold meaning: improvement of designers' productivity, and completion of the virtuous cycle. In this paper, we present a comprehensive review of the work that applies ML for computer architecture and system design. First, we perform a high-level taxonomy by considering the typical role that ML techniques take in architecture/system design, i.e., either for fast predictive modeling or as the design methodology. Then, we summarize the common problems in computer architecture/system design that can be solved by ML techniques, and the typical ML techniques employed to resolve each of them. In addition to emphasis on computer architecture in a narrow sense, we adopt the concept that data centers can be recognized as warehouse-scale computers; sketchy discussions are provided in adjacent computer systems, such as code generation and compiler; we also give attention to how ML techniques can aid and transform design automation. We further provide a future vision of opportunities and potential directions, and envision that applying ML for computer architecture and systems would thrive in the community.


title: Asynchronous Distributed Optimization via Dual Decomposition and Block Coordinate Subgradient Methods

abstract: We study the problem of minimizing the sum of potentially non-differentiable convex cost functions with partially overlapping dependences in an asynchronous manner, where communication in the network is not coordinated. We study the behavior of an asynchronous algorithm based on dual decomposition and block coordinate subgradient methods under assumptions weaker than those used in the literature. At the same time, we allow different agents to use local stepsizes with no global coordination. Sufficient conditions are provided for almost sure convergence to the solution of the optimization problem. Under additional assumptions, we establish a sublinear convergence rate that in turn can be strengthened to linear convergence rate if the problem is strongly convex and has Lipschitz gradients. We also extend available results in the literature by allowing multiple and potentially overlapping blocks to be updated at the same time with non-uniform and potentially time varying probabilities assigned to different blocks. A numerical example is provided to illustrate the effectiveness of the algorithm.


title: AlphaNet: Improved Training of Supernets with Alpha-Divergence

abstract: Weight-sharing neural architecture search (NAS) is an effective technique for automating efficient neural architecture design. Weight-sharing NAS builds a supernet that assembles all the architectures as its sub-networks and jointly trains the supernet with the sub-networks. The success of weight-sharing NAS heavily relies on distilling the knowledge of the supernet to the sub-networks. However, we find that the widely used distillation divergence, i.e., KL divergence, may lead to student sub-networks that over-estimate or under-estimate the uncertainty of the teacher supernet, leading to inferior performance of the sub-networks. In this work, we propose to improve the supernet training with a more generalized alpha-divergence. By adaptively selecting the alpha-divergence, we simultaneously prevent the over-estimation or under-estimation of the uncertainty of the teacher model. We apply the proposed alpha-divergence based supernets training to both slimmable neural networks and weight-sharing NAS, and demonstrate significant improvements. Specifically, our discovered model family, AlphaNet, outperforms prior-art models on a wide range of FLOPs regimes, including BigNAS, Once-for-All networks, and AttentiveNAS. We achieve ImageNet top-1 accuracy of 80.0% with only 444M FLOPs. Our code and pretrained models are available at https://github.com/facebookresearch/AlphaNet.


title: Deep Learning based Multi-Source Localization with Source Splitting and its Effectiveness in Multi-Talker Speech Recognition

abstract: Multi-source localization is an important and challenging technique for multi-talker conversation analysis. This paper proposes a novel supervised learning method using deep neural networks to estimate the direction of arrival (DOA) of all the speakers simultaneously from the audio mixture. At the heart of the proposal is a source splitting mechanism that creates source-specific intermediate representations inside the network. This allows our model to give source-specific posteriors as the output unlike the traditional multi-label classification approach. Existing deep learning methods perform a frame level prediction, whereas our approach performs an utterance level prediction by incorporating temporal selection and averaging inside the network to avoid post-processing. We also experiment with various loss functions and show that a variant of earth mover distance (EMD) is very effective in classifying DOA at a very high resolution by modeling inter-class relationships. In addition to using the prediction error as a metric for evaluating our localization model, we also establish its potency as a frontend with automatic speech recognition (ASR) as the downstream task. We convert the estimated DOAs into a feature suitable for ASR and pass it as an additional input feature to a strong multi-channel and multi-talker speech recognition baseline. This added input feature drastically improves the ASR performance and gives a word error rate (WER) of 6.3% on the evaluation data of our simulated noisy two speaker mixtures, while the baseline which doesn't use explicit localization input has a WER of 11.5%. We also perform ASR evaluation on real recordings with the overlapped set of the MC-WSJ-AV corpus in addition to simulated mixtures.


title: Efficient Discretizations of Optimal Transport

abstract: Obtaining solutions to Optimal Transportation (OT) problems is typically intractable when the marginal spaces are continuous. Recent research has focused on approximating continuous solutions with discretization methods based on i.i.d. sampling, and has proven convergence as the sample size increases. However, obtaining OT solutions with large sample sizes requires intensive computation effort, that can be prohibitive in practice. In this paper, we propose an algorithm for calculating discretizations with a given number of points for marginal distributions, by minimizing the (entropy-regularized) Wasserstein distance, and result in plans that are comparable to those obtained with much larger numbers of i.i.d. samples. Moreover, a local version of such discretizations which is parallelizable for large scale applications is proposed. We prove bounds for our approximation and demonstrate performance on a wide range of problems.


title: Vibrational relaxation dynamics in layered perovskite quantum wells

abstract: Organic-inorganic layered perovskites are two-dimensional quantum wells with layers of lead-halide octahedra stacked between organic ligand barriers. The combination of their dielectric confinement and ionic sublattice results in excitonic excitations with substantial binding energies that are strongly coupled to the surrounding soft, polar lattice. However, the ligand environment in layered perovskites can significantly alter their optical properties due to the complex dynamic disorder of soft perovskite lattice. Here, we observe the dynamic disorder through phonon dephasing lifetimes initiated by ultrafast photoexcitation employing high-resolution resonant impulsive stimulated Raman spectroscopy of a variety of ligand substitutions. We demonstrate that vibrational relaxation in layered perovskite formed from flexible alkyl-amines as organic barriers is fast and relatively independent of the lattice temperature. Relaxation in aromatic amine based layered perovskite is slower, though still fast relative to pure inorganic lead bromide lattices, with a rate that is temperature dependent. Using molecular dynamics simulations, we explain the fast rates of relaxation by quantifying the large anharmonic coupling of the optical modes with the ligand layers and rationalize the temperature independence due to their amorphous packing. This work provides a molecular and time-domain depiction of the relaxation of nascent optical excitations and opens opportunities to understand how they couple to the complex layered perovskite lattice, elucidating design principles for optoelectronic devices.


title: Importance of Instruction for Pedestrian-Automated Driving Vehicle Interaction with an External Human Machine Interface: Effects on Pedestrians' Situation Awareness, Trust, Perceived Risks and Decision Making

abstract: Compared to a manual driving vehicle (MV), an automated driving vehicle lacks a way to communicate with the pedestrian through the driver when it interacts with the pedestrian because the driver usually does not participate in driving tasks. Thus, an external human machine interface (eHMI) can be viewed as a novel explicit communication method for providing driving intentions of an automated driving vehicle (AV) to pedestrians when they need to negotiate in an interaction, e.g., an encountering scene. However, the eHMI may not guarantee that the pedestrians will fully recognize the intention of the AV. In this paper, we propose that the instruction of the eHMI's rationale can help pedestrians correctly understand the driving intentions and predict the behavior of the AV, and thus their subjective feelings (i.e., dangerous feeling, trust in the AV, and feeling of relief) and decision-making are also improved. The results of an interaction experiment in a road-crossing scene indicate that the participants were more difficult to be aware of the situation when they encountered an AV w/o eHMI compared to when they encountered an MV; further, the participants' subjective feelings and hesitation in decision-making also deteriorated significantly. When the eHMI was used in the AV, the situational awareness, subjective feelings and decision-making of the participants regarding the AV w/ eHMI were improved. After the instruction, it was easier for the participants to understand the driving intention and predict driving behavior of the AV w/ eHMI. Further, the subjective feelings and the hesitation related to decision-making were improved and reached the same standards as that for the MV.


title: ReGraphX: NoC-enabled 3D Heterogeneous ReRAM Architecture for Training Graph Neural Networks

abstract: Graph Neural Network (GNN) is a variant of Deep Neural Networks (DNNs) operating on graphs. However, GNNs are more complex compared to traditional DNNs as they simultaneously exhibit features of both DNN and graph applications. As a result, architectures specifically optimized for either DNNs or graph applications are not suited for GNN training. In this work, we propose a 3D heterogeneous manycore architecture for on-chip GNN training to address this problem. The proposed architecture, ReGraphX, involves heterogeneous ReRAM crossbars to fulfill the disparate requirements of both DNN and graph computations simultaneously. The ReRAM-based architecture is complemented with a multicast-enabled 3D NoC to improve the overall achievable performance. We demonstrate that ReGraphX outperforms conventional GPUs by up to 3.5X (on an average 3X) in terms of execution time, while reducing energy consumption by as much as 11X.


title: A Combination of Multi-Objective Genetic Algorithm and Deep Learning for Music Harmony Generation

abstract: Automatic Music Generation (AMG) has become an interesting research topic for many scientists in artificial intelligence, who are also interested in the music industry. One of the main challenges in AMG is that there is no clear objective evaluation criterion that can measure the music grammar, structural rules, and audience satisfaction. Also, original music contains different elements that should work together, such as melody, harmony, and rhythm; but in the most of previous works, AMG works only for one element (e.g., melody). Therefore, in this paper, we propose a Multi-Objective Genetic Algorithm (MO-GA) to generate polyphonic music pieces, considering grammar and listener satisfaction. In this method, we use three objective functions. The first objective function is the accuracy of the generated music piece, based on music theory; and the other two objective functions are modeled scores provided by music experts and ordinary listeners. The scoring of experts and listeners separately are modeled using Bi-directional Long Short-Term Memory (Bi-LSTM) neural networks. The proposed music generation system tries to maximize mentioned objective functions to generate a new piece of music, including melody and harmony. The results show that the proposed method can generate pleasant pieces with desired styles and lengths, along with harmonic sounds that follow the grammar.


title: Semi-Supervised Singing Voice Separation with Noisy Self-Training

abstract: Recent progress in singing voice separation has primarily focused on supervised deep learning methods. However, the scarcity of ground-truth data with clean musical sources has been a problem for long. Given a limited set of labeled data, we present a method to leverage a large volume of unlabeled data to improve the model's performance. Following the noisy self-training framework, we first train a teacher network on the small labeled dataset and infer pseudo-labels from the large corpus of unlabeled mixtures. Then, a larger student network is trained on combined ground-truth and self-labeled datasets. Empirical results show that the proposed self-training scheme, along with data augmentation methods, effectively leverage the large unlabeled corpus and obtain superior performance compared to supervised methods.


title: Berger domains and Kolmogorov typicality of infinitely many invariant circles

abstract: Using the novel notion of parablender, P. Berger proved that the existence of finitely many attractors is not Kolmogorov typical in parametric families of diffeomorphisms. Here, motivated by the concept of Newhouse domains we define Berger domains for families of diffeomorphisms. As an application, we show that the coexistence of infinitely many attracting invariant smooth circles is Kolmogorov typical in certain non-sectionally dissipative Berger domains of parametric families in dimension three or greater.


title: Protoplanetary disk formation from the collapse of a prestellar core

abstract: While it is generally accepted that the magnetic field and its non-ideal effects play important roles during the stellar formation, simple models of pure hydrodynamics and angular momentum conservation are still widely employed in the studies of disk assemblage in the framework of the so-called "alpha-disk" model due to their simplicity. There has only been a few efforts trying to bridge the gap between a collapsing prestellar core and a developed disk. The goal of the present work is to revisit the assemblage of the protoplanetary disk (PPD), by performing 3D MHD simulations with ambipolar diffusion and full radiative transfer. We follow the global evolution of the PPD from the prestellar core collapse for 100 kyr, with resolution of one AU. The formed disk is more realistic and is in agreement with recent observations of disks around class-0 young stellar objects. The mass flux arriving onto the disk and the radial mass accretion rate within the disk are measured and compared to analytical self-similar models. The surface mass flux is very centrally peaked, implying that most of the mass falling onto the star does not transit through the mid-plane of the disk. The disk mid-plane is almost dead to turbulence, whereas upper layers and the disk outer edge are very turbulent. The snow-line is significantly further away than in a passive disk. We developed a zoomed rerun technique to quickly obtain a reasonable disk that is highly stratified, weakly magnetized inside, and strongly magnetized outside. During the class-0 phase of PPD formation, the interaction between the disk and the infalling envelope is important and ought not be neglected. Accretion onto the star is found to mostly depend on dynamics of the collapsing envelope, rather than the detailed disk structure.


title: Observation of Nonlinear Dynamics in an Optical Levitation System

abstract: Optical levitation of mechanical oscillators has been suggested as a promising way to decouple the environmental noise and increase the mechanical quality factor. Here, we investigate the dynamics of a free-standing mirror acting as the top reflector of a vertical optical cavity, designed as a testbed for a tripod cavity optical levitation setup. To reach the regime of levitation for a milligram-scale mirror, the optical intensity of the intracavity optical field approaches 3 MW cm$^{-2}$. We identify three distinct optomechanical effects: excitation of acoustic vibrations, expansion due to photothermal absorption, and partial lift-off of the mirror due to radiation pressure force. These effects are intercoupled via the intracavity optical field and induce complex system dynamics inclusive of high-order sideband generation, optical bistability, parametric amplification, and the optical spring effect. We modify the response of the mirror with active feedback control to improve the overall stability of the system.


title: Genus zero Gopakumar-Vafa invariants of Multi-Banana configurations

abstract: The multi-Banana configuration $\widehat{F}_{mb}$ is a local Calabi-Yau threefold of Schoen type. Namely, $\widehat{F}_{mb}$ is a conifold resolution of $\widehat{I}_v \times_{\bf{D}} \widehat{I}_w$, where $\widehat{I}_v \to {\bf{D}}$ is an elliptic surface over a formal disc ${\bf{D}}$ with an $I_v$ singulararity on the central fiber. We generalize the technique developed in our earlier paper to compute genus 0 Gopakumar-Vafa invariants of certain fiber curve classes. We illustrate the computation explicitly for $v=1$ and $v=w=2$. The resulting partition function can be expressed in terms of elliptic genera of $\bf{C}^2$, or classical theta functions, respectively.


title: A Hybrid Semi-Lagrangian Cut Cell Method for Advection-Diffusion Problems with Robin Boundary Conditions in Moving Domains

abstract: We present a new discretization for advection-diffusion problems with Robin boundary conditions on complex time-dependent domains. The method is based on second order cut cell finite volume methods introduced by Bochkov et al. to discretize the Laplace operator and Robin boundary condition. To overcome the small cell problem, we use a splitting scheme that uses a semi-Lagrangian method to treat advection. We demonstrate second order accuracy in the $L^1$, $L^2$, and $L^\infty$ norms for both analytic test problems and numerical convergence studies. We also demonstrate the ability of the scheme to handle conversion of one concentration field to another across a moving boundary.


title: Distribution-Free Conditional Median Inference

abstract: We consider the problem of constructing confidence intervals for the median of a response $Y \in \mathbb{R}$ conditional on features $X \in \mathbb{R}^d$ in a situation where we are not willing to make any assumption whatsoever on the underlying distribution of the data $(X,Y)$. We propose a method based upon ideas from conformal prediction and establish a theoretical guarantee of coverage while also going over particular distributions where its performance is sharp. Additionally, we prove an equivalence between confidence intervals for the conditional median and confidence intervals for the response variable, resulting in a lower bound on the length of any possible conditional median confidence interval. This lower bound is independent of sample size and holds for all distributions with no point masses.


title: Multi-Attribute Enhancement Network for Person Search

abstract: Person Search is designed to jointly solve the problems of Person Detection and Person Re-identification (Re-ID), in which the target person will be located in a large number of uncut images. Over the past few years, Person Search based on deep learning has made great progress. Visual character attributes play a key role in retrieving the query person, which has been explored in Re-ID but has been ignored in Person Search. So, we introduce attribute learning into the model, allowing the use of attribute features for retrieval task. Specifically, we propose a simple and effective model called Multi-Attribute Enhancement (MAE) which introduces attribute tags to learn local features. In addition to learning the global representation of pedestrians, it also learns the local representation, and combines the two aspects to learn robust features to promote the search performance. Additionally, we verify the effectiveness of our module on the existing benchmark dataset, CUHK-SYSU and PRW. Ultimately, our model achieves state-of-the-art among end-to-end methods, especially reaching 91.8% of mAP and 93.0% of rank-1 on CUHK-SYSU.Codes and models are available at https://github.com/chenlq123/MAE.


title: Machine Learning Based Cyber Attacks Targeting on Controlled Information: A Survey

abstract: Stealing attack against controlled information, along with the increasing number of information leakage incidents, has become an emerging cyber security threat in recent years. Due to the booming development and deployment of advanced analytics solutions, novel stealing attacks utilize machine learning (ML) algorithms to achieve high success rate and cause a lot of damage. Detecting and defending against such attacks is challenging and urgent so that governments, organizations, and individuals should attach great importance to the ML-based stealing attacks. This survey presents the recent advances in this new type of attack and corresponding countermeasures. The ML-based stealing attack is reviewed in perspectives of three categories of targeted controlled information, including controlled user activities, controlled ML model-related information, and controlled authentication information. Recent publications are summarized to generalize an overarching attack methodology and to derive the limitations and future directions of ML-based stealing attacks. Furthermore, countermeasures are proposed towards developing effective protections from three aspects -- detection, disruption, and isolation.


title: Offline Model-Based Optimization via Normalized Maximum Likelihood Estimation

abstract: In this work we consider data-driven optimization problems where one must maximize a function given only queries at a fixed set of points. This problem setting emerges in many domains where function evaluation is a complex and expensive process, such as in the design of materials, vehicles, or neural network architectures. Because the available data typically only covers a small manifold of the possible space of inputs, a principal challenge is to be able to construct algorithms that can reason about uncertainty and out-of-distribution values, since a naive optimizer can easily exploit an estimated model to return adversarial inputs. We propose to tackle this problem by leveraging the normalized maximum-likelihood (NML) estimator, which provides a principled approach to handling uncertainty and out-of-distribution inputs. While in the standard formulation NML is intractable, we propose a tractable approximation that allows us to scale our method to high-capacity neural network models. We demonstrate that our method can effectively optimize high-dimensional design problems in a variety of disciplines such as chemistry, biology, and materials engineering.


title: Spin excitations coupled with lattice and charge dynamics in La$_{2-x}$Sr$_{x}$CuO$_4$

abstract: Spin excitations of layered copper oxide show various characteristic features, depending on the carrier concentration. In this study, we conducted inelastic neutron scattering (INS) measurements on La$_{2-x}$Sr$_{x}$CuO$_4$ (LSCO), with $x$ = 0, 0.075, 0.18, and 0.30 and La$_{2-x}$Sr$_{x}$NiO$_4$ (LSNO) with 1/3, to clarify the origin of the intensity enhancement in the excitation spectrum of LSCO at the energy ($\omega$) of 16--19 meV [Phys. Rev. B {\bf 91}, 224404 (2015), {\it ibid}. {\bf 93}, 094416 (2016)]. We confirmed the presence of a peak-structure in the $\omega$-dependence of the local spin susceptibility $\chi''(\omega)$ of superconducting (SC) LSCO with a peak energy of 16--19 meV, where the spin excitations intersect optical phonon branches. A comparable peak-structure is not observed in the insulating La$_2$CuO$_4$, LSNO, and heavily overdoped LSCO with $x$ = 0.30. A dome-shaped $x$-dependence of the integrated intensity around the peak energies is revealed for SC phase by summarizing the present and previously reported results. Furthermore, our phonon calculation on LCO shows the existence of two optical branches at $\sim$19 meV that could stabilize stripe-alignment of carriers due to out-of-plane vibrations of Cu or O of the CuO$_2$ planes. These results indicate the interplay among spin, charge, and lattice dynamics and suggest that the intensity enhancement is associated with their composite excitations.


title: Federated Learning over Wireless Networks: A Band-limited Coordinated Descent Approach

abstract: We consider a many-to-one wireless architecture for federated learning at the network edge, where multiple edge devices collaboratively train a model using local data. The unreliable nature of wireless connectivity, together with constraints in computing resources at edge devices, dictates that the local updates at edge devices should be carefully crafted and compressed to match the wireless communication resources available and should work in concert with the receiver. Thus motivated, we propose SGD-based bandlimited coordinate descent algorithms for such settings. Specifically, for the wireless edge employing over-the-air computing, a common subset of k-coordinates of the gradient updates across edge devices are selected by the receiver in each iteration, and then transmitted simultaneously over k sub-carriers, each experiencing time-varying channel conditions. We characterize the impact of communication error and compression, in terms of the resulting gradient bias and mean squared error, on the convergence of the proposed algorithms. We then study learning-driven communication error minimization via joint optimization of power allocation and learning rates. Our findings reveal that optimal power allocation across different sub-carriers should take into account both the gradient values and channel conditions, thus generalizing the widely used water-filling policy. We also develop sub-optimal distributed solutions amenable to implementation.


title: A Sub-band Approach to Deep Denoising Wavelet Networks and a Frequency-adaptive Loss for Perceptual Quality

abstract: In this paper, we propose two contributions to neural network based denoising. First, we propose applying separate convolutional layers to each sub-band of discrete wavelet transform (DWT) as opposed to the common usage of DWT which concatenates all sub-bands and applies a single convolution layer. We show that our approach to using DWT in neural networks improves the accuracy notably, due to keeping the sub-band order uncorrupted prior to inverse DWT. Our second contribution is a denoising loss based on top k-percent of errors in frequency domain. A neural network trained with this loss, adaptively focuses on frequencies that it fails to recover the most in each iteration. We show that this loss results into better perceptual quality by providing an image that is more balanced in terms of the errors in frequency components.


title: Follow-the-Regularized-Leader Routes to Chaos in Routing Games

abstract: We study the emergence of chaotic behavior of Follow-the-Regularized Leader (FoReL) dynamics in games. We focus on the effects of increasing the population size or the scale of costs in congestion games, and generalize recent results on unstable, chaotic behaviors in the Multiplicative Weights Update dynamics to a much larger class of FoReL dynamics. We establish that, even in simple linear non-atomic congestion games with two parallel links and any fixed learning rate, unless the game is fully symmetric, increasing the population size or the scale of costs causes learning dynamics to become unstable and eventually chaotic, in the sense of Li-Yorke and positive topological entropy. Furthermore, we show the existence of novel non-standard phenomena such as the coexistence of stable Nash equilibria and chaos in the same game. We also observe the simultaneous creation of a chaotic attractor as another chaotic attractor gets destroyed. Lastly, although FoReL dynamics can be strange and non-equilibrating, we prove that the time average still converges to an exact equilibrium for any choice of learning rate and any scale of costs.

categories: cs.GT cs.LG math.DS nlin.CD physics.soc-ph


title: Twin Augmented Architectures for Robust Classification of COVID-19 Chest X-Ray Images

abstract: The gold standard for COVID-19 is RT-PCR, testing facilities for which are limited and not always optimally distributed. Test results are delayed, which impacts treatment. Expert radiologists, one of whom is a co-author, are able to diagnose COVID-19 positivity from Chest X-Rays (CXR) and CT scans, that can facilitate timely treatment. Such diagnosis is particularly valuable in locations lacking radiologists with sufficient expertise and familiarity with COVID-19 patients. This paper has two contributions. One, we analyse literature on CXR based COVID-19 diagnosis. We show that popular choices of dataset selection suffer from data homogeneity, leading to misleading results. We compile and analyse a viable benchmark dataset from multiple existing heterogeneous sources. Such a benchmark is important for realistically testing models. Our second contribution relates to learning from imbalanced data. Datasets for COVID X-Ray classification face severe class imbalance, since most subjects are COVID -ve. Twin Support Vector Machines (Twin SVM) and Twin Neural Networks (Twin NN) have, in recent years, emerged as effective ways of handling skewed data. We introduce a state-of-the-art technique, termed as Twin Augmentation, for modifying popular pre-trained deep learning models. Twin Augmentation boosts the performance of a pre-trained deep neural network without requiring re-training. Experiments show, that across a multitude of classifiers, Twin Augmentation is very effective in boosting the performance of given pre-trained model for classification in imbalanced settings.


title: A General Descent Aggregation Framework for Gradient-based Bi-level Optimization

abstract: In recent years, a variety of gradient-based methods have been developed to solve Bi-Level Optimization (BLO) problems in machine learning and computer vision areas. However, the theoretical correctness and practical effectiveness of these existing approaches always rely on some restrictive conditions (e.g., Lower-Level Singleton, LLS), which could hardly be satisfied in real-world applications. Moreover, previous literature only proves theoretical results based on their specific iteration strategies, thus lack a general recipe to uniformly analyze the convergence behaviors of different gradient-based BLOs. In this work, we formulate BLOs from an optimistic bi-level viewpoint and establish a new gradient-based algorithmic framework, named Bi-level Descent Aggregation (BDA), to partially address the above issues. Specifically, BDA provides a modularized structure to hierarchically aggregate both the upper- and lower-level subproblems to generate our bi-level iterative dynamics. Theoretically, we establish a general convergence analysis template and derive a new proof recipe to investigate the essential theoretical properties of gradient-based BLO methods. Furthermore, this work systematically explores the convergence behavior of BDA in different optimization scenarios, i.e., considering various solution qualities (i.e., global/local/stationary solution) returned from solving approximation subproblems. Extensive experiments justify our theoretical results and demonstrate the superiority of the proposed algorithm for hyper-parameter optimization and meta-learning tasks. Source code is available at https://github.com/vis-opt-group/BDA.


title: On the Diophantine equation $cx^2+p^{2m}=4y^n$

abstract: Let $c$ be a square-free positive integer and $p$ a prime satisfying $p\nmid c$. Let $h(-c)$ denote the class number of the imaginary quadratic field $\mathbb{Q}(\sqrt{-c})$. In this paper, we consider the Diophantine equation $$cx^2+p^{2m}=4y^n,~~x,y\geq 1, m\geq 0, n\geq 3, \gcd(x,y)=1, \gcd(n,2h(-c))=1,$$ and we describe all its integer solutions. Our main tool here is the prominent result of Bilu, Hanrot and Voutier on existence of primitive divisors in Lehmer sequences.


title: A Benchmark of Ocular Disease Intelligent Recognition: One Shot for Multi-disease Detection

abstract: In ophthalmology, early fundus screening is an economic and effective way to prevent blindness caused by ophthalmic diseases. Clinically, due to the lack of medical resources, manual diagnosis is time-consuming and may delay the condition. With the development of deep learning, some researches on ophthalmic diseases have achieved good results, however, most of them are just based on one disease. During fundus screening, ophthalmologists usually give diagnoses of multi-disease on binocular fundus image, so we release a dataset with 8 diseases to meet the real medical scene, which contains 10,000 fundus images from both eyes of 5,000 patients. We did some benchmark experiments on it through some state-of-the-art deep neural networks. We found simply increasing the scale of network cannot bring good results for multi-disease classification, and a well-structured feature fusion method combines characteristics of multi-disease is needed. Through this work, we hope to advance the research of related fields.


title: Local Well-posedness and Incompressible Limit of the Free-Boundary Problem in Compressible Elastodynamics

abstract: We consider 3D free-boundary compressible elastodynamic system under the Rayleigh-Taylor sign condition. It describes the motion of an isentropic inviscid elastic medium with moving boundary. The deformation tensor satisfies the neo-Hookean linear elasticity. The local well-posedness was proved by Trakhinin [84] by Nash-Moser iteration. In this paper, we give a new proof of the local well-posedness by the combination of classical energy method and hyperbolic approach and also establish the incompressible limit. We apply the tangential smoothing method to define the approximation system. The key observation is that the structure of the wave equation of pressure together with Christodoulou-Lindblad elliptic estimates reduces the energy estimates to the control of tangentially-differentiated wave equations in spite of a potential loss of derivative in the source term. We first establish the nonlinear energy estimate without loss of regularity for the free-boundary compressible elastodynamic system. The energy estimate is also uniform in sound speed which yields the incompressible limit. It is worth emphasizing that our method is completely applicable to compressible Euler equations. Our observation also shows that it is not necessary to include the full time derivatives in boundary energy and analyze higher order wave equations as in the previous works of compressible Euler equations (cf. Lindblad-Luo [59] and Luo [61]) even if we require the energy is uniform in sound speed. Moreover, the enhanced regularity for compressible Euler equations obtained in [59,61] can still be recovered for a slightly compressible elastic medium by further delicate analysis which is completely different from Euler equations.


title: Empirical Characterization of Graph Sampling Algorithms

abstract: Graph sampling allows mining a small representative subgraph from a big graph. Sampling algorithms deploy different strategies to replicate the properties of a given graph in the sampled graph. In this study, we provide a comprehensive empirical characterization of five graph sampling algorithms on six properties of a graph including degree, clustering coefficient, path length, global clustering coefficient, assortativity, and modularity. We extract samples from fifteen graphs grouped into five categories including collaboration, social, citation, technological, and synthetic graphs. We provide both qualitative and quantitative results. We find that there is no single method that extracts true samples from a given graph with respect to the properties tested in this work. Our results show that the sampling algorithm that aggressively explores the neighborhood of a sampled node performs better than the others.


title: SiMaN: Sign-to-Magnitude Network Binarization

abstract: Binary neural networks (BNNs) have attracted broad research interest due to their efficient storage and computational ability. Nevertheless, a significant challenge of BNNs lies in handling discrete constraints while ensuring bit entropy maximization, which typically makes their weight optimization very difficult. Existing methods relax the learning using the sign function, which simply encodes positive weights into +1s, and -1s otherwise. Alternatively, we formulate an angle alignment objective to constrain the weight binarization to {0,+1} to solve the challenge. In this paper, we show that our weight binarization provides an analytical solution by encoding high-magnitude weights into +1s, and 0s otherwise. Therefore, a high-quality discrete solution is established in a computationally efficient manner without the sign function. We prove that the learned weights of binarized networks roughly follow a Laplacian distribution that does not allow entropy maximization, and further demonstrate that it can be effectively solved by simply removing the $\ell_2$ regularization during network training. Our method, dubbed sign-to-magnitude network binarization (SiMaN), is evaluated on CIFAR-10 and ImageNet, demonstrating its superiority over the sign-based state-of-the-arts. Our source code, experimental settings, training logs and binary models are available at https://github.com/lmbxmu/SiMaN.


title: Voice Gender Scoring and Independent Acoustic Characterization of Perceived Masculinity and Femininity

abstract: Previous research has found that voices can provide reliable information to be used for gender classification with a high level of accuracy. In social psychology, perceived masculinity and femininity (masculinity and femininity rated by humans) has often been considered an important feature when investigating the influence of vocal features on social behaviours. While previous studies have characterised the acoustic features that contributed to perceivers' judgements of speakers' masculinity or femininity, there is limited research on developing a machine masculinity/femininity scoring model and characterizing the independent acoustic factors that contribute to perceivers' masculinity and femininity judgements. In this work, we first propose a machine scoring model of perceived masculinity/femininity based on the Extreme Random Forest and then characterize the independent and meaningful acoustic factors that contribute to perceivers' judgements by using a correlation matrix based hierarchical clustering method. Our results show that the machine ratings of masculinity and femininity strongly correlated with the human ratings of masculinity and femininity when we used an optimal speech duration of 7 seconds, with a correlation coefficient of up to .63 for females and .77 for males. Nine independent clusters of acoustic measures were generated from our modelling of femininity judgements for female voices and eight clusters were found for masculinity judgements for male voices. The results revealed that, for both genders, the F0 mean is the most important acoustic measure affecting the judgement of acoustic-related masculinity and femininity. The F3 mean, F4 mean and VTL estimators were found to be highly inter-correlated and appeared in the same cluster, forming the second most significant factor in influencing the assessment of acoustic-related masculinity and femininity.


title: FEWS: Large-Scale, Low-Shot Word Sense Disambiguation with the Dictionary

abstract: Current models for Word Sense Disambiguation (WSD) struggle to disambiguate rare senses, despite reaching human performance on global WSD metrics. This stems from a lack of data for both modeling and evaluating rare senses in existing WSD datasets. In this paper, we introduce FEWS (Few-shot Examples of Word Senses), a new low-shot WSD dataset automatically extracted from example sentences in Wiktionary. FEWS has high sense coverage across different natural language domains and provides: (1) a large training set that covers many more senses than previous datasets and (2) a comprehensive evaluation set containing few- and zero-shot examples of a wide variety of senses. We establish baselines on FEWS with knowledge-based and neural WSD approaches and present transfer learning experiments demonstrating that models additionally trained with FEWS better capture rare senses in existing WSD datasets. Finally, we find humans outperform the best baseline models on FEWS, indicating that FEWS will support significant future work on low-shot WSD.


title: Hunting for direct CP violation in $\bar{B}_s^0 \to {\pi^+}{\pi^-}K^{*0}$

abstract: In perturbative QCD approach, based on the first order of isospin symmetry breaking, we study the direct $CP$ violation in the decay of $\bar{B}_s^0\to\rho(\omega )K^{*0}\to {\pi^+}{\pi^-}K^{*0}$. An interesting mechanism is applied to enlarge the $CP$ violating asymmetry involving the charge symmetry breaking between $\rho$ and $\omega$. We find that the $CP$ violation is large by the $\rho-\omega$ mixing mechanism when the invariant masses of the $\pi^+\pi^-$ pairs is in the vicinity of the $\omega$ resonance. For the decay process of $\bar{B}^0_{s}\to\rho(\omega )K^{*0}\to{\pi^+}{\pi^-}K^{*0}$, the maximum $CP$ violation can reach $-59.12\%$. Furthermore, taking $\rho-\omega$ mixing into account, we calculate the branching ratio for $\bar{B}_s^0 \rightarrow \rho(\omega) K^{*0}$. We also discuss the possibility of observing the predicted $CP$ violation asymmetry at the LHC.


title: Counting Hamiltonian cycles in 2-tiled graphs

abstract: In 1930, Kuratowski showed that $K_{3,3}$ and $K_5$ are the only two minor-minimal non-planar graphs. Robertson and Seymour extended finiteness of the set of forbidden minors for any surface. \v{S}ir\'{a}\v{n} and Kochol showed that there are infinitely many $k$-crossing-critical graphs for any $k\ge 2$, even if restricted to simple $3$-connected graphs. Recently, $2$-crossing-critical graphs have been completely characterized by Bokal, Oporowski, Richter, and Salazar. We present a simplified description of large 2-crossing-critical graphs and use this simplification to count Hamiltonian cycles in such graphs. We generalize this approach to an algorithm counting Hamiltonian cycles in all 2-tiled graphs, thus extending the results of Bodro\v{z}a-Panti\'c, Kwong, Doroslova\v{c}ki, and Panti\'c for $n = 2$.


title: Matter density distribution of general relativistic highly magnetized jets driven by black holes

abstract: High-resolution very long baseline interferometry (VLBI) radio observations have resolved the detailed emission structures of active galactic nucleus jets. General relativistic magnetohydrodynamic (GRMHD) simulations have improved the understanding of jet production physics, although theoretical studies still have difficulties in constraining the origin and distribution of jetted matter. We construct a new steady, axisymmetric GRMHD jet model to obtain approximate solutions of black hole (BH) magnetospheres, and examine the matter density distribution of jets. By assuming fixed poloidal magnetic field shapes that mimic force-free analytic solutions and GRMHD simulation results and assuming constant poloidal velocity at the separation surface, which divides the inflow and outflow, we numerically solve the force-balance between the field lines at the separation surface and analytically solve the distributions of matter velocity and density along the field lines. We find that the densities at the separation surface in our parabolic field models roughly follow $\propto r_{ss}^{-2}$ in the far zone from the BH, where $r_{ss}$ is the radius of the separation surface. When the BH spin is larger or the velocity at the separation surface is smaller, the density at the separation surface becomes concentrated more near the jet edge. Our semi-analytic model, combined with radiative transfer calculations, may help interpret the high-resolution VLBI observations and understand the origin of jetted matter.


title: The Elliptical Potential Lemma for General Distributions with an Application to Linear Thompson Sampling

abstract: In this note, we introduce a general version of the well-known elliptical potential lemma that is a widely used technique in the analysis of algorithms in sequential learning and decision-making problems. We consider a stochastic linear bandit setting where a decision-maker sequentially chooses among a set of given actions, observes their noisy rewards, and aims to maximize her cumulative expected reward over a decision-making horizon. The elliptical potential lemma is a key tool for quantifying uncertainty in estimating parameters of the reward function, but it requires the noise and the prior distributions to be Gaussian. Our general elliptical potential lemma relaxes this Gaussian requirement which is a highly non-trivial extension for a number of reasons; unlike the Gaussian case, there is no closed-form solution for the covariance matrix of the posterior distribution, the covariance matrix is not a deterministic function of the actions, and the covariance matrix is not decreasing with respect to the semidefinite inequality. While this result is of broad interest, we showcase an application of it to prove an improved Bayesian regret bound for the well-known Thompson sampling algorithm in stochastic linear bandits with changing action sets where prior and noise distributions are general. This bound is minimax optimal up to constants.


title: TeraPipe: Token-Level Pipeline Parallelism for Training Large-Scale Language Models

abstract: Model parallelism has become a necessity for training modern large-scale deep language models. In this work, we identify a new and orthogonal dimension from existing model parallel approaches: it is possible to perform pipeline parallelism within a single training sequence for Transformer-based language models thanks to its autoregressive property. This enables a more fine-grained pipeline compared with previous work. With this key idea, we design TeraPipe, a high-performance token-level pipeline parallel algorithm for synchronous model-parallel training of Transformer-based language models. We develop a novel dynamic programming-based algorithm to calculate the optimal pipelining execution scheme given a specific model and cluster configuration. We show that TeraPipe can speed up the training by 5.0x for the largest GPT-3 model with 175 billion parameters on an AWS cluster with 48 p3.16xlarge instances compared with state-of-the-art model-parallel methods. The code for reproduction can be found at https://github.com/zhuohan123/terapipe


title: LEAD: LiDAR Extender for Autonomous Driving

abstract: 3D perception using sensors under vehicle industrial standard is the rigid demand in autonomous driving. MEMS LiDAR emerges with irresistible trend due to its lower cost, more robust, and meeting the mass-production standards. However, it suffers small field of view (FoV), slowing down the step of its population. In this paper, we propose LEAD, i.e., LiDAR Extender for Autonomous Driving, to extend the MEMS LiDAR by coupled image w.r.t both FoV and range. We propose a multi-stage propagation strategy based on depth distributions and uncertainty map, which shows effective propagation ability. Moreover, our depth outpainting/propagation network follows a teacher-student training fashion, which transfers depth estimation ability to depth completion network without any scale error passed. To validate the LiDAR extension quality, we utilize a high-precise laser scanner to generate a ground-truth dataset. Quantitative and qualitative evaluations show that our scheme outperforms SOTAs with a large margin. We believe the proposed LEAD along with the dataset would benefit the community w.r.t depth researches.


title: Through-the-Wall Radar under Electromagnetic Complex Wall: A Deep Learning Approach

abstract: This paper employed deep learning to do two-dimensional, multi-target locating in Through-the-Wall Radar under conditions where the wall is treated as a complex electromagnetic medium. We made five assumptions about the wall and two about the number of targets. There are two target modes available: single target and double targets. The wall scenarios include a homogeneous wall, a wall with an air gap, an inhomogeneous wall, an anisotropic wall, and an inhomogeneous-anisotropic wall. Target locating is accomplished through the use of a deep neural network technique. We constructed a dataset using the Python FDTD module and then modeled it using deep learning. Assuming the wall is a complex electromagnetic medium, we achieved 97.7% accuracy for single-target 2D locating and 94.1% accuracy for two-target locating. Additionally, we noticed a loss of 10% to 20% inaccuracy when noise was added at low SNRs, although this decrease dropped to less than 10% at high SNRs.


title: Manifestations of non-zero Majorana CP violating phases in oscillations of supernova neutrinos

abstract: We investigate effects of non-zero Dirac and Majorana CP violating phases on neutrino-antineutrino oscillations in a magnetic field of astrophysical environments. It is shown that in the presence of strong magnetic fields and dense matter, non-zero CP phases can induce new resonances in the oscillations channels $\nu_e \leftrightarrow \bar{\nu}_e$, $\nu_e \leftrightarrow \bar{\nu}_\mu$ and $\nu_e \leftrightarrow \bar{\nu}_{\tau}$. We also consider all other possible oscillation channels with $\nu_\mu$ and $\nu_\tau$ in the initial state. The resonances can potentially lead to significant phenomena in neutrino oscillations accessible for observation in experiments. In particular, we show that neutrino-antineutrino oscillations combined with Majorana-type CP violation can affect the $\bar{\nu}_e$/$\nu_e$ ratio for neutrinos coming from the supernovae explosion. This effect is more prominent for the normal neutrino mass ordering. The detection of supernovae neutrino fluxes in the future experiments, such as JUNO, DUNE and Hyper-Kamiokande, can give an insight into the nature of CP violation and, consequently, provides a tool for distinguishing the Dirac or Majorana nature of neutrinos.


title: A New Method to Determine the Presence of Continuous Variation in Parameters of Biological Growth Curve Models

abstract: Quantitative assessment of the growth of biological organisms has produced many mathematical equations. Many efforts have been given on statistical identification of the correct growth model from experimental data. Every growth equation is unique in terms of mathematical structures; however, one model may serve as a close approximation of the other by appropriate choice of the parameter(s). It is still a challenging problem to select the best estimating model from a set of model equations whose shapes are similar in nature. Our aim in this manuscript is to develop methodology that will reduce the efforts in model selection. This is achieved by utilizing an existing model selection criterion in an innovative way that reduces the number of model fitting exercises substantially. In this manuscript, we have shown that one model can be obtained from the other by choosing a suitable continuous transformation of the parameters. This idea builds an interconnection between many equations which are scattered in the literature. We also get several new growth equations; out of them large number of equations can be obtained from a few key models. Given a set of training data points and the key models, we utilize the idea of interval specific rate parameter (ISRP) proposed by Bhowmick et al (2014) to obtain a suitable mathematical model for the data. The ISRP profile of the parameters of simpler models indicates the nature of variation in parameters with time, thus, enable the experimenter to extrapolate the inference to more complex models. Our proposed methodology significantly reduces the efforts involved in model fitting exercises. The proposed idea is verified by using simulated and real data sets. In addition, theoretical justifications have been provided by investigating the statistical properties of the estimators.


title: Structure of the meson Regge trajectories

abstract: We investigate the structure of the meson Regge trajectories based on the quadratic form of the spinless Salpeter-type equation. It is found that the forms of the Regge trajectories depend on the energy region. As the employed Regge trajectory formula does not match the energy region, the fitted parameters neither have explicit physical meanings nor obey the constraints although the fitted Regge trajectory can give the satisfactory predictions if the employed formula is appropriate mathematically. Moreover, the consistency of the Regge trajectories obtained from different approaches is discussed. And the Regge trajectories for different mesons are presented. Finally, we show that the masses of the constituents will come into the slope and explain why the slopes of the fitted linear Regge trajectories vary with different kinds of mesons.


title: Belief Propagation List Ordered Statistics Decoding of Polar Codes

abstract: It is shown how to combine ordered statistics decoding (OSD) with CRC-aided belief propagation list (CBPL) decoding of polar codes. Even when the reprocessing order of the OSD is as low as one, the new decoder is shown to significantly improve on CBPL. For reprocessing orders higher than one, we suggest partial reprocessing, where only error patterns associated with the least reliable part of the belief propagation decoded most reliable independent bits are considered. This type of partial reprocessing offers a trade-off between performance and computational complexity.


title: D2A: A Dataset Built for AI-Based Vulnerability Detection Methods Using Differential Analysis

abstract: Static analysis tools are widely used for vulnerability detection as they understand programs with complex behavior and millions of lines of code. Despite their popularity, static analysis tools are known to generate an excess of false positives. The recent ability of Machine Learning models to understand programming languages opens new possibilities when applied to static analysis. However, existing datasets to train models for vulnerability identification suffer from multiple limitations such as limited bug context, limited size, and synthetic and unrealistic source code. We propose D2A, a differential analysis based approach to label issues reported by static analysis tools. The D2A dataset is built by analyzing version pairs from multiple open source projects. From each project, we select bug fixing commits and we run static analysis on the versions before and after such commits. If some issues detected in a before-commit version disappear in the corresponding after-commit version, they are very likely to be real bugs that got fixed by the commit. We use D2A to generate a large labeled dataset to train models for vulnerability identification. We show that the dataset can be used to build a classifier to identify possible false alarms among the issues reported by static analysis, hence helping developers prioritize and investigate potential true positives first.


title: Chandra probes the X-ray variability of M51 ULX-7: evidence of propeller transition and X-ray dips on orbital periods

abstract: We report on the temporal properties of the ULX pulsar M51 ULX-7 inferred from the analysis of the 2018-2020 Swift/XRT monitoring data and archival Chandra data obtained over a period of 33 days in 2012. We find an extended low flux state, which might be indicative of propeller transition, lending further support to the interpretation that the NS is rotating near equilibrium. Alternatively, this off state could be related to a variable super-orbital period. Moreover, we report the discovery of periodic dips in the X-ray light curve that are associated with the binary orbital period. The presence of the dips implies a configuration where the orbital plane of the binary is closer to an edge on orientation, and thus demonstrates that favorable geometries are not necessary in order to observe ULX pulsars.These characteristics are similar to those seen in prototypical X-ray pulsars like Her X-1 and SMC X-1 or other ULX pulsars like NGC 5907 ULX1.


title: A2-FPN for Semantic Segmentation of Fine-Resolution Remotely Sensed Images

abstract: Semantic segmentation using fine-resolution remotely sensed images plays a critical role in many practical applications, such as urban planning, environmental protection, natural and anthropogenic landscape monitoring, etc. However, the automation of semantic segmentation, i.e., automatic categorization/labeling and segmentation is still a challenging task, particularly for fine-resolution images with huge spatial and spectral complexity. Addressing such a problem represents an exciting research field, which paves the way for scene-level landscape pattern analysis and decision making. In this paper, we propose an approach for automatic land segmentation based on the Feature Pyramid Network (FPN). As a classic architecture, FPN can build a feature pyramid with high-level semantics throughout. However, intrinsic defects in feature extraction and fusion hinder FPN from further aggregating more discriminative features. Hence, we propose an Attention Aggregation Module (AAM) to enhance multi-scale feature learning through attention-guided feature aggregation. Based on FPN and AAM, a novel framework named Attention Aggregation Feature Pyramid Network (A2-FPN) is developed for semantic segmentation of fine-resolution remotely sensed images. Extensive experiments conducted on three datasets demonstrate the effectiveness of our A2 -FPN in segmentation accuracy. Code is available at https://github.com/lironui/A2-FPN.


title: Spin injection into vanadium dioxide films from a typical ferromagnetic metal, across the metal-insulator transition of the vanadium dioxide films

abstract: A vanadium dioxide VO2 film shows metal-insulator transition (MIT) induced by changing environmental temperature. We report the temperature dependence of electromotive force properties generated in VO2/Ni80Fe20 bilayer junctions under the ferromagnetic resonance (FMR) of the Ni80Fe20 layer. An electromotive force generated in a VO2/Ni80Fe20 bilayer junction under the FMR showed a small change across the MIT temperature of the VO2 film, while the VO2 film resistance drastically changed. This behavior was not only explained with the temperature dependence of the electromotive force property generated in the Ni80Fe20 film itself under the FMR, but also with the generated electromotive forces due to the inverse spin-Hall effect (ISHE) in the VO2 film under the FMR of the Ni80Fe20 film. That is, we successfully demonstrated the spin injection from a Ni80Fe20 film into a VO2 film across the MIT temperature of the VO2 film.


title: Imaging properties of large field-of-view quadratic metalenses and their applications to fingerprint detection

abstract: Dielectric metasurfaces, extremely thin nanostructured dielectric surfaces, hold promise to replace conventional refractive optics, such as lenses, due to their high performance and compactness. However, designing large field-of-view (FOV) metalenses, which are of particular importance when imaging relatively big objects at short distances, remains one of the most critical challenges. Recently, metalenses implementing a quadratic phase profile have been put forward to solve this problem with a single element, but despite their theoretical ability to provide $180^\circ\,$FOV, imaging over very large FOV has not been demonstrated yet. In this work, we provide an in-depth analysis of the imaging properties of quadratic metalenses and, in particular, show that due to their intrinsic barrel distortion or fish-eye effect, there is a fundamental trade-off between the FOV achievable in a given imaging configuration and the optical resolution of the metalens and/or the detector resolution. To illustrate how to harness the full potential of quadratic metalenses, we apply these considerations to the fingerprint detection problem, and demonstrate experimentally the full imaging of a $5\,$mm fingerprint with features of the order of $100\,\mu$m, with a metalens ten times smaller in size and located at a distance of only $2.5\,$mm away from the object. This constitutes the most compact system reported so far for the fingerprint detection.


title: Energy-conserving integrator for conservative Hamiltonian systems with ten-dimensional phase space

abstract: In this paper, an implicit nonsymplectic exact energy-preserving integrator is specifically designed for a ten-dimensional phase-space conservative Hamiltonian system with five degrees of freedom. It is based on a suitable discretization-averaging of the Hamiltonian gradient, with a second-order accuracy to numerical solutions. A one-dimensional disordered discrete nonlinear Schr\"{o}dinger equation and a post-Newtonian Hamiltonian system of spinning compact binaries are taken as our two examples. We demonstrate numerically that the proposed algorithm exhibits good long-term performance in the preservation of energy, if roundoff errors are neglected. This result is independent of time steps, initial orbital eccentricities, and regular and chaotic orbital dynamical behavior. In particular, the application of appropriately large time steps to the new algorithm is helpful in reducing time-consuming and roundoff errors. This new method, combined with fast Lyapunov indicators, is well suited related to chaos in the two example problems. It is found that chaos in the former system is mainly responsible for one of the parameters. In the latter problem, a combination of small initial separations and high initial eccentricities can easily induce chaos.


title: Wreath products of groups acting with bounded orbits

abstract: If $\textbf{S}$ is a subcategory of metric spaces, we say that a group G has property $B\textbf{S}$ if any isometric action on an $\textbf{S}$-space has bounded orbits. Examples of such subcategories include metric spaces, affine real Hilbert spaces, CAT(0) cube complexes, connected median graphs, trees or ultra-metric spaces. The corresponding properties $B\textbf{S}$ are respectively Bergman's property, property FH (which, for countable groups, is equivalent to the celebrated Kazhdan's property (T)), property FW (both for CAT(0) cube complexes and for connected median graphs), property FA and uncountable cofinality. Historically many of these properties were defined using the existence of fixed points. Our main result is that for many subcategories $\textbf{S}$, the wreath product $G\wr_XH$ has property $B\textbf{S}$ if and only if both $G$ and $H$ have property $B\textbf{S}$ and $X$ is finite. On one hand, this encompasses in a general setting previously known results for properties FH and FW. On the other hand, this also applies to the Bergman's property. Finally, we also obtain that $G\wr_XH$ has uncountable cofinality if and only if both $G$ and $H$ have uncountable cofinality and $H$ acts on $X$ with finitely many orbits.


title: Reversible Random Walks on Dynamic Graphs

abstract: Recently, random walks on dynamic graphs have been studied because of their adaptivity to the time-varying structure of real-world networks. In general, there is a tremendous gap between static and dynamic graph settings for the lazy simple random walk: Although $O(n^3)$ cover time was shown for any static graphs of $n$ vertices, there is an edge-changing dynamic graph with an exponential hitting time. On the other hand, previous works indicate that the random walk on a dynamic graph with a time-homogeneous stationary distribution behaves almost identically to that on a static graph. In this paper, we strengthen this insight by obtaining general and improved bounds. Specifically, we consider a random walk according to a sequence $(P_t)_{t\geq 1}$ of irreducible and reversible transition matrices such that all $P_t$ have the same stationary distribution. We bound the mixing, hitting, and cover times in terms of the hitting and relaxation times of the random walk according to the worst fixed $P_t$. Moreover, we obtain the first bounds of the hitting and cover times of multiple random walks and the coalescing time on dynamic graphs. These bounds can be seen as an extension of the well-known bounds of random walks on static graphs. Our results generalize the previous upper bounds for specific random walks on dynamic graphs, e.g., lazy simple random walks and $d_{\max}$-lazy walks, and give improved and tight upper bounds in various cases. As an interesting consequence of our generalization, we obtain tight bounds for the lazy Metropolis walk [Nonaka, Ono, Sadakane, and Yamashita, TCS10] on any dynamic graph: $O(n^2)$ mixing time, $O(n^2)$ hitting time, and $O(n^2\log n)$ cover time. Additionally, our coalescing time bound implies the consensus time bound of the pull voting on a dynamic graph.


title: DAN-Net: Dual-Domain Adaptive-Scaling Non-local Network for CT Metal Artifact Reduction

abstract: Metal implants can heavily attenuate X-rays in computed tomography (CT) scans, leading to severe artifacts in reconstructed images, which significantly jeopardize image quality and negatively impact subsequent diagnoses and treatment planning. With the rapid development of deep learning in the field of medical imaging, several network models have been proposed for metal artifact reduction (MAR) in CT. Despite the encouraging results achieved by these methods, there is still much room to further improve performance. In this paper, a novel Dual-domain Adaptive-scaling Non-local network (DAN-Net) for MAR. We correct the corrupted sinogram using adaptive scaling first to preserve more tissue and bone details as a more informative input. Then, an end-to-end dual-domain network is adopted to successively process the sinogram and its corresponding reconstructed image generated by the analytical reconstruction layer. In addition, to better suppress the existing artifacts and restrain the potential secondary artifacts caused by inaccurate results of the sinogram-domain network, a novel residual sinogram learning strategy and nonlocal module are leveraged in the proposed network model. In the experiments, the proposed DAN-Net demonstrates performance competitive with several state-of-the-art MAR methods in both qualitative and quantitative aspects.


title: A Mental Trespass? Unveiling Truth, Exposing Thoughts and Threatening Civil Liberties with Non-Invasive AI Lie Detection

abstract: Imagine an app on your phone or computer that can tell if you are being dishonest, just by processing affective features of your facial expressions, body movements, and voice. People could ask about your political preferences, your sexual orientation, and immediately determine which of your responses are honest and which are not. In this paper we argue why artificial intelligence-based, non-invasive lie detection technologies are likely to experience a rapid advancement in the coming years, and that it would be irresponsible to wait any longer before discussing its implications. Legal and popular perspectives are reviewed to evaluate the potential for these technologies to cause societal harm. To understand the perspective of a reasonable person, we conducted a survey of 129 individuals, and identified consent and accuracy as the major factors in their decision-making process regarding the use of these technologies. In our analysis, we distinguish two types of lie detection technology, accurate truth metering and accurate thought exposing. We generally find that truth metering is already largely within the scope of existing US federal and state laws, albeit with some notable exceptions. In contrast, we find that current regulation of thought exposing technologies is ambiguous and inadequate to safeguard civil liberties. In order to rectify these shortcomings, we introduce the legal concept of mental trespass and use this concept as the basis for proposed regulation.


title: TransFuse: Fusing Transformers and CNNs for Medical Image Segmentation

abstract: Medical image segmentation - the prerequisite of numerous clinical needs - has been significantly prospered by recent advances in convolutional neural networks (CNNs). However, it exhibits general limitations on modeling explicit long-range relation, and existing cures, resorting to building deep encoders along with aggressive downsampling operations, leads to redundant deepened networks and loss of localized details. Hence, the segmentation task awaits a better solution to improve the efficiency of modeling global contexts while maintaining a strong grasp of low-level details. In this paper, we propose a novel parallel-in-branch architecture, TransFuse, to address this challenge. TransFuse combines Transformers and CNNs in a parallel style, where both global dependency and low-level spatial details can be efficiently captured in a much shallower manner. Besides, a novel fusion technique - BiFusion module is created to efficiently fuse the multi-level features from both branches. Extensive experiments demonstrate that TransFuse achieves the newest state-of-the-art results on both 2D and 3D medical image sets including polyp, skin lesion, hip, and prostate segmentation, with significant parameter decrease and inference speed improvement.


title: Unidirectional Alignment of AgCN Microwires on Distorted Transition Metal Dichalcogenide Crystals

abstract: Van der Waals epitaxy on the surface of two-dimensional (2D) layered crystals has gained significant research interest for the assembly of well-ordered nanostructures and fabrication of vertical heterostructures based on 2D crystals. Although van der Waals epitaxial assembly on the hexagonal phase of transition metal dichalcogenides (TMDCs) has been relatively well characterized, a comparable study on the distorted octahedral phase (1T' or Td) of TMDCs is largely lacking. Here we investigate the assembly behavior of one-dimensional (1D) AgCN microwires on various distorted TMDC crystals, namely 1T'-MoTe2, Td-WTe2, and 1T'-ReS2. The unidirectional alignment of AgCN chains is observed on these crystals, reflecting the symmetry of underlying distorted TMDCs. Polarized Raman spectroscopy and transmission electron microscopy directly confirm that AgCN chains display the remarkable alignment behavior along the distorted chain directions of underlying TMDCs. The observed unidirectional assembly behavior can be attributed to the favorable adsorption configurations of 1D chains along the substrate distortion, which is supported by our theoretical calculations and observation of similar assembly behavior from different cyanide chains. The aligned AgCN microwires can be harnessed as facile markers to identify polymorphs and crystal orientations of TMDCs.


title: Skew group categories, algebras associated to Cartan matrices and folding of root lattices

abstract: For a finite group action on a finite EI quiver, we construct its `orbifold' quotient EI quiver. The free EI category associated to the quotient EI quiver is equivalent to the skew group category with respect to the given group action. Specializing the result to a finite group action on a finite acyclic quiver, we prove that, under reasonable conditions, the skew group category of the path category is equivalent to a finite EI category of Cartan type. If the ground field is of characteristic $p$ and the acting group is a cyclic $p$-group, we prove that the skew group algebra of the path algebra is Morita equivalent to the algebra associated to a Cartan matrix, defined in [C. Geiss, B. Leclerc, and J. Schr\"{o}er, Quivers with relations for symmetrizable Cartan matrices I: Foundations, Invent. Math. 209 (2017), 61--158]. We apply the Morita equivalence to construct a categorification of the folding projection between the root lattices with respect to a graph automorphism. In the Dynkin cases, the restriction of the categorification to indecomposable modules corresponds to the folding of positive roots.


title: On regularity of solutions for certain linear Boltzmann transport equations

abstract: The paper considers a class of linear Boltzmann transport equations which models a charged particle transport. The equation is an approximation of the original exact transport equation which involves hyper-singular integrals in their collision terms. Hyper-singular integrals can be approximated by partial differential operators together with partial integral operators which leads to an approximation under consideration. This type of approximation is applied, for example in the dose calculation of radiation therapy. The related transport problem is an initial inflow boundary value problem. Regularity results of solutions are verified utilizing the scales of relevant anisotropic Sobolev spaces.


title: EfficientLPS: Efficient LiDAR Panoptic Segmentation

abstract: Panoptic segmentation of point clouds is a crucial task that enables autonomous vehicles to comprehend their vicinity using their highly accurate and reliable LiDAR sensors. Existing top-down approaches tackle this problem by either combining independent task-specific networks or translating methods from the image domain ignoring the intricacies of LiDAR data and thus often resulting in sub-optimal performance. In this paper, we present the novel top-down Efficient LiDAR Panoptic Segmentation (EfficientLPS) architecture that addresses multiple challenges in segmenting LiDAR point clouds including distance-dependent sparsity, severe occlusions, large scale-variations, and re-projection errors. EfficientLPS comprises of a novel shared backbone that encodes with strengthened geometric transformation modeling capacity and aggregates semantically rich range-aware multi-scale features. It incorporates new scale-invariant semantic and instance segmentation heads along with the panoptic fusion module which is supervised by our proposed panoptic periphery loss function. Additionally, we formulate a regularized pseudo labeling framework to further improve the performance of EfficientLPS by training on unlabelled data. We benchmark our proposed model on two large-scale LiDAR datasets: nuScenes, for which we also provide ground truth annotations, and SemanticKITTI. Notably, EfficientLPS sets the new state-of-the-art on both these datasets.


title: Strange duality between the quadrangle complete intersection singularities

abstract: There is a strange duality between the quadrangle isolated complete intersection singularities discovered by the first author and C.T.C.Wall. We derive this duality from the mirror symmetry, the Berglund-H\"ubsch transposition of invertible polynomials, and our previous results about the strange duality between hypersurface and complete intersection singularities using matrix factorizations of size two.


title: Fluid-structure interaction simulations with a LES filtering approach in solids4Foam

abstract: The goal of this paper is to test solids4Foam, the fluid-structure interaction (FSI) toolbox developed for foam-extend (a branch of OpenFOAM), and assess its flexibility in handling more complex flows. For this purpose, we consider the interaction of an incompressible fluid described by a Leray model with a hyperelastic structure modeled as a Saint Venant-Kirchhoff material. We focus on a strongly coupled, partitioned fluid-structure interaction (FSI) solver in a finite volume environment, combined with an arbitrary Lagrangian-Eulerian approach to deal with the motion of the fluid domain. For the implementation of the Leray model, which features a nonlinear differential low-pass filter, we adopt a three-step algorithm called Evolve-Filter-Relax. We validate our approach against numerical data available in the literature for the 3D cross flow past a cantilever beam at Reynolds number 100 and 400.


title: Training Stacked Denoising Autoencoders for Representation Learning

abstract: We implement stacked denoising autoencoders, a class of neural networks that are capable of learning powerful representations of high dimensional data. We describe stochastic gradient descent for unsupervised training of autoencoders, as well as a novel genetic algorithm based approach that makes use of gradient information. We analyze the performance of both optimization algorithms and also the representation learning ability of the autoencoder when it is trained on standard image classification datasets.


title: Temporal-Amount Snapshot MultiGraph for Ethereum Transaction Tracking

abstract: With the wide application of blockchain in the financial field, the rise of various types of cybercrimes has brought great challenges to the security of blockchain. In order to better understand this emerging market and explore more efficient countermeasures for effective supervision, it is imperative to track transactions on blockchain-based systems. Due to the openness of Ethereum, we can easily access the publicly available transaction records, model them as a complex network, and further study the problem of transaction tracking via link prediction, which provides a deeper understanding of Ethereum transactions from a network perspective. Specifically, we introduce an embedding based link prediction framework that is composed of temporal-amount snapshot multigraph (TASMG) and present temporal-amount walk (TAW). By taking the realistic rules and features of transaction networks into consideration, we propose TASMG to model Ethereum transaction records as a temporal-amount network and then present TAW to effectively embed accounts via their transaction records, which integrates temporal and amount information of the proposed network. Experimental results demonstrate the superiority of the proposed framework in learning more informative representations and could be an effective method for transaction tracking.


title: Representing Hierarchical Structure by Using Cone Embedding

abstract: Graph embedding is becoming an important method with applications in various areas, including social networks and knowledge graph completion. In particular, Poincar\'e embedding has been proposed to capture the hierarchical structure of graphs, and its effectiveness has been reported. However, most of the existing methods have isometric mappings in the embedding space, and the choice of the origin point can be arbitrary. This fact is not desirable when the distance from the origin is used as an indicator of hierarchy, as in the case of Poincar\'e embedding. In this paper, we propose cone embedding, embedding method in a metric cone, which solve these problems, and we gain further benefits: 1) we provide an indicator of hierarchical information that is both geometrically and intuitively natural to interpret, and 2) we can extract the hierarchical structure from a graph embedding output of other methods by learning additional one-dimensional parameters.


title: Improving speech recognition models with small samples for air traffic control systems

abstract: In the domain of air traffic control (ATC) systems, efforts to train a practical automatic speech recognition (ASR) model always faces the problem of small training samples since the collection and annotation of speech samples are expert- and domain-dependent task. In this work, a novel training approach based on pretraining and transfer learning is proposed to address this issue, and an improved end-to-end deep learning model is developed to address the specific challenges of ASR in the ATC domain. An unsupervised pretraining strategy is first proposed to learn speech representations from unlabeled samples for a certain dataset. Specifically, a masking strategy is applied to improve the diversity of the sample without losing their general patterns. Subsequently, transfer learning is applied to fine-tune a pretrained or other optimized baseline models to finally achieves the supervised ASR task. By virtue of the common terminology used in the ATC domain, the transfer learning task can be regarded as a sub-domain adaption task, in which the transferred model is optimized using a joint corpus consisting of baseline samples and new transcribed samples from the target dataset. This joint corpus construction strategy enriches the size and diversity of the training samples, which is important for addressing the issue of the small transcribed corpus. In addition, speed perturbation is applied to augment the new transcribed samples to further improve the quality of the speech corpus. Three real ATC datasets are used to validate the proposed ASR model and training strategies. The experimental results demonstrate that the ASR performance is significantly improved on all three datasets, with an absolute character error rate only one-third of that achieved through the supervised training. The applicability of the proposed strategies to other ASR approaches is also validated.


title: Multi-level stochastic refinement for complex time series and fields: A Data-Driven Approach

abstract: Spatio-temporally extended nonlinear systems often exhibit a remarkable complexity in space and time. In many cases, extensive datasets of such systems are difficult to obtain, yet needed for a range of applications. Here, we present a method to generate synthetic time series or fields that reproduce statistical multi-scale features of complex systems. The method is based on a hierarchical refinement employing transition probability density functions (PDFs) from one scale to another. We address the case in which such PDFs can be obtained from experimental measurements or simulations and then used to generate arbitrarily large synthetic datasets. The validity of our approach is demonstrated at the example of an experimental dataset of high Reynolds number turbulence.


title: Reaction-diffusion fronts in funnel-shaped domains

abstract: We consider bistable reaction-diffusion equations in funnel-shaped domains of R N made up of straight parts and conical parts with positive opening angles. We study the large time dynamics of entire solutions emanating from a planar front in the straight part of such a domain and moving into the conical part. We show a dichotomy between blocking and spreading, by proving especially some new Liouville type results on stable solutions of semilinear elliptic equations in the whole space R N. We also show that any spreading solution is a transition front having a global mean speed, which is the unique speed of planar fronts, and that it converges at large time in the conical part of the domain to a well-formed front whose position is approximated by expanding spheres. Moreover, we provide sufficient conditions on the size R of the straight part of the domain and on the opening angle $\alpha$ of the conical part, under which the solution emanating from a planar front is blocked or spreads completely in the conical part. We finally show the openness of the set of parameters (R, $\alpha$) for which the propagation is complete.


title: Computing isogenies between jacobians of hyperelliptic curves of arbitrary genus via differential equations

abstract: Let $p$ be an odd prime number and be an integer coprime to $p$. We survey an algorithm for computing explicit rational representations of $(\ell,...,\ell)$-isogenies between Jacobians of hyperelliptic curves of arbitrary genus over an extension $K$ of the field of $p$-adic numbers $\mathbb{Q}\_p$. The algorithm has a quasi-linear complexity in $\ell$ as well as in the genus of the curves.


title: A Thorough View of Exact Inference in Graphs from the Degree-4 Sum-of-Squares Hierarchy

abstract: Performing inference in graphs is a common task within several machine learning problems, e.g., image segmentation, community detection, among others. For a given undirected connected graph, we tackle the statistical problem of exactly recovering an unknown ground-truth binary labeling of the nodes from a single corrupted observation of each edge. Such problem can be formulated as a quadratic combinatorial optimization problem over the boolean hypercube, where it has been shown before that one can (with high probability and in polynomial time) exactly recover the ground-truth labeling of graphs that have an isoperimetric number that grows with respect to the number of nodes (e.g., complete graphs, regular expanders). In this work, we apply a powerful hierarchy of relaxations, known as the sum-of-squares (SoS) hierarchy, to the combinatorial problem. Motivated by empirical evidence on the improvement in exact recoverability, we center our attention on the degree-4 SoS relaxation and set out to understand the origin of such improvement from a graph theoretical perspective. We show that the solution of the dual of the relaxed problem is related to finding edge weights of the Johnson and Kneser graphs, where the weights fulfill the SoS constraints and intuitively allow the input graph to increase its algebraic connectivity. Finally, as byproduct of our analysis, we derive a novel Cheeger-type lower bound for the algebraic connectivity of graphs with signed edge weights.


title: Concentration of measure and generalized product of random vectors with an application to Hanson-Wright-like inequalities

abstract: Starting from concentration of measure hypotheses on $m$ random vectors $Z_1,\ldots, Z_m$, this article provides an expression of the concentration of functionals $\phi(Z_1,\ldots, Z_m)$ where the variations of $\phi$ on each variable depend on the product of the norms (or semi-norms) of the other variables (as if $\phi$ were a product). We illustrate the importance of this result through various generalizations of the Hanson-Wright concentration inequality as well as through a study of the random matrix $XDX^T$ and its resolvent $Q = (I_p - \frac{1}{n}XDX^T)^{-1}$, where $X$ and $D$ are random, which have fundamental interest in statistical machine learning applications.


title: Uncertainty-based method for improving poorly labeled segmentation datasets

abstract: The success of modern deep learning algorithms for image segmentation heavily depends on the availability of large datasets with clean pixel-level annotations (masks), where the objects of interest are accurately delineated. Lack of time and expertise during data annotation leads to incorrect boundaries and label noise. It is known that deep convolutional neural networks (DCNNs) can memorize even completely random labels, resulting in poor accuracy. We propose a framework to train binary segmentation DCNNs using sets of unreliable pixel-level annotations. Erroneously labeled pixels are identified based on the estimated aleatoric uncertainty of the segmentation and are relabeled to the true value.


title: An example of a Brauer-Manin obstruction to weak approximation at a prime with good reduction

abstract: Following Bright and Newton, we construct an explicit K$3$ surface over the rational numbers having good reduction at 2, and for which 2 is the only prime at which weak approximation is obstructed.


title: Joint self-supervised blind denoising and noise estimation

abstract: We propose a novel self-supervised image blind denoising approach in which two neural networks jointly predict the clean signal and infer the noise distribution. Assuming that the noisy observations are independent conditionally to the signal, the networks can be jointly trained without clean training data. Therefore, our approach is particularly relevant for biomedical image denoising where the noise is difficult to model precisely and clean training data are usually unavailable. Our method significantly outperforms current state-of-the-art self-supervised blind denoising algorithms, on six publicly available biomedical image datasets. We also show empirically with synthetic noisy data that our model captures the noise distribution efficiently. Finally, the described framework is simple, lightweight and computationally efficient, making it useful in practical cases.


title: Poincar\'e series of multiplier and test ideals

abstract: We prove the rationality of the Poincar\'e series of multiplier ideals in any dimension and thus extending the main results for surfaces of Galindo and Monserrat and Alberich-Carrami\~nana et al. Our results also hold for Poincar\'e series of test ideals. In order to do so, we introduce a theory of Hilbert functions indexed over $\mathbb{R}$ which gives an unified treatment of both cases.


title: Beyond Horndeski interactions induced by quantum effects

abstract: Opportunity to generate beyond Horndeski interactions is addressed. An amplitude generating a certain beyond Horndeski coupling is explicitly found. The amplitude is free from ultraviolet divergences, so it is protected from ultraviolet contributions and can be considered as a universal prediction of effective field theory.


title: EDITH :ECG biometrics aided by Deep learning for reliable Individual auTHentication

abstract: In recent years, physiological signal based authentication has shown great promises,for its inherent robustness against forgery. Electrocardiogram (ECG) signal, being the most widely studied biosignal, has also received the highest level of attention in this regard. It has been proven with numerous studies that by analyzing ECG signals from different persons, it is possible to identify them, with acceptable accuracy. In this work, we present, EDITH, a deep learning-based framework for ECG biometrics authentication system. Moreover, we hypothesize and demonstrate that Siamese architectures can be used over typical distance metrics for improved performance. We have evaluated EDITH using 4 commonly used datasets and outperformed the prior works using less number of beats. EDITH performs competitively using just a single heartbeat (96-99.75% accuracy) and can be further enhanced by fusing multiple beats (100% accuracy from 3 to 6 beats). Furthermore, the proposed Siamese architecture manages to reduce the identity verification Equal Error Rate (EER) to 1.29%. A limited case study of EDITH with real-world experimental data also suggests its potential as a practical authentication system.


title: Near-unity third-harmonic circular dichroism driven by quasi-BIC in asymmetric silicon metasurfaces

abstract: We use numerical simulations to demonstrate third-harmonic generation with near-unity nonlinear circular dichroism (CD) and high conversion efficiency ($ 10^{-2}\ \text{W}^{-2}$) in asymmetric Si-on-SiO$_2$ metasurfaces. The working principle relies on the selective excitation of a quasi-bound state in the continuum, characterized by a very high ($>10^5$) quality-factor. By tuning multi-mode interference with the variation of the metasurface geometrical parameters, we show the possibility of independent control of linear CD and nonlinear CD. Our results pave the way for the development of all-dielectric metasurfaces for nonlinear chiro-optical devices with high conversion efficiency.


title: Electron beam transverse phase space tomography using nanofabricated wire scanners with submicrometer resolution

abstract: Characterization and control of the transverse phase space of high-brightness electron beams is required at free-electron lasers or electron diffraction experiments for emittance measurement and beam optimization as well as at advanced acceleration experiments. Dielectric laser accelerators or plasma accelerators with external injection indeed require beam sizes at the micron level and below. We present a method using nano-fabricated metallic wires oriented at different angles to obtain projections of the transverse phase space by scanning the wires through the beam and detecting the amount of scattered particles. Performing this measurement at several locations along the waist allows assessing the transverse distribution at different phase advances. By applying a novel tomographic algorithm the transverse phase space density can be reconstructed. Measurements at the ACHIP chamber at SwissFEL confirm that the transverse phase space of micrometer-sized electron beams can be reliably characterized using this method.


title: Transferring Domain Knowledge with an Adviser in Continuous Tasks

abstract: Recent advances in Reinforcement Learning (RL) have surpassed human-level performance in many simulated environments. However, existing reinforcement learning techniques are incapable of explicitly incorporating already known domain-specific knowledge into the learning process. Therefore, the agents have to explore and learn the domain knowledge independently through a trial and error approach, which consumes both time and resources to make valid responses. Hence, we adapt the Deep Deterministic Policy Gradient (DDPG) algorithm to incorporate an adviser, which allows integrating domain knowledge in the form of pre-learned policies or pre-defined relationships to enhance the agent's learning process. Our experiments on OpenAi Gym benchmark tasks show that integrating domain knowledge through advisers expedites the learning and improves the policy towards better optima.


title: The Brundan-Kleshchev subalgebra and BK-type isomorphsims

abstract: We use a unified method to give an isomorphism between direct sums of cyclotomic affine (and degenerate affine) Hecke algebras and cyclotomic BK-subalgebras which are some KLR-type algebras.


title: An analytic characterization of the symmetric extension of a Herglotz-Nevanlinna function in several variables

abstract: In this paper, we derive an analytic characterization of the symmetric extension of a Herglotz-Nevanlinna function in several variables. Here, the main tools used are the so-called variable non-dependence property and the symmetry formula satisfied by Herglotz-Nevanlinna function and Cauchy-type functions. We also provide an extension of the Stieltjes inversion formula for Cauchy-type functions.


title: On algebraic group varieties

abstract: Several results on presenting an affine algebraic group variety as a product of algebraic varieties are obtained.


title: Propagating Fronts for a Viscous Hamer-Type system

abstract: Motivated by radiation hydrodynamics, we analyse a 2x2 system consisting of a one-dimensional viscous conservation law with strictly convex flux -- the viscous Burgers' equation being a paradigmatic example -- coupled with an elliptic equation, named viscous Hamer-type system. In the regime of small viscosity and for large shocks, namely when the profile of the corresponding underlying inviscid model undergoes a discontinuity -- usually called sub-shock -- it is proved the existence of a smooth propagating front, regularising the jump of the corresponding inviscid equation. The proof is based on Geometric Singular Perturbation Theory (GSPT) as introduced in the pioneering work of Fenichel [5] and subsequently developed by Szmolyan [19]. In addition, the case of small shocks and large viscosity is also addressed via a standard bifurcation argument.