title: Exploring the change of semiconductor hole mass under Coulomb scattering

abstract: Semiconductor valence holes are known to have heavy and light effective masses; but the consequence of this mass difference on Coulomb scatterings has been considered intractable and thus ignored up to now. The reason is that the heavy/light index is quantized along the hole momentum that changes in a Coulomb scattering; so, a heavy hole can turn light, depending on the scattering angle. This mass change has never been taken into account in many-body problems, and a single ``average'' hole mass has been used instead. In order to study the missed consequences of this crude approximation, the first necessary step is to determine the Coulomb scatterings with valence holes in a precise way. We here derive these scatterings from scratch, starting from the threefold valence-electron spatial level, all the way through the spin-orbit splitting, the Kohn-Luttinger effective Hamiltonian, its spherical approximation, and the phase factors that appear when turning from valence electron to hole operators, that is, all the points of semiconductor physics that render valence holes so different from a na\"{i}ve positive charge.


title: Automated Learning Rate Scheduler for Large-batch Training

abstract: Large-batch training has been essential in leveraging large-scale datasets and models in deep learning. While it is computationally beneficial to use large batch sizes, it often requires a specially designed learning rate (LR) schedule to achieve a comparable level of performance as in smaller batch training. Especially, when the number of training epochs is constrained, the use of a large LR and a warmup strategy is critical in the final performance of large-batch training due to the reduced number of updating steps. In this work, we propose an automated LR scheduling algorithm which is effective for neural network training with a large batch size under the given epoch budget. In specific, the whole schedule consists of two phases: adaptive warmup and predefined decay, where the LR is increased until the training loss no longer decreases and decreased to zero until the end of training. Here, whether the training loss has reached the minimum value is robustly checked with Gaussian process smoothing in an online manner with a low computational burden. Coupled with adaptive stochastic optimizers such as AdamP and LAMB, the proposed scheduler successfully adjusts the LRs without cumbersome hyperparameter tuning and achieves comparable or better performances than tuned baselines on various image classification benchmarks and architectures with a wide range of batch sizes.


title: eProduct: A Million-Scale Visual Search Benchmark to Address Product Recognition Challenges

abstract: Large-scale product recognition is one of the major applications of computer vision and machine learning in the e-commerce domain. Since the number of products is typically much larger than the number of categories of products, image-based product recognition is often cast as a visual search rather than a classification problem. It is also one of the instances of super fine-grained recognition, where there are many products with slight or subtle visual differences. It has always been a challenge to create a benchmark dataset for training and evaluation on various visual search solutions in a real-world setting. This motivated creation of eProduct, a dataset consisting of 2.5 million product images towards accelerating development in the areas of self-supervised learning, weakly-supervised learning, and multimodal learning, for fine-grained recognition. We present eProduct as a training set and an evaluation set, where the training set contains 1.3M+ listing images with titles and hierarchical category labels, for model development, and the evaluation set includes 10,000 query and 1.1 million index images for visual search evaluation. We will present eProduct's construction steps, provide analysis about its diversity and cover the performance of baseline models trained on it.


title: Neural networks for on-the-fly single-shot state classification

abstract: Neural networks have proven to be efficient for a number of practical applications ranging from image recognition to identifying phase transitions in quantum physics models. In this paper we investigate the application of neural networks to state classification in a single-shot quantum measurement. We use dispersive readout of a superconducting transmon circuit to demonstrate an increase in assignment fidelity for both two and three state classification. More importantly, our method is ready for on-the-fly data processing without overhead or need for large data transfer to a hard drive. In addition we demonstrate the capacity of neural networks to be trained against experimental imperfections, such as phase drift of a local oscillator in a heterodyne detection scheme.


title: Multi-Objective Graph Heuristic Search for Terrestrial Robot Design

abstract: We present methods for co-designing rigid robots over control and morphology (including discrete topology) over multiple objectives. Previous work has addressed problems in single-objective robot co-design or multi-objective control. However, the joint multi-objective co-design problem is extremely important for generating capable, versatile, algorithmically designed robots. In this work, we present Multi-Objective Graph Heuristic Search, which extends a single-objective graph heuristic search from previous work to enable a highly efficient multi-objective search in a combinatorial design topology space. Core to this approach, we introduce a new universal, multi-objective heuristic function based on graph neural networks that is able to effectively leverage learned information between different task trade-offs. We demonstrate our approach on six combinations of seven terrestrial locomotion and design tasks, including one three-objective example. We compare the captured Pareto fronts across different methods and demonstrate that our multi-objective graph heuristic search quantitatively and qualitatively outperforms other techniques.


title: AUC Optimization for Robust Small-footprint Keyword Spotting with Limited Training Data

abstract: Deep neural networks provide effective solutions to small-footprint keyword spotting (KWS). However, if training data is limited, it remains challenging to achieve robust and highly accurate KWS in real-world scenarios where unseen sounds that are out of the training data are frequently encountered. Most conventional methods aim to maximize the classification accuracy on the training set, without taking the unseen sounds into account. To enhance the robustness of the deep neural networks based KWS, in this paper, we introduce a new loss function, named the maximization of the area under the receiver-operating-characteristic curve (AUC). The proposed method not only maximizes the classification accuracy of keywords on the closed training set, but also maximizes the AUC score for optimizing the performance of non-keyword segments detection. Experimental results on the Google Speech Commands dataset v1 and v2 show that our method achieves new state-of-the-art performance in terms of most evaluation metrics.


title: Exponentially convergent trapezoidal rules to approximate fractional powers of operators

abstract: In this paper we are interested in the approximation of fractional powers of self-adjoint positive operators. Starting from the integral representation of the operators, we apply the trapezoidal rule combined with a single-exponential and a double-exponential transform of the integrand function. For the first approach our aim is only to review some theoretical aspects in order to refine the choice of the parameters that allow a faster convergence. As for the double exponential transform, in this work we show how to improve the existing error estimates for the scalar case and also extend the analysis to operators. We report some numerical experiments to show the reliability of the estimates obtained.


title: Quantum conditional probabilities

abstract: We investigate the consistency of conditional quantum probabilities. This is whether there is compatibility between the Kolmogorov-Bayes conditional probabilities and the Born rule. We show that they are not compatible in the sense that there are situations where there is no legitimate density matrix that may reproduce the conditional statistics of the other observable via the Born rule. This is to say that the Gleason theorem does not apply to conditional probabilities. Moreover, we show that when this occurs the joint statistics is nonclassical. We show that conditional probabilities are not equivalent to state reduction, so these results do not affect the validity of the L\"{u}ders expression.


title: Dynamical and static spin structure factors of Heisenberg antiferromagnet on honeycomb lattice in the presence of Dzyaloshinskii-Moriya interaction

abstract: We have theoretically studied the spin structure factors of Heisenberg model on honeycomb lattice in the presence of longitudinal magnetic field, i.e. magnetic field perpendicular to the honeycomb plane, and Dzyaloshinskii-Moriya interaction. The possible effects of next nearest neighbor exchange constant are investigated in terms of anisotropy in the Heisenberg interactions. This spatial anisotropy is due to the difference between nearest neighbor exchange coupling constant and next nearest neighbor exchange coupling constant. The original spin model hamiltonian is mapped to a bosonic model via a hard core bosonic transformation where an infinite hard core repulsion is imposed to constrain one boson occupation per site. Using Green's function approach, the energy spectrum of quasiparticle excitation has been obtained. The spectrum of the bosonic gas has been implemented in order to obtain two particle propagator which corresponds to spin structure factor of original Heisenberg chain model Hamiltonian. The results show the position of peak in the dynamical transverse spin structure factor at fixed value for Dzyaloshinskii Moriya interaction moves to higher frequency with magnetic field. Also the intensity of dynamical transverse spin structure factor is not affected by magnetic field. However the Dzyaloshinskii Moriya interaction strength causes to decrease the intensity of dynamical transverse spin structure factor. The increase of magnetic field does not varied the frequency position of peaks in dynamical longitudinal spin susceptibility however the intensity reduces with magnetic field. Our results show static transverse structure factor is found to be monotonically decreasing with magnetic field and temperature for different vlaues of next nearest neighbor coupling exchange constant.


title: Toward Safe Integration of Legacy SCADA Systems in the Smart Grid

abstract: A SCADA system is a distributed network of cyber-physical devices used for instrumentation and control of critical infrastructures such as an electric power grid. With the emergence of the smart grid, SCADA systems are increasingly required to be connected to more open systems and security becomes crucial. However, many of these SCADA systems have been deployed for decades and were initially not designed with security in mind. In particular, the field devices in these systems are vulnerable to false command injection from an intruding or compromised device. But implementing cryptographic defence on these old-generation devices is challenging due to their computation constraints. As a key requirement, solutions to protect legacy SCADA systems have to be an add-on. This paper discusses two add-on defence strategies for legacy SCADA systems -- the data diode and the detect-and-respond approach -- and compares their security guarantees and applicable scenarios. A generic architectural framework is also proposed to implement the detect-and-respond strategy, with an instantiation to demonstrate its practicality.


title: Eddy saturation in a reduced two-level model of the atmosphere

abstract: Eddy saturation describes the nonlinear mechanism in geophysical flows whereby, when average conditions are considered, direct forcing of the zonal flow increases the eddy kinetic energy, while the energy associated with the zonal flow does not increase. Here we present a minimal baroclinic model that exhibits complete eddy saturation. Starting from Phillips' classical quasi-geostrophic two-level model on the beta channel of the mid-latitudes, we derive a reduced order model comprising of six ordinary differential equations including parameterised eddies. This model features two physically realisable steady state solutions, one a purely zonal flow and one where, additionally, finite eddy motions are present. As the baroclinic forcing in the form of diabatic heating is increased, the zonal solution loses stability and the eddy solution becomes attracting. After this bifurcation, the zonal components of the solution are independent of the baroclinic forcing, and the excess of heat in the low latitudes is efficiently transported northwards by finite eddies, in the spirit of baroclinic adjustment.


title: Topological descriptor of thermal conductivity in amorphous materials

abstract: Quantifying the correlation between the complex structures of amorphous materials and their physical properties has been a long-standing problem in materials science. In amorphous Si, a representative covalent amorphous solid, the presence of a medium-range order (MRO) has been intensively discussed. However, the specific atomic arrangement corresponding to the MRO and its relationship with physical properties, such as thermal conductivity, remain elusive. Here, we solve this problem by combining topological data analysis, machine learning, and molecular dynamics simulations. By using persistent homology, we constructed a topological descriptor that can predict the thermal conductivity. Moreover, from the inverse analysis of the descriptor, we determined the typical ring features that correlated with both the thermal conductivity and MRO. The results provide an avenue for controlling the material characteristics through the topology of nanostructures.


title: A Dialogue-based Information Extraction System for Medical Insurance Assessment

abstract: In the Chinese medical insurance industry, the assessor's role is essential and requires significant efforts to converse with the claimant. This is a highly professional job that involves many parts, such as identifying personal information, collecting related evidence, and making a final insurance report. Due to the coronavirus (COVID-19) pandemic, the previous offline insurance assessment has to be conducted online. However, for the junior assessor often lacking practical experience, it is not easy to quickly handle such a complex online procedure, yet this is important as the insurance company needs to decide how much compensation the claimant should receive based on the assessor's feedback. In order to promote assessors' work efficiency and speed up the overall procedure, in this paper, we propose a dialogue-based information extraction system that integrates advanced NLP technologies for medical insurance assessment. With the assistance of our system, the average time cost of the procedure is reduced from 55 minutes to 35 minutes, and the total human resources cost is saved 30% compared with the previous offline procedure. Until now, the system has already served thousands of online claim cases.


title: Emerging Oscillating Reactions at the Insulator/Semiconductor Solid/Solid Interface via Proton Implantation

abstract: Most oscillating reactions (ORs) happen in solutions. Few existing solid-based ORs either happen on solid/gas (e.g., oxidation or corrosion) or solid/liquid interfaces, or at the all-solid interfaces neighboring to metals or ionic conductors (e.g., electrolysis or electroplate). We report in this paper a new type of all-solid based OR that happens at the insulator (amorphous SiO$_2$)/semiconductor (Si) interface with the interfacial point defects as the oscillating species. This OR is the first example of the point-defect coupled ORs (PDC-ORs) proposed by H. Schmalzried et al. and J. Janek et al. decades ago. We use proton implantation as the driving force of the oscillation, and employ techniques common in semiconductor device characterization to monitor the oscillation in situ. This approach not only overcomes the difficulties associated with detecting reactions in solids, but also accurately measure the oscillating ultra-low concentration ($10^{10}\sim10^{11}$ cm$^{-2}$) of the interfacial charged point-defects. We propose a mechanism for the reported PDC-OR based on the Brusselator model by identifying the interfacial reactions.


title: Security and Privacy of Wireless Beacon Systems

abstract: Bluetooth Low Energy (BLE) beacons have been increasingly used in smart city applications, such as location-based and proximity-based services, to enable Internet of Things to interact with people in vicinity or enhance context-awareness. Their widespread deployment in human-centric applications makes them an attractive target to adversaries for social or economic reasons. In fact, beacons are reportedly exposed to various security issues and privacy concerns. A characterization of attacks against beacon systems is given to help understand adversary motives, required adversarial capabilities, potential impact and possible defence mechanisms for different threats, with a view to facilitating security evaluation and protection formulation for beacon systems.


title: Applications of knowledge graphs for food science and industry

abstract: The deployment of various networks (e.g., Internet of Things [IoT] and mobile networks), databases (e.g., nutrition tables and food compositional databases), and social media (e.g., Instagram and Twitter) generates huge amounts of food data, which present researchers with an unprecedented opportunity to study various problems and applications in food science and industry via data-driven computational methods. However, these multi-source heterogeneous food data appear as information silos, leading to difficulty in fully exploiting these food data. The knowledge graph provides a unified and standardized conceptual terminology in a structured form, and thus can effectively organize these food data to benefit various applications. In this review, we provide a brief introduction to knowledge graphs and the evolution of food knowledge organization mainly from food ontology to food knowledge graphs. We then summarize seven representative applications of food knowledge graphs, such as new recipe development, diet-disease correlation discovery, and personalized dietary recommendation. We also discuss future directions in this field, such as multimodal food knowledge graph construction and food knowledge graphs for human health.


title: Potential singularity of the 3D Euler equations in the interior domain

abstract: Whether the 3D incompressible Euler equations can develop a finite time singularity from smooth initial data is one of the most challenging problems in nonlinear PDEs. In this paper, we present some new numerical evidence that the 3D axisymmetric incompressible Euler equations with smooth initial data of finite energy develop a potential finite time singularity at the origin. This potential singularity is different from the blow-up scenario revealed by Luo-Hou in \cite{luo2014potentially,luo2014toward}, which occurs on the boundary. Our initial condition has a simple form and shares several attractive features of a more sophisticated initial condition constructed by Hou-Huang in \cite{Hou-Huang-2021,Hou-Huang-2022}. One important difference between these two blow-up scenarios is that the solution for our initial data has a one-scale structure instead of a two-scale structure reported in \cite{Hou-Huang-2021,Hou-Huang-2022}. More importantly, the solution seems to develop nearly self-similar scaling properties that are compatible with those of the 3D Navier-Stokes equations. We will present numerical evidence that the 3D Euler equations seem to develop a potential finite time singularity. Moreover, the nearly self-similar profile seems to be very stable to the small perturbation of the initial data.


title: Impact of fully coherent energy loss on heavy meson production in pA collisions

abstract: Hadron production in proton-nucleus (pA) collisions was previously shown to be suppressed by medium-induced fully coherent energy loss (FCEL). We show that the quenching of $D$ and $B$ mesons in pPb collisions at the LHC due solely to FCEL is, at least, on par with other nuclear effects such as gluon shadowing or saturation. This is consistent with previous findings for both quarkonium and light hadron production in pA collisions, emphasising that FCEL effects need to be included for a reliable understanding of hadron production measurements in pA collisions.


title: The Proposed Silicate-Sulfuric Acid Process: Mineral Processing for In Situ Resource Utilization (ISRU)

abstract: Volatile elements and compounds found in extra-terrestrial environments are often the target of In Situ Resource Utilization (ISRU) studies. Although water and hydroxide are most commonly the focus of these studies as they can be used for propellant and human consumption; we instead focus on the possible exploitation of sulfur and how it could be utilized to produce building materials on the Moon, Mars and Asteroids. We describe the physical and chemical pathways for extracting sulfur from native sulfide minerals, manufacturing sulfuric acid in situ, and using the produced acid to dissolve native silicate minerals. The final products of this process, which we call the Silicate-Sulfuric Acid Process (SSAP), include iron metal, silica, oxygen and metal oxides, all of which are crucial in the scope of a sustainable, space-based economy. Although our proposed methodology requires an initial investment of water, oxygen, and carbon dioxide, we show that all of these volatiles are recovered and reused in order to repeat the process. We calculate the product yield from this process if it were enacted on the lunar highlands, lunar mare, Mars, as well as an array of asteroid types.


title: Sequential generation of projected entangled-pair states

abstract: We introduce plaquette projected entangled-pair states, a class of states in a lattice that can be generated by applying sequential unitaries acting on plaquettes of overlapping regions. They satisfy area-law entanglement, possess long-range correlations, and naturally generalize other relevant classes of tensor network states. We identify a subclass that can be more efficiently prepared in a radial fashion and that contains the family of isometric tensor network states [M. P. Zaletel and F. Pollmann, Phys. Rev. Lett. 124, 037201 (2020)]. We also show how this subclass can be efficiently prepared using an array of photon sources.


title: Minimum Generating Sets for Complete Graphs

abstract: Let $G$ be a graph whose edges are labeled by ideals of a commutative ring $R$ with identity. Such a graph is called an edge-labeled graph over $R$. A generalized spline is a vertex labeling so that the difference between the labels of any two adjacent vertices lies in the ideal corresponding to the edge. These generalized splines form a module over $R$. In this paper, we consider complete graphs whose edges are labeled with proper ideals of $\mathbb{Z} / m\mathbb{Z}$. We compute minimum generating sets of constant flow-up classes for spline modules on edge-labeled complete graphs over $\mathbb{Z} / m\mathbb{Z}$ and their rank under some restrictions.


title: Veldkamp quadrangles and polar spaces

abstract: Veldkamp polygons are certain graphs $\Gamma=(V,E)$ such that for each $v\in V$, $\Gamma_v$ is endowed with a symmetric anti-reflexive relation $\equiv_v$. These relations are all trivial if and only if $\Gamma$ is a thick generalized polygon. A Veldkamp polygon is called flat if no two vertices have the same set of vertices that are opposite in a natural sense. We explore the connection between Veldkamp quadrangles and polar spaces. Using this connection, we give the complete classification of flat Veldkamp quadrangles in which some but not all of the relations $\equiv_v$ are trivial.


title: A Configurable Multilingual Model is All You Need to Recognize All Languages

abstract: Multilingual automatic speech recognition (ASR) models have shown great promise in recent years because of the simplified model training and deployment process. Conventional methods either train a universal multilingual model without taking any language information or with a 1-hot language ID (LID) vector to guide the recognition of the target language. In practice, the user can be prompted to pre-select several languages he/she can speak. The multilingual model without LID cannot well utilize the language information set by the user while the multilingual model with LID can only handle one pre-selected language. In this paper, we propose a novel configurable multilingual model (CMM) which is trained only once but can be configured as different models based on users' choices by extracting language-specific modules together with a universal model from the trained CMM. Particularly, a single CMM can be deployed to any user scenario where the users can pre-select any combination of languages. Trained with 75K hours of transcribed anonymized Microsoft multilingual data and evaluated with 10-language test sets, the proposed CMM improves from the universal multilingual model by 26.0%, 16.9%, and 10.4% relative word error reduction when the user selects 1, 2, or 3 languages, respectively. CMM also performs significantly better on code-switching test sets.


title: GA and ILS for optimizing the size of NFA models

abstract: Grammatical inference consists in learning a formal grammar (as a set of rewrite rules or a finite state machine). We are concerned with learning Nondeterministic Finite Automata (NFA) of a given size from samples of positive and negative words. NFA can naturally be modeled in SAT. The standard model [1] being enormous, we also try a model based on prefixes [2] which generates smaller instances. We also propose a new model based on suffixes and a hybrid model based on prefixes and suffixes. We then focus on optimizing the size of generated SAT instances issued from the hybrid models. We present two techniques to optimize this combination, one based on Iterated Local Search (ILS), the second one based on Genetic Algorithm (GA). Optimizing the combination significantly reduces the SAT instances and their solving time, but at the cost of longer generation time. We, therefore, study the balance between generation time and solving time thanks to some experimental comparisons, and we analyze our various model improvements.


title: Minimizing the Risk of Spreading Processes via Surveillance Schedules and Sparse Control

abstract: In this paper, we propose an optimization framework that combines surveillance schedules and sparse control to bound the risk of spreading processes such as epidemics and wildfires. Here, risk is considered the risk of an undetected outbreak, i.e. the product of the probability of an outbreak and the impact of that outbreak, and we can bound or minimize the risk by resource allocation and persistent monitoring schedules. The presented framework utilizes the properties of positive systems and convex optimization to provide scalable algorithms for both surveillance and intervention purposes. We demonstrate with different spreading process examples how the method can incorporate different parameters and scenarios such as a vaccination strategy for epidemics and the effect of vegetation, wind and outbreak rate on a wildfire in persistent monitoring scenarios.


title: SRG/ART-XC all-sky X-ray survey: Catalog of sources detected during the first year

abstract: We present a first catalog of sources detected by the Mikhail Pavlinsky ART-XC telescope on board the SRG observatory in the 4-12 keV energy band during its ongoing all-sky survey. The catalog comprises 867 sources detected on the combined map of the first two 6-month scans of the sky (December 2019 - December 2020). The achieved sensitivity to point sources varies between ~4x10^-12 erg/s/cm2 near the ecliptic plane and ~8x10^-13 erg/s/cm2 (4-12 keV) near the ecliptic poles, and the typical localization accuracy is ~15 arcsec. Of the 750 sources of known or suspected origin in the catalog, 56% are extragalactic (mostly active galactic nuclei, AGN; and clusters of galaxies) and the rest are Galactic (mostly cataclysmic variables, CVs; and low- and high-mass X-ray binaries). For 114 sources, ART-XC has detected X-rays for the first time. Although the majority of these (~80) are expected to be spurious (given the adopted detection threshold), there can be a significant number of newly discovered astrophysical objects. We have started a program of optical follow-up observations of the new and previously unidentified X-ray sources, which has already led to the identification of several AGN and CVs. With the SRG all-sky survey planned to continue for a total of four years, we can expect the ART-XC survey in the 4-12 keV band to significantly surpass previous surveys that were carried out in similar (medium X-ray) energy bands in terms of the combination of angular resolution, sensitivity, and sky coverage.


title: Dynamics in interacting scalar-torsion theory

abstract: In a spatially flat \ Friedmann--Lema\^{\i}tre--Robertson--Walker background space we consider a scalar-torsion gravitational model which has similar properties with the dilaton theory. This teleparallel model is invariant under a discrete transformation similar to the Gasperini-Veneziano duality transformation. Moreover, in the gravitational Action integral we introduce the Lagrangian function of a pressureless fluid source which is coupled to the teleparallel dilaton field. This specific gravitational theory with interaction in the dark sector of the universe is investigated by using methods of the dynamical system analysis. We calculate that the theory provides various areas of special interest for the evolution of the cosmological history. Inflationary scaling solutions and the de Sitter universe is recovered. Furthermore, we calculate that there exist an attractor which provides a stable solution where the two fluid components, the scalar field and the pressureless matter, contribute in the cosmological fluid. This solution is of special interest because it can describe the present epoch. Finally, the qualitative evolution of the cosmographic parameters is discussed.


title: A CCSD(T)-based permutationally invariant polynomial 4-body potential for water

abstract: We report a permutationally invariant polynomial (PIP) potential energy surface for the water 4-body interaction. This 12-atom PES is a fit to 2119, symmetry-unique, CCSD(T)-F12a/haTZ (aug-cc-pVTZ basis for 'O' atom and cc-pVTZ basis for 'H' atom) 4-b interaction energies. These come from low-level, direct-dynamics calculations, tetramer fragments from an MD water simulation at 300 K, and from the water hexamer, heptamer, decamer, and 13-mer clusters. The PIP basis is purified to ensure that the 4-b potential goes rigorously to zero in monomer+trimer and dimer+dimer dissociations for all possible such fragments. The 4-b energies of isomers of the hexamer calculated with the new surface are shown to be in better agreement with benchmark CCSD(T) results than those from the MB-pol potential. Other tests validate the high-fidelity of the PES.


title: Classification of real simple symplectic triple systems

abstract: The simple symplectic triple systems over the real numbers are classified up to isomorphism, and linear models of all of them are provided. Besides the split cases, one for each complex simple Lie algebra, there are two kinds of non-split real simple symplectic triple systems with classical enveloping algebra, called unitarian and quaternionic types, and five non-split real simple symplectic triple systems with exceptional enveloping algebra.


title: Hall algebras of extriangulated categories

abstract: Recently, Nakaoka and Palu introduced a notion of extriangulated categories. This is a unification of exact categories and triangulated categories. In this paper, we generalize the definitions of Hall algebras of exact categories and triangulated categories to extriangulated categories.


title: Auto IV: Counterfactual Prediction via Automatic Instrumental Variable Decomposition

abstract: Instrumental variables (IVs), sources of treatment randomization that are conditionally independent of the outcome, play an important role in causal inference with unobserved confounders. However, the existing IV-based counterfactual prediction methods need well-predefined IVs, while it is an art rather than science to find valid IVs in many real-world scenes. Moreover, the predefined hand-made IVs could be weak or erroneous by violating the conditions of valid IVs. These thorny facts hinder the application of the IV-based counterfactual prediction methods. In this paper, we propose a novel Automatic Instrumental Variable decomposition (AutoIV) algorithm to automatically generate representations serving the role of IVs from observed variables (IV candidates). Specifically, we let the learned IV representations satisfy the relevance condition with the treatment and exclusion condition with the outcome via mutual information maximization and minimization constraints, respectively. We also learn confounder representations by encouraging them to be relevant to both the treatment and the outcome. The IV and confounder representations compete for the information with their constraints in an adversarial game, which allows us to get valid IV representations for IV-based counterfactual prediction. Extensive experiments demonstrate that our method generates valid IV representations for accurate IV-based counterfactual prediction.


title: Exploiting Network Structures to Improve Semantic Representation for the Financial Domain

abstract: This paper presents the participation of the MiniTrue team in the FinSim-3 shared task on learning semantic similarities for the financial domain in English language. Our approach combines contextual embeddings learned by transformer-based language models with network structures embeddings extracted on external knowledge sources, to create more meaningful representations of financial domain entities and terms. For this, two BERT based language models and a knowledge graph embedding model are used. Besides, we propose a voting function to joint three basic models for the final inference. Experimental results show that the model with the knowledge graph embeddings has achieved a superior result than these models with only contextual embeddings. Nevertheless, we also observe that our voting function brings an extra benefit to the final system.


title: Promise Constraint Satisfaction and Width

abstract: We study the power of the bounded-width consistency algorithm in the context of the fixed-template Promise Constraint Satisfaction Problem (PCSP). Our main technical finding is that the template of every PCSP that is solvable in bounded width satisfies a certain structural condition implying that its algebraic closure-properties include weak near unanimity polymorphisms of all large arities. While this parallels the standard (non-promise) CSP theory, the method of proof is quite different and applies even to the regime of sublinear width. We also show that, in contrast with the CSP world, the presence of weak near unanimity polymorphisms of all large arities does not guarantee solvability in bounded width. The separating example is even solvable in the second level of the Sherali-Adams (SA) hierarchy of linear programming relaxations. This shows that, unlike for CSPs, linear programming can be stronger than bounded width. A direct application of these methods also show that the problem of $q$-coloring $p$-colorable graphs is not solvable in bounded or even sublinear width, for any two constants $p$ and $q$ such that $3 \leq p \leq q$. Turning to algorithms, we note that Wigderson's algorithm for $O(\sqrt{n})$-coloring $3$-colorable graphs with $n$ vertices is implementable in width $4$. Indeed, by generalizing the method we see that, for any $\epsilon > 0$ smaller than $1/2$, the optimal width for solving the problem of $O(n^\epsilon)$-coloring $3$-colorable graphs with $n$ vertices lies between $n^{1-3\epsilon}$ and $n^{1-2\epsilon}$. The upper bound gives a simple $2^{\Theta(n^{1-2\epsilon}\log(n))}$-time algorithm that, asymptotically, beats the straightforward $2^{\Theta(n^{1-\epsilon})}$ bound that follows from partitioning the graph into $O(n^\epsilon)$ many independent parts each of size $O(n^{1-\epsilon})$.


title: ST-DETR: Spatio-Temporal Object Traces Attention Detection Transformer

abstract: We propose ST-DETR, a Spatio-Temporal Transformer-based architecture for object detection from a sequence of temporal frames. We treat the temporal frames as sequences in both space and time and employ the full attention mechanisms to take advantage of the features correlations over both dimensions. This treatment enables us to deal with frames sequence as temporal object features traces over every location in the space. We explore two possible approaches; the early spatial features aggregation over the temporal dimension, and the late temporal aggregation of object query spatial features. Moreover, we propose a novel Temporal Positional Embedding technique to encode the time sequence information. To evaluate our approach, we choose the Moving Object Detection (MOD)task, since it is a perfect candidate to showcase the importance of the temporal dimension. Results show a significant 5% mAP improvement on the KITTI MOD dataset over the 1-step spatial baseline.


title: Asymptotic Results for Rough Continuous-state Branching Processes

abstract: In this paper we provide explicit representations of Laplace transforms of extinction time and total progeny of rough continuous-state branching processes introduced in [7]. Also, we show that their tail distributions are much fatter than those of Feller branching diffusions.


title: Quantitative stability estimates for a two-phase Serrin-type overdetermined problem

abstract: In this paper, we deal with an overdetermined problem of Serrin-type with respect to a two-phase elliptic operator in divergence form with piecewise constant coefficients. In particular, we consider the case where the two-phase overdetermined problem is close to the one-phase setting. First, we show quantitative stability estimates for the two-phase problem via a one-phase stability result. Furthermore, we prove non-existence for the corresponding inner problem by the aforementioned two-phase stability result.


title: Gamma-matrices: a new class of simultaneously diagonalizable matrices

abstract: In order to precondition Toeplitz systems, we present a new class of simultaneously diagonalizable real matrices, the Gamma-matrices, which include both symmetric circulant matrices and a subclass of the set of all reverse circulant matrices. We define some algorithms for fast computation of the product between a Gamma-matrix and a real vector and between two Gamma-matrices. Moreover, we illustrate a technique of approximating a real symmetric Toeplitz matrix by a Gamma-matrix, and we show that the eigenvalues of the preconditioned matrix are clustered around zero with the exception of at most a finite number of terms.


title: Dynamic State Estimation for Integrated Natural Gas and Electric Power Systems

abstract: A dynamic state estimation method of integrated natural gas and electric power systems (IGESs) in proposed. Firstly, the coupling model of gas pipeline networks and power systems by gas turbine units (GTUs) is established. Secondly, the Kalman filter based linear DSE model for the IGES is built. The gas density and mass flow rate, as well as the real and imaginary parts of bus voltages are taken as states, which are predicted by the linearized fluid dynamic equations of gases and exponential smoothing techniques. Boundary conditions of pipeline networks are used as supplementary constraints in the system model. At last, the proposed method is applied to an IGES including a 30-node pipeline network and IEEE 39-bus system coupled by two GTUs. Two indexes are used to evaluate the DSE performance under three measurement error conditions, and the results show that the DSE can obtain the accurate dynamic states in different conditions.


title: Simplicial volume and essentiality of manifolds fibered over spheres

abstract: We study the question when a manifold that fibers over a sphere can be rationally essential, or even have positive simplicial volume. More concretely, we show that mapping tori of manifolds (whose fundamental groups can be quite arbitrary) of odd dimension at least 7 with non-zero simplicial volume are very common. This contrasts the case of fiber bundles over a sphere of dimension d > 1: we prove that their total spaces are rationally inessential if d is at least 3, and always have simplicial volume 0. Using a result by Dranishnikov, we also deduce a surprising property of macroscopic dimension, and we give two applications to positive scalar curvature and characteristic classes, respectively.


title: PU-Flow: a Point Cloud Upsampling Network with Normalizing Flows

abstract: Point cloud upsampling aims to generate dense point clouds from given sparse ones, which is a challenging task due to the irregular and unordered nature of point sets. To address this issue, we present a novel deep learning-based model, called PU-Flow, which incorporates normalizing flows and weight prediction techniques to produce dense points uniformly distributed on the underlying surface. Specifically, we exploit the invertible characteristics of normalizing flows to transform points between Euclidean and latent spaces and formulate the upsampling process as ensemble of neighbouring points in a latent space, where the ensemble weights are adaptively learned from local geometric context. Extensive experiments show that our method is competitive and, in most test cases, it outperforms state-of-the-art methods in terms of reconstruction quality, proximity-to-surface accuracy, and computation efficiency. The source code will be publicly available at https://github.com/unknownue/pu-flow.


title: Automatic Seizure Detection Using the Pulse Transit Time

abstract: Documentation of epileptic seizures plays an essential role in planning medical therapy. Solutions for automated epileptic seizure detection can help improve the current problem of incomplete and erroneous manual documentation of epileptic seizures. In recent years, a number of wearable sensors have been tested for this purpose. However, detecting seizures with subtle symptoms remains difficult and current solutions tend to have a high false alarm rate. Seizures can also affect the patient's arterial blood pressure, which has not yet been studied for detection with sensors. The pulse transit time (PTT) provides a noninvasive estimate of arterial blood pressure. It can be obtained by using to two sensors, which are measuring the time differences between arrivals of the pulse waves. Due to separated time chips a clock drift emerges, which is strongly influencing the PTT. In this work, we present an algorithm which responds to alterations in the PTT, considering the clock drift and enabling the noninvasive monitoring of blood pressure alterations using separated sensors. Furthermore we investigated whether seizures can be detected using the PTT. Our results indicate that using the algorithm, it is possible to detect seizures with a Random Forest. Using the PTT along with other signals in a multimodal approach, the detection of seizures with subtle symptoms could thereby be improved.


title: A Theory of Spherical Diagrams

abstract: We introduce an axiomatic theory of spherical diagrams as a tool to study certain combinatorial properties of polyhedra in $\mathbb R^3$, which are of central interest in the context of Art Gallery problems for polyhedra and other visibility-related problems in discrete and computational geometry.


title: Charge mechanism of low-frequency stimulated Raman scattering in virus suspensions

abstract: A simple physical mechanism of stimulated light scattering on viruses in a water suspension (similar to Langmuir wave mechanism in plasma) is proposed. The proposed mechanism is based on the dipole interaction between the light wave and the inevitable uncompensated electrical charge on a virus in a water environment. Experimental data on tobacco mosaic virus are presented to support the proposed physical mechanism. It is demonstrated that stimulated amplification spectral line frequencies observed experimentally are well explained by the proposed mechanism. In particular, the absence of lower-frequency lines and the shifting of generation lines when the pH changes are due to ion friction in the ionic solution environment. The selection rules observed experimentally also confirm the dipole interaction type. It is shown that microwave radiation on virus acoustic vibrations frequency should appear under such scattering conditions. We demonstrate that such conditions also allow for local selective heating of viruses. This effect is controlled by the optical irradiation parameters and can be used to selectively affect a specific type of virus.


title: Screener3D: a Gaseous Time Projection Chamber for Ultra-low Radioactive Material Screening

abstract: In experiments searching for rare signals, background events from the detector itself are some of the major factors limiting search sensitivity.Screening for ultra-low radioactive detector materials is becoming ever more essential. We propose to develop a gaseous time projection chamber (TPC) with a Micromegas readout for radio screening. The TPC records three-dimensional trajectories of charged particles emitted from a flat sample placed in the active volume of the detector. The detector can distinguish the origin of an event and identify the particle types with information from trajectories, which significantly increases the screening sensitivity. For $\alpha$ particles from the sample surface, we observe that our proposed detector can reach a sensitivity higher than 100 $\mu$Bq$\cdot$m$^{-2}$ within two days.


title: First-principles study of the superconductivity in LaO

abstract: A recent experiment reported the first rare-earth binary oxide superconductor LaO ($T_c $ $\sim$ 5 K) with a rock-salt structure [K. Kaminaga et al., J. Am. Chem. Soc. 140, 6754 (2018)]. Correspondingly, the underlying superconducting mechanism in LaO needs theoretical elucidation. Based on first-principles calculations on the electronic structure, lattice dynamics, and electron-phonon coupling of LaO, we show that the superconducting pairing in LaO belongs to the conventional Bardeen-Cooper-Schrieffer (BCS) type. Remarkably, the electrons and phonons of the heavy La atoms, instead of those of the light O atoms, contribute most to the electron-phonon coupling. We further find that both the biaxial tensile strain and the pure electron doping can enhance the superconducting $T_c$ of LaO. With the synergistic effect of electron doping and tensile strain, the $T_c$ could be even higher, for example, 11.11 K at a doping of 0.2 electrons per formula unit and a tensile strain of $4\%$. Moreover, our calculations show that the superconductivity in LaO thin film remains down to the trilayer thickness with a $T_c$ of 1.4 K.


title: Speech Representation Learning Combining Conformer CPC with Deep Cluster for the ZeroSpeech Challenge 2021

abstract: We present a system for the Zero Resource Speech Challenge 2021, which combines a Contrastive Predictive Coding (CPC) with deep cluster. In deep cluster, we first prepare pseudo-labels obtained by clustering the outputs of a CPC network with k-means. Then, we train an additional autoregressive model to classify the previously obtained pseudo-labels in a supervised manner. Phoneme discriminative representation is achieved by executing the second-round clustering with the outputs of the final layer of the autoregressive model. We show that replacing a Transformer layer with a Conformer layer leads to a further gain in a lexical metric. Experimental results show that a relative improvement of 35% in a phonetic metric, 1.5% in the lexical metric, and 2.3% in a syntactic metric are achieved compared to a baseline method of CPC-small which is trained on LibriSpeech 460h data. We achieve top results in this challenge with the syntactic metric.


title: On massive spin-2 in the Fradkin-Vasiliev formalism. II. General massive case

abstract: In this work we apply the Fradkin-Vasiliev formalism based on the frame-like gauge invariant description of the massive and massless spin 2 to the construction of the cubic interactions vertices for massive spin 2 self-interaction as well as its gravitational interaction. In the first case we show that the vertex can be reduced (by field redefinitions) to the set of the trivially gauge invariant terms. There are four such terms which are not equivalent om-shell and do not contain more than four derivatives. Moreover, one their particular combination reproduces the minimal (with no more than two derivatives) vertex. As for the gravitational vertex, we show that due to the presence of the massless spin 2 there exist two abelian vertices (besides the three trivially gauge invariant ones) which are not equivalent to any trivially gauge invariant terms and can not be removed by field redefinitions. Moreover, their existence appears to be crucial for the possibility to reproduce the minimal two derivatives vertex.


title: Fast approximations of the Jeffreys divergence between univariate Gaussian mixture models via exponential polynomial densities

abstract: The Jeffreys divergence is a renown symmetrization of the oriented Kullback-Leibler divergence broadly used in information sciences. Since the Jeffreys divergence between Gaussian mixture models is not available in closed-form, various techniques with pros and cons have been proposed in the literature to either estimate, approximate, or lower and upper bound this divergence. In this paper, we propose a simple yet fast heuristic to approximate the Jeffreys divergence between two univariate Gaussian mixtures with arbitrary number of components. Our heuristic relies on converting the mixtures into pairs of dually parameterized probability densities belonging to an exponential family. In particular, we consider the versatile polynomial exponential family densities, and design a divergence to measure in closed-form the goodness of fit between a Gaussian mixture and its polynomial exponential density approximation. This goodness-of-fit divergence is a generalization of the Hyv\"arinen divergence used to estimate models with computationally intractable normalizers. It allows us to perform model selection by choosing the orders of the polynomial exponential densities used to approximate the mixtures. We demonstrate experimentally that our heuristic to approximate the Jeffreys divergence improves by several orders of magnitude the computational time of stochastic Monte Carlo estimations while approximating reasonably well the Jeffreys divergence, specially when the mixtures have a very small number of modes. Besides, our mixture-to-exponential family conversion techniques may prove useful in other settings.


title: The arithmetic of a twist of the Fermat quartic

abstract: We study the arithmetic of the twist of the Fermat quartic defined by $X^4 + Y^4 + Z^4 = 0$ which has no $\mathbb{Q}$-rational point. We calculate the Mordell--Weil group of the Jacobian variety explicilty. We show that the degree $0$ part of the Picard group is a free $\mathbb{Z}/2\mathbb{Z}$-module of rank $2$, whereas the Mordell--Weil group is a free $\mathbb{Z}/2\mathbb{Z}$-module of rank $3$. Thus the relative Brauer group is non-trivial. We also show that this quartic violates the local-global property for linear determinantal representations.


title: Minimization Interchange Theorem on Posets

abstract: Interchange theorems between minimization and integration are useful in optimization, especially in optimal control and in stochastic optimization. In this article, we establish a generalized minimization interchange theorem, where integration is replaced by a monotone mapping between posets (partially ordered sets). As an application, we recover, and slightly extend, classical results from the literature, and we tackle the case of the Choquet integral. Our result provides insight on the mechanisms behind existing interchange results.


title: Region attention and graph embedding network for occlusion objective class-based micro-expression recognition

abstract: Micro-expression recognition (\textbf{MER}) has attracted lots of researchers' attention in a decade. However, occlusion will occur for MER in real-world scenarios. This paper deeply investigates an interesting but unexplored challenging issue in MER, \ie, occlusion MER. First, to research MER under real-world occlusion, synthetic occluded micro-expression databases are created by using various mask for the community. Second, to suppress the influence of occlusion, a \underline{R}egion-inspired \underline{R}elation \underline{R}easoning \underline{N}etwork (\textbf{RRRN}) is proposed to model relations between various facial regions. RRRN consists of a backbone network, the Region-Inspired (\textbf{RI}) module and Relation Reasoning (\textbf{RR}) module. More specifically, the backbone network aims at extracting feature representations from different facial regions, RI module computing an adaptive weight from the region itself based on attention mechanism with respect to the unobstructedness and importance for suppressing the influence of occlusion, and RR module exploiting the progressive interactions among these regions by performing graph convolutions. Experiments are conducted on handout-database evaluation and composite database evaluation tasks of MEGC 2018 protocol. Experimental results show that RRRN can significantly explore the importance of facial regions and capture the cooperative complementary relationship of facial regions for MER. The results also demonstrate RRRN outperforms the state-of-the-art approaches, especially on occlusion, and RRRN acts more robust to occlusion.


title: Dilute quantum liquid in a K-Rb Bose mixture

abstract: A quantum liquid in a heterogeneous mixture of $^{41}$K and $^{87}$Rb atoms is studied using the diffusion Monte Carlo method and Density Functional Theory. The perturbative Lee-Huang-Yang term for a heterogeneous mixture is verified and it is proved to be valid only near the gas-liquid transition. Based on the equations of state of the bulk mixture, calculated with diffusion Monte Carlo, extensions to Lee-Huang-Yang corrected mean-field energy functionals (MF+LHY) are presented. Using Density Functional Theory, a systematic comparison between different functionals is performed, focusing on the critical atom number, surface tension, surface width, Tolman length, and compressibility. These results are given as a function of the inter-species interaction strength, within the stability domain of the liquid mixture.

categories: cond-mat.quant-gas physics.atom-ph physics.comp-ph physics.flu-dyn quant-ph


title: Hund's metallicity enhanced by van Hove singularity in cubic perovskite systems

abstract: A van Hove singularity (VHS) often significantly amplifies the electronic instability of a crystalline solid, including correlation-induced phenomena such as Hund's metallicity. We perform a systematic study on the interplay between Hund's coupling and electronic structures with a VHS focusing on Hund's metallicity. We construct a simplified tight-binding model targeting cubic perovskite materials and test the effects of the VHS utilizing dynamical mean-field theory with an exact diagonalization solver. The quasiparticle weight and the low-frequency power exponent of the self-energy provide a quantitative estimation of metallicity over the phase diagram. We find the VHS to substantially enhance Hund's metallicity. The results here suggest a range of parameters through which a VHS can bring great synergy with Hund's coupling.


title: Conformer-based End-to-end Speech Recognition With Rotary Position Embedding

abstract: Transformer-based end-to-end speech recognition models have received considerable attention in recent years due to their high training speed and ability to model a long-range global context. Position embedding in the transformer architecture is indispensable because it provides supervision for dependency modeling between elements at different positions in the input sequence. To make use of the time order of the input sequence, many works inject some information about the relative or absolute position of the element into the input sequence. In this work, we investigate various position embedding methods in the convolution-augmented transformer (conformer) and adopt a novel implementation named rotary position embedding (RoPE). RoPE encodes absolute positional information into the input sequence by a rotation matrix, and then naturally incorporates explicit relative position information into a self-attention module. To evaluate the effectiveness of the RoPE method, we conducted experiments on AISHELL-1 and LibriSpeech corpora. Results show that the conformer enhanced with RoPE achieves superior performance in the speech recognition task. Specifically, our model achieves a relative word error rate reduction of 8.70% and 7.27% over the conformer on test-clean and test-other sets of the LibriSpeech corpus respectively.


title: Experience Report: Deep Learning-based System Log Analysis for Anomaly Detection

abstract: Logs have been an imperative resource to ensure the reliability and continuity of many software systems, especially large-scale distributed systems. They faithfully record runtime information to facilitate system troubleshooting and behavior understanding. Due to the large scale and complexity of modern software systems, the volume of logs has reached an unprecedented level. Consequently, for log-based anomaly detection, conventional manual inspection methods or even traditional machine learning-based methods become impractical, which serve as a catalyst for the rapid development of deep learning-based solutions. However, there is currently a lack of rigorous comparison among the representative log-based anomaly detectors that resort to neural networks. Moreover, the re-implementation process demands non-trivial efforts, and bias can be easily introduced. To better understand the characteristics of different anomaly detectors, in this paper, we provide a comprehensive review and evaluation of five popular neural networks used by six state-of-the-art methods. Particularly, four of the selected methods are unsupervised, and the remaining two are supervised. These methods are evaluated with two publicly available log datasets, which contain nearly 16 million log messages and 0.4 million anomaly instances in total. We believe our work can serve as a basis in this field and contribute to future academic research and industrial applications.


title: Clathrate Structure of Fullerite C60

abstract: Investigations of clathrate structures have gained a new impetus with the recent discovery of room-temperature superconductivity in metal hydrides. Here we report the finding, through density functional theory calculations, of a clathrate phase in the fullerite C60 system. Intermolecular bonds of the type 5/5 2+3 cycloaddition are induced between each C60 molecule and its twelve nearest neighbors in the face centered cubic lattice. Remarkably, this bonding creates on octahedral sites new C60 cages, identical to the original ones, and on tetrahedral sites distorted sodalite-like cages. The resulting carbon clathrate has a Pm-3 simple cubic structure with half of the original face centered lattice constant. Eighty per cent of its atoms are sp3-hybridized, driving a narrow-gap semiconducting behavior, a moderate bulk modulus of 268GPa and an estimated hardness of 21.6GPa. This new phase is likely to be prepared by subjecting C60 to high pressure and high temperature conditions.


title: Higher-Order Topology in Monolayer FeSe

abstract: Generally, the topological corner state in two-dimensional second-order topological insulator (2D SOTI) is equivalent to the well-known domain wall state, originated from the mass-inversion between two adjacent edges with phase shift of pi. In this work, go beyond this conventional physical picture, we report a fractional mass-kink induced 2D SOTI in monolayer FeSe with canted checkerboard antiferromagnetic (AFM) order by analytic model and first-principles calculations. The canted spin associated in-plane Zeeman field can gap out the quantum spin Hall edge state of FeSe, forming a fractional mass-kink with phase shift of pi/2 at the rectangular corner, and generating an in-gap topological corner state with fractional charge of e/4. Moreover, the topological corner state is robust to local perturbation, existing in both naturally and non-naturally cleaved corners, regardless of the edge orientation. Our results not only demonstrate a material system to realize the unique 2D AFM SOTI, but also pave a new way to design the higher-order topological states from fractional mass-kink with arbitrary phase shift, which are expected to draw immediate experimental attention.


title: Model Transferability With Responsive Decision Subjects

abstract: Given an algorithmic predictor that is accurate on some source population consisting of strategic human decision subjects, will it remain accurate if the population respond to it? In our setting, an agent or a user corresponds to a sample $(X,Y)$ drawn from a distribution $\cal{D}$ and will face a model $h$ and its classification result $h(X)$. Agents can modify $X$ to adapt to $h$, which will incur a distribution shift on $(X,Y)$. Our formulation is motivated by applications where the deployed machine learning models are subjected to human agents, and will ultimately face responsive and interactive data distributions. We formalize the discussions of the transferability of a model by studying how the performance of the model trained on the available source distribution (data) would translate to the performance on its induced domain. We provide both upper bounds for the performance gap due to the induced domain shift, as well as lower bounds for the trade-offs that a classifier has to suffer on either the source training distribution or the induced target distribution. We provide further instantiated analysis for two popular domain adaptation settings, including covariate shift and target shift.


title: Epimorphisms in varieties of residuated structures

abstract: It is proved that epimorphisms are surjective in a range of varieties of residuated structures, including all varieties of Heyting or Brouwerian algebras of finite depth, and all varieties consisting of Goedel algebras, relative Stone algebras, Sugihara monoids or positive Sugihara monoids. This establishes the infinite deductive Beth definability property for a corresponding range of substructural logics. On the other hand, it is shown that epimorphisms need not be surjective in a locally finite variety of Heyting or Brouwerian algebras of width 2. It follows that the infinite Beth property is strictly stronger than the so-called finite Beth property, confirming a conjecture of Blok and Hoogland.


title: Can Less be More? When Increasing-to-Balancing Label Noise Rates Considered Beneficial

abstract: In this paper, we answer the question of when inserting label noise (less informative labels) can instead return us more accurate and fair models. We are primarily inspired by three observations: 1) In contrast to reducing label noise rates, increasing the noise rates is easy to implement; 2) Increasing a certain class of instances' label noise to balance the noise rates (increasing-to-balancing) results in an easier learning problem; 3) Increasing-to-balancing improves fairness guarantees against label bias. In this paper, we first quantify the trade-offs introduced by increasing a certain group of instances' label noise rate w.r.t. the loss of label informativeness and the lowered learning difficulties. We analytically demonstrate when such an increase is beneficial, in terms of either improved generalization power or the fairness guarantees. Then we present a method to insert label noise properly for the task of learning with noisy labels, either without or with a fairness constraint. The primary technical challenge we face is due to the fact that we would not know which data instances are suffering from higher noise, and we would not have the ground truth labels to verify any possible hypothesis. We propose a detection method that informs us which group of labels might suffer from higher noise without using ground truth labels. We formally establish the effectiveness of the proposed solution and demonstrate it with extensive experiments.


title: Categorical Center of Higher Genera and 4D Factorization Homology

abstract: Many quantum invariants of knots and 3-manifolds (e.g. Jones polynomials) are special cases of the Witten-Reshetikhin-Turaev 3D TQFT. The latter is in turn a part of a larger theory - the Crane-Yetter 4D TQFT. In this work, we compute the Crane-Yetter theory for all (smooth and oriented) surfaces with at least one puncture. The results in general are constructed and called the categorical center of higher genera.


title: GLAMLE: inference for multiview network data in the presence of latent variables, with application to commodities trading

abstract: The statistical analysis of import/export data is helpful to understand the mechanism that determines exchanges in an economic network. The probability of having a commercial relationship between two countries often depends on some unobservable (or not easy-to-measure) factors, like socio-economical conditions, political views, level of the infrastructures. To conduct inference on this type of data, we introduce a novel class of latent variable models for multiview networks, where a multivariate latent Gaussian variable determines the probabilistic behavior of the edges. We label our model the Graph Generalized Linear Latent Variable Model (GGLLVM) and we base our inference on the maximization of the Laplace-approximated likelihood. We call the resulting M-estimator the Graph Laplace-Approximated Maximum Likelihood Estimator (GLAMLE) and we study its statistical properties. Numerical experiments on simulated networks illustrate that the GLAMLE yields fast and accurate inference. A real data application to commodities trading in Central Europe countries unveils the import/export propensity that each node of the network has toward other nodes, along with additional information specific to each traded commodity.


title: Towards Automatic Instrumentation by Learning to Separate Parts in Symbolic Multitrack Music

abstract: Modern keyboards allow a musician to play multiple instruments at the same time by assigning zones -- fixed pitch ranges of the keyboard -- to different instruments. In this paper, we aim to further extend this idea and examine the feasibility of automatic instrumentation -- dynamically assigning instruments to notes in solo music during performance. In addition to the online, real-time-capable setting for performative use cases, automatic instrumentation can also find applications in assistive composing tools in an offline setting. Due to the lack of paired data of original solo music and their full arrangements, we approach automatic instrumentation by learning to separate parts (e.g., voices, instruments and tracks) from their mixture in symbolic multitrack music, assuming that the mixture is to be played on a keyboard. We frame the task of part separation as a sequential multi-class classification problem and adopt machine learning to map sequences of notes into sequences of part labels. To examine the effectiveness of our proposed models, we conduct a comprehensive empirical evaluation over four diverse datasets of different genres and ensembles -- Bach chorales, string quartets, game music and pop music. Our experiments show that the proposed models outperform various baselines. We also demonstrate the potential for our proposed models to produce alternative convincing instrumentations for an existing arrangement by separating its mixture into parts. All source code and audio samples can be found at https://salu133445.github.io/arranger/ .


title: Towards Representation Identical Privacy-Preserving Graph Neural Network via Split Learning

abstract: In recent years, the fast rise in number of studies on graph neural network (GNN) has put it from the theories research to reality application stage. Despite the encouraging performance achieved by GNN, less attention has been paid to the privacy-preserving training and inference over distributed graph data in the related literature. Due to the particularity of graph structure, it is challenging to extend the existing private learning framework to GNN. Motivated by the idea of split learning, we propose a \textbf{S}erver \textbf{A}ided \textbf{P}rivacy-preserving \textbf{GNN} (SAPGNN) for the node level task on horizontally partitioned cross-silo scenario. It offers a natural extension of centralized GNN to isolated graph with max/min pooling aggregation, while guaranteeing that all the private data involved in computation still stays at local data holders. To further enhancing the data privacy, a secure pooling aggregation mechanism is proposed. Theoretical and experimental results show that the proposed model achieves the same accuracy as the one learned over the combined data.


title: Experimental validation of fluid inertia models for a cylinder settling in a quiescent flow

abstract: The precise description of the motion of anisotropic particles in a flow rests on the understanding of the force and torque acting on them. Here, we study experimentally small, very elongated particles settling in a fluid at small Reynolds number. In our experiments, we can, to a very good approximation, relate the rate of rotation of cylindrical tungsten rods, of aspect ratios \beta = 8 and \beta = 16, settling in pure glycerol to the torque they are experiencing. This allows us to compare the measured torque with expressions obtained either in the slender-rod limit, or in the case of spheroids. Both theories predict a simple angle dependence for the torque, which is found to capture very well the experimental results. Surprisingly, the slender-rod approximation predicts much better the results for \beta = 8, than for \beta = 16. In the latter case, the expression obtained for a spheroid provides a better approximation. The translational dynamics is shown to be in qualitative agreement with the slender-rod and spheroid models, the former one being found to represent better the experimental data.


title: Periodic cavity state revivals from atomic frequency combs

abstract: Spin ensembles with a comb-shaped spectrum have shown exciting properties as efficient quantum memories. Here, we present a rigorous theoretical study of such atomic frequency combs in the strong coupling limit of cavity QED, based on a full quantum treatment using tensor-network methods. Our results demonstrate that arbitrary multi-photon states in the cavity are almost perfectly absorbed by the spin ensemble and re-emitted as parity-flipped states at periodic time intervals. Fidelity values near unity are achieved in these revived states by compensating for energy shifts induced by the strong spin-cavity coupling through adjustments of individual coupling values of the teeth in the atomic frequency comb.


title: Doping-induced dielectric catastrophe prompts free-carrier release in organic semiconductors

abstract: The control over material properties attainable through molecular doping is essential to many technological applications of organic semiconductors, such as OLED or thermoelectrics. These excitonic semiconductors typically reach the degenerate limit only at impurity concentrations of 5-10\%, a phenomenon that has been put in relation to the strong Coulomb binding between charge carriers and ionized dopants, and whose comprehension remained elusive so far. This study proposes a general mechanism for the release of carriers at finite doping in terms of collective screening phenomena. A multiscale model for the dielectric properties of doped organic semiconductor is set up by combining first principles and microelectrostatic calculations. Our results predict a large nonlinear enhancement of the dielectric constant (ten-fold at 8\% load) as the system approaches a dielectric instability (catastrophe) upon increasing doping. This can be attributed to the presence of highly polarizable host-dopant complexes, plus a nontrivial leading contribution from dipolar interactions in the disordered and heterogeneous system. The enhanced screening in the material drastically reduces the (free) energy barriers for electron-hole separation, rationalizing the possibility for thermal charge release. The proposed mechanism is consistent with conductivity data and sets the basis for achieving higher conductivities at lower doping loads.


title: Families of Canonical Local Periods on Spherical Varieties

abstract: We consider the variation of canonical local periods on spherical varieties proposed by Sakellaridis-Venkatesh in families. We formulate conjectures for the rationality and meromorphic property of canonical local periods and establish these conjectures for strongly tempered spherical G-varieties without type N-roots when G is split.


title: First-principles study of the crystal structure, electronic structure, and transport properties of NiTe$_2$ under pressure

abstract: Recent experiments showed the distinct observations on the transition metal ditelluride NiTe$_2$ under pressure: one reported a superconducting phase transition at 12 GPa, whereas another observed a sign reversal of Hall resistivity at 16 GPa without the appearance of superconductivity. To clarify the controversial experimental phenomena, we have carried out first-principles electronic structure calculations on the compressed NiTe$_2$ with structure searching and optimization. Our calculations show that the pressure can transform NiTe$_2$ from a layered P-3m1 phase to a cubic Pa-3 phase at $\sim$10 GPa. Meanwhile, both the P-3m1 and Pa-3 phases possess nontrivial topological properties. The calculated superconducting $T_c$'s for these two phases based on the electron-phonon coupling theory both approach 0 K. Further magnetic transport calculations reveal that the sign of Hall resistance for the Pa-3 phase is sensitive to the pressure and the charge doping, in contrast to the case of the P-3m1 phase. Our theoretical predictions on the compressed NiTe$_2$ wait for careful experimental examinations.


title: Multiplicative Error Models: 20 years on

abstract: Several phenomena are available representing market activity: volumes, number of trades, durations between trades or quotes, volatility - however measured - all share the feature to be represented as positive valued time series. When modeled, persistence in their behavior and reaction to new information suggested to adopt an autoregressive-type framework. The Multiplicative Error Model (MEM) is borne of an extension of the popular GARCH approach for modeling and forecasting conditional volatility of asset returns. It is obtained by multiplicatively combining the conditional expectation of a process (deterministically dependent upon an information set at a previous time period) with a random disturbance representing unpredictable news: MEMs have proved to parsimoniously achieve their task of producing good performing forecasts. In this paper we discuss various aspects of model specification and inference both for the univariate and the multivariate case. The applications are illustrative examples of how the presence of a slow moving low-frequency component can improve the properties of the estimated models.


title: An Improvement of a Key Exchange Protocol Relying on Polynomial Maps

abstract: Akiyama et al. (Int. J. Math. Indust., 2019) proposed a post-quantum key exchange protocol that is based on the hardness of solving a system of multivariate non-linear polynomial equations but has a design strategy different from ordinary multivariate cryptography. Their protocol has two versions, an original one and a modified one, where the modified one has a trade-off that its security is strengthened while it has non-zero error probability in establishing a common key. In fact, the evaluation in their paper suggests that the probability of failing to establish a common key by the modified protocol with the proposed parameter set is impractically high. In this paper, we improve the success probability of Akiyama et al.'s modified key exchange protocol significantly while keeping the security, by restricting each component of the correct common key from the whole of the coefficient field to its small subset. We give theoretical and experimental evaluations showing that our proposed parameter set for our protocol is expected to achieve both failure probability $2^{-120}$ and $128$-bit security level.


title: Angular momentum projection in the deformed relativistic Hartree-Bogoliubov theory in continuum

abstract: The angular momentum projection (AMP) method is implemented in the deformed relativistic Hartree-Bogoliubov theory in continuum (DRHBc) with the point-coupling density functional. The wave functions of angular momentum projected states are expanded in terms of the Dirac Woods-Saxon (WS) basis, providing a proper description of the asymptotic behavior of the wave functions for weakly bound nuclei. The contribution of continuum induced by the pairing is considered by treating the pairing correlation with the Bogoliubov transformation. We present the formulae and numerical checks for the DRHBc+AMP approach and use it to study low-lying excited states of weakly bound deformed nuclei. Our calculations show that neutron-rich magnesium isotopes $^{36,38,40}$Mg are all well deformed nuclei. The low-lying excited states of these three nuclei are obtained by performing the AMP on the mean-field ground-states. The ground-state rotational bands of $^{36,38,40}$Mg are reproduced reasonably well by using this new DRHBc+AMP approach with the density functional PC-F1.


title: k-Gauss-Bonnet inflation

abstract: We propose a novel {\it k}-Gauss-Bonnet inflationary model, in which a kinetic term of scalar field is allowed to non-minimally couple to the Gauss-Bonnet topological invariant in the absence of a potential of scalar field. As a result, this model is shown to admit an isotropic power-law inflation provided that the scalar field is phantom. Furthermore, stability analysis based on the dynamical system method is performed to indicate that this inflation solution is indeed stable and attractive. More interestingly, a gradient instability in tensor perturbations is shown to disappear in this model.


title: One-sided GRP Solver and Numerical Boundary Conditions for compressible fluid flows

abstract: In the computation of compressible fluid flows, numerical boundary conditions are always necessary for all physical variables at computational boundaries while just partial physical variables are often prescribed as physical boundary conditions. Certain extrapolation technique or ghost cells are often employed traditionally for this issue but spurious wave reflections often arise to cause numerical instability. In this paper, we associate this issue with the one-sided generalized Riemann problem (GRP) solver motivated by the accelerated piston problem in gas dynamics so that the extrapolation technique can be actually avoided. In fact, the compatibility arguments naturally requires to formulate the one-sided generalized Riemann problem and incorporate it into the numerical procedure of boundary conditions. As far as the interaction of nonlinear waves with physical boundaries, such a one-sided GRP solver shows significant effects, as numerical experiments demonstrate, on avoiding spurious wave reflections at the computational boundaries.


title: First-Order Logic with Connectivity Operators

abstract: First-order logic (FO) can express many algorithmic problems on graphs, such as the independent set and dominating set problem, parameterized by solution size. On the other hand, FO cannot express the very simple algorithmic question of whether two vertices are connected. We enrich FO with connectivity predicates that are tailored to express algorithmic graph properties that are commonly studied in parameterized algorithmics. By adding the atomic predicates $conn_k (x, y, z_1 ,\ldots, z_k)$ that hold true in a graph if there exists a path between (the valuations of) $x$ and $y$ after (the valuations of) $z_1,\ldots,z_k$ have been deleted, we obtain separator logic $FO + conn$. We show that separator logic can express many interesting problems such as the feedback vertex set problem and elimination distance problems to first-order definable classes. We then study the limitations of separator logic and prove that it cannot express planarity, and, in particular, not the disjoint paths problem. We obtain the stronger disjoint-paths logic $FO + DP$ by adding the atomic predicates $disjoint-paths_k [(x_1, y_1 ),\ldots , (x_k , y_k )]$ that evaluate to true if there are internally vertex disjoint paths between (the valuations of) $x_i$ and $y_i$ for all $1 \le i \le k$. Disjoint-paths logic can express the disjoint paths problem, the problem of (topological) minor containment, the problem of hitting (topological) minors, and many more. Finally, we compare the expressive power of the new logics with that of transitive closure logics and monadic second-order logic.


title: Superconducting microwave magnetometer for absolute flux detection

abstract: Superconducting quantum interference devices (SQUIDs) are among the most sensitive detectors for out-of-plane magnetic field components. However, due to their periodic response with short modulation period $M = 1 \Phi_0$, determined by the magnetic flux quantum $\Phi_0 \approx 2.068\times 10^{-15}\,\mathrm{Wb}$, it is difficult to infer the value of the magnetic flux unambiguously, especially in case the magnetic flux enclosed in the SQUID loop changes by many flux quanta. Here, we demonstrate that by introducing a second degree of freedom in the form of a second SQUID, we substantially enhance the modulation period $M$ of our device without sacrificing sensitivity. As a proof of concept, we implement our idea by embedding two asymmetric direct current SQUIDs into a common tank circuit. By measuring the reflection coefficient of the device, we extract the two lowest energy eigenfrequencies as a function of the external magnetic flux created by a superconducting field coil, from which we experimentally deduce a modulation period $M \geq 15 \Phi_0$, as well as the magnetic offset-field $B_0 = 22\,\mathrm{nT}$ present in our experiment.


title: Single-shot structured illumination microscopy

abstract: Structured illumination microscopy (SIM) can double the resolution beyond the light diffraction limit, but it comes at the cost of multiple camera exposures and the heavy computation burden of multiple Fourier transforms. In this paper, we report a novel technique termed single-shot SIM, to overcome these limitations. A multi-task joint deep-learning strategy is proposed. Generative adversative networks (GAN) are employed to generate five structured illumination images based on the single-shot structured illumination image. U-Net is employed to reconstruct the super-resolution image from these six generated images without time-consuming Fourier transform. By imaging a self-assembling DNB array, we experimentally verified that this technique could perform single-shot super-resolution reconstruction comparing favorably with conventional SIM. This single-shot SIM technique may ultimately overcome the limitations of multiple exposures and Fourier transforms and is potentially applied for high-throughput gene sequencing.


title: Radio evidence for a shock wave reflected by a coronal hole

abstract: We report the first unambiguous observational evidence in the radio range of the reflection of a coronal shock wave at the boundary of a coronal hole. The event occurred above an active region located at the northwest limb of the Sun and was characterized by an eruptive prominence and an extreme-ultraviolet (EUV) wave steepening into a shock. The EUV observations acquired by the Atmospheric Imaging Assembly (AIA) instrument on board the Solar Dynamics Observatory(SDO) and the Extreme Ultraviolet Imager (EUVI) instrument on board the Solar TErrestrial RElations Observatory(STEREO-A) were used to track the development of the EUV front in the inner corona. Metric type II radio emission, a distinguishing feature of shock waves propagating in the inner corona, was simultaneously recorded by ground-based radio spectrometers. The radio dynamic spectra displayed an unusual reversal of the type II emission lanes, together with type III-like herringbone emission, indicating shock-accelerated electron beams. Combined analysis of imaging data from the two space-based EUV instruments and the Nancay Radioheliograph (NRH) evidences that the reverse-drifting typeiiemission was produced at the intersection of the shock front, reflected at a coronal hole boundary, with an intervening low-Alfv\'en-speed region characterized by an open field configuration. We also provide an outstanding data-driven reconstruction of the spatiotemporal evolution in the inner corona of the shock-accelerated electron beams produced by the reflected shock.


title: FeI and NiI in cometary atmospheres. Connections between the NiI/FeI abundance ratio and chemical characteristics of Jupiter-family and Oort-cloud comets

abstract: FeI and NiI emission lines have recently been found in the spectra of 17 Solar System comets observed at heliocentric distances between 0.68 and 3.25 au and in the interstellar comet 2I/Borisov. The blackbody equilibrium temperature at the nucleus surface is too low to vaporize the refractory dust grains that contain metals, making the presence of iron and nickel atoms in cometary atmospheres a puzzling observation. Moreover, the measured NiI/FeI abundance ratio is on average one order of magnitude larger than the solar photosphere value. We report new measurements of FeI and NiI production rates and abundance ratios for the Jupiter-family comet (JFC) 46P/Wirtanen in its 2018 apparition and from archival data of the Oort-cloud comet (OCC) C/1996 B2 (Hyakutake). The comets were at geocentric distances of 0.09 au and 0.11 au, respectively. The emission line surface brightness was found to be inversely proportional to the projected distance to the nucleus, confirming that FeI and NiI atoms are ejected from the surface of the nucleus or originate from a short-lived parent. Considering the full sample of 20 comets, we find that the range of NiI/FeI abundance ratios is significantly larger in JFCs than in OCCs. We also unveil significant correlations between NiI/FeI and C$_2$/CN, C$_2$H$_6$/H$_2$O, and NH/CN. Carbon-chain- and NH-depleted comets show the highest NiI/FeI ratios. The existence of such relations suggests that the diversity of NiI/FeI abundance ratios in comets could be related to the cometary formation rather than to subsequent processes~in~the~coma.


title: Outcome-guided Bayesian Clustering for Disease Subtype Discovery Using High-dimensional Transcriptomic Data

abstract: The discovery of disease subtypes is an essential step for developing precision medicine, and disease subtyping via omics data has become a popular approach. While promising, subtypes obtained from conventional approaches may not be necessarily associated with clinical outcomes. The collection of rich clinical data along with omics data has provided an unprecedented opportunity to facilitate the disease subtyping process and to discovery clinically meaningful disease subtypes. Thus, we developed an outcome-guided Bayesian clustering (GuidedBayesianClustering) method to fully integrate the clinical data and the high-dimensional omics data. A Gaussian mixed model framework was applied to perform sample clustering; a spike-and-slab prior was utilized to perform gene selection; a mixture model prior was employed to incorporate the guidance from a clinical outcome variable; and a decision framework was adopted to infer the false discovery rate of the selected genes. We deployed conjugate priors to facilitate efficient Gibbs sampling. Our proposed full Bayesian method is capable of simultaneously (i) obtaining sample clustering (disease subtype discovery); (ii) performing feature selection (select genes related to the disease subtype); and (iii) utilizing clinical outcome variable to guide the disease subtype discovery. The superior performance of the GuidedBayesianClustering was demonstrated through simulations and applications of breast cancer expression data.


title: OFF-state trapping phenomena in GaN HEMTs: interplay between gate trapping, acceptor ionization and positive charge redistribution

abstract: We present an extensive analysis of the trapping processes induced by drain bias stress in AlGaN/GaN high-electron-mobility transistors (HEMTs) with p-GaN gate. We demonstrate that: (i) with increasing drain stress, pulsed I-V and VTH measurements shown an initial positive VTH variation and an increase in RON then, for drain voltages >100 V, VTH is stable and the RON shows a partial recovery. (ii) At moderate voltages, VTH instability is related to trapping at the gate stack, due to residual negative charge left behind by the holes that leave the p-GaN layer through the Schottky gate contact and/or to trapping at the barrier. At higher voltages, we demonstrate the interplay of two trapping processes by C-V and pulsed drain current analysis: (iii) a fast storage of positive charge, accumulated near the buffer/SRL interface, not strongly thermally activated, dominating at higher voltages; (iv) a slower negative charge storage, thermally activated with activation energies for trapping and de-trapping equal to ~0.6 eV and ~0.4-0.8 eV, respectively.


title: BambooMC -- A Geant4-based simulation program for the PandaX experiments

abstract: The purpose of the PandaX experiments is to search for the possible events resulted from dark matter particles, neutrinoless double beta decay or other rare processes with xenon detectors. Understanding the energy depositions from backgrounds or calibration sources in these detectors is very important. The program of BambooMC is created to perform the Geant4-based Monte Carlo simulation, providing reference information for the experiments. We introduce the design and features of BambooMC in this report. The running of the program depends on a configuration file, which combines different detectors, event generators, physics lists and analysis packs together in one simulation. The program can be easily extended and applied to other experiments.


title: Testability of Reverse Causality Without Exogenous Variation

abstract: This paper shows that testability of reverse causality is possible even in the absence of exogenous variation, such as in the form of instrumental variables. Instead of relying on exogenous variation, we achieve testability by imposing relatively weak model restrictions and exploiting that a dependence of residual and purported cause is informative about the causal direction. Our main assumption is that the true functional relationship is nonlinear and that error terms are additively separable. We extend previous results by incorporating control variables and allowing heteroskedastic errors. We build on reproducing kernel Hilbert space (RKHS) embeddings of probability distributions to test conditional independence and demonstrate the efficacy in detecting the causal direction in both Monte Carlo simulations and an application to German survey data.


title: Advanced Boundary Conditions for the Simulations of Laser Ablation

abstract: Irradiating materials with ultra-short laser pulses generates unwanted shock waves which distort the interesting physics. Advanced boundary conditions are presented to erase even very strong shock waves. Depending on the wave length, laser light which leads to ablation may penetrate very deep into the sample. Connection conditions are presented to consistently couple atomistics and continuum description of the sample even at high temperatures together with a discussion of the temperature definition.


title: Learning from Partially Overlapping Labels: Image Segmentation under Annotation Shift

abstract: Scarcity of high quality annotated images remains a limiting factor for training accurate image segmentation models. While more and more annotated datasets become publicly available, the number of samples in each individual database is often small. Combining different databases to create larger amounts of training data is appealing yet challenging due to the heterogeneity as a result of differences in data acquisition and annotation processes, often yielding incompatible or even conflicting information. In this paper, we investigate and propose several strategies for learning from partially overlapping labels in the context of abdominal organ segmentation. We find that combining a semi-supervised approach with an adaptive cross entropy loss can successfully exploit heterogeneously annotated data and substantially improve segmentation accuracy compared to baseline and alternative approaches.


title: A QUIC(K) Way Through Your Firewall?

abstract: The QUIC protocol is a new approach to combine encryption and transport layer stream abstraction into one protocol to lower latency and improve security. However, the decision to encrypt transport layer functionality may limit the capabilities of firewalls to protect networks. To identify these limitations we created a test environment and analyzed generated QUIC traffic from the viewpoint of a middlebox. This paper shows that QUIC indeed exposes traditional stateful firewalls to UDP hole punching bypass attacks. On the contrary we show the robustness against censorship of QUIC through the encrypted transport layer design and analyze the capabilities to re-gain stateful tracking capabilities by deep packet inspection of the few exposed QUIC header fields.


title: Cats, not CAT scans: a study of dataset similarity in transfer learning for 2D medical image classification

abstract: Transfer learning is a commonly used strategy for medical image classification, especially via pretraining on source data and fine-tuning on target data. There is currently no consensus on how to choose appropriate source data, and in the literature we can find both evidence of favoring large natural image datasets such as ImageNet, and evidence of favoring more specialized medical datasets. In this paper we perform a systematic study with nine source datasets with natural or medical images, and three target medical datasets, all with 2D images. We find that ImageNet is the source leading to the highest performances, but also that larger datasets are not necessarily better. We also study different definitions of data similarity. We show that common intuitions about similarity may be inaccurate, and therefore not sufficient to predict an appropriate source a priori. Finally, we discuss several steps needed for further research in this field, especially with regard to other types (for example 3D) medical images. Our experiments and pretrained models are available via \url{https://www.github.com/vcheplygina/cats-scans}


title: Multi-Scale Label Relation Learning for Multi-Label Classification Using 1-Dimensional Convolutional Neural Networks

abstract: We present Multi-Scale Label Dependence Relation Networks (MSDN), a novel approach to multi-label classification (MLC) using 1-dimensional convolution kernels to learn label dependencies at multi-scale. Modern multi-label classifiers have been adopting recurrent neural networks (RNNs) as a memory structure to capture and exploit label dependency relations. The RNN-based MLC models however tend to introduce a very large number of parameters that may cause under-/over-fitting problems. The proposed method uses the 1-dimensional convolutional neural network (1D-CNN) to serve the same purpose in a more efficient manner. By training a model with multiple kernel sizes, the method is able to learn the dependency relations among labels at multiple scales, while it uses a drastically smaller number of parameters. With public benchmark datasets, we demonstrate that our model can achieve better accuracies with much smaller number of model parameters compared to RNN-based MLC models.


title: A Novel Deep Learning Method for Thermal to Annotated Thermal-Optical Fused Images

abstract: Thermal Images profile the passive radiation of objects and capture them in grayscale images. Such images have a very different distribution of data compared to optical colored images. We present here a work that produces a grayscale thermo-optical fused mask given a thermal input. This is a deep learning based pioneering work since to the best of our knowledge, there exists no other work on thermal-optical grayscale fusion. Our method is also unique in the sense that the deep learning method we are proposing here works on the Discrete Wavelet Transform (DWT) domain instead of the gray level domain. As a part of this work, we also present a new and unique database for obtaining the region of interest in thermal images based on an existing thermal visual paired database, containing the Region of Interest on 5 different classes of data. Finally, we are proposing a simple low cost overhead statistical measure for identifying the region of interest in the fused images, which we call as the Region of Fusion (RoF). Experiments on the database show encouraging results in identifying the region of interest in the fused images. We also show that they can be processed better in the mixed form rather than with only thermal images.