title: SAT: Self-adaptive training for fashion compatibility prediction

abstract: This paper presents a self-adaptive training (SAT) model for fashion compatibility prediction. It focuses on the learning of some hard items, such as those that share similar color, texture, and pattern features but are considered incompatible due to the aesthetics or temporal shifts. Specifically, we first design a method to define hard outfits and a difficulty score (DS) is defined and assigned to each outfit based on the difficulty in recommending an item for it. Then, we propose a self-adaptive triplet loss (SATL), where the DS of the outfit is considered. Finally, we propose a very simple conditional similarity network combining the proposed SATL to achieve the learning of hard items in the fashion compatibility prediction. Experiments on the publicly available Polyvore Outfits and Polyvore Outfits-D datasets demonstrate our SAT's effectiveness in fashion compatibility prediction. Besides, our SATL can be easily extended to other conditional similarity networks to improve their performance.


title: Inverted Semantic-Index for Image Retrieval

abstract: This paper addresses the construction of inverted index for large-scale image retrieval. The inverted index proposed by J. Sivic brings a significant acceleration by reducing distance computations with only a small fraction of the database. The state-of-the-art inverted indices aim to build finer partitions that produce a concise and accurate candidate list. However, partitioning in these frameworks is generally achieved by unsupervised clustering methods which ignore the semantic information of images. In this paper, we replace the clustering method with image classification, during the construction of codebook. We then propose a merging and splitting method to solve the problem that the number of partitions is unchangeable in the inverted semantic-index. Next, we combine our semantic-index with the product quantization (PQ) so as to alleviate the accuracy loss caused by PQ compression. Finally, we evaluate our model on large-scale image retrieval benchmarks. Experiment results demonstrate that our model can significantly improve the retrieval accuracy by generating high-quality candidate lists.


title: Non-minimal Coupling Inflation and Dark Matter under the $\mathbb{Z}_{3}$ Symmetry

abstract: We study the cosmological inflation and dark matter (DM) in a unified way within a $Z_3$ complex scalar model. The real and imaginary parts of the complex scalar act as the inflaton and DM respectively. The slow-rolling inflation with non-minimal coupling in both the metric and Palatini formalisms can be realized. We examine the whole parameters space by fully considering the theoretical and experimental constraints. We find that in the low-energy scale, the DM relic density and the DM-nucleon direct scattering experiments favor the mixing angle $|\theta| \lesssim 0.25$, the DM mass $m_\chi \gtrsim 80\rm{GeV}$, and the mass of Higgs-like scalar $m_{h_2} \gtrsim 300\rm{GeV}$. In the high-energy scale, after further considering the cosmological constraints of the scalar spectral index and the tensor-to-scalar ratio for the two forms of inflation, the scalar spectral indices are both $\sim 0.965$, the non-minimum coupling coefficients are $\sim 10^4$ and $\sim 10^9$, and the tensor-to-scalar ratios are $\sim 10^{-3}$ and $\lesssim 10^{-11}$ respectively, which suggests that the inflation under the two formalisms can be distinguished by measuring the tensor-to-scalar ratio with higher precision.


title: Asymptotic-Preserving Neural Networks for multiscale hyperbolic models of epidemic spread

abstract: When investigating epidemic dynamics through differential models, the parameters needed to understand the phenomenon and to simulate forecast scenarios require a delicate calibration phase, often made even more challenging by the scarcity and uncertainty of the observed data reported by official sources. In this context, Physics-Informed Neural Networks (PINNs), by embedding the knowledge of the differential model that governs the physical phenomenon in the learning process, can effectively address the inverse and forward problem of data-driven learning and solving the corresponding epidemic problem. In many circumstances, however, the spatial propagation of an infectious disease is characterized by movements of individuals at different scales governed by multiscale PDEs. This reflects the heterogeneity of a region or territory in relation to the dynamics within cities and in neighboring zones. In presence of multiple scales, a direct application of PINNs generally leads to poor results due to the multiscale nature of the differential model in the loss function of the neural network. To allow the neural network to operate uniformly with respect to the small scales, it is desirable that the neural network satisfies an Asymptotic-Preservation (AP) property in the learning process. To this end, we consider a new class of AP Neural Networks (APNNs) for multiscale hyperbolic transport models of epidemic spread that, thanks to an appropriate AP formulation of the loss function, is capable to work uniformly at the different scales of the system. A series of numerical tests for different epidemic scenarios confirms the validity of the proposed approach, highlighting the importance of the AP property in the neural network when dealing with multiscale problems especially in presence of sparse and partially observed systems.


title: Multi-Variate Time Series Forecasting on Variable Subsets

abstract: We formulate a new inference task in the domain of multivariate time series forecasting (MTSF), called Variable Subset Forecast (VSF), where only a small subset of the variables is available during inference. Variables are absent during inference because of long-term data loss (eg. sensor failures) or high -> low-resource domain shift between train / test. To the best of our knowledge, robustness of MTSF models in presence of such failures, has not been studied in the literature. Through extensive evaluation, we first show that the performance of state of the art methods degrade significantly in the VSF setting. We propose a non-parametric, wrapper technique that can be applied on top any existing forecast models. Through systematic experiments across 4 datasets and 5 forecast models, we show that our technique is able to recover close to 95\% performance of the models even when only 15\% of the original variables are present.


title: The Stokes phenomenon for certain partial differential equations with variable coefficients depending on the time variable

abstract: We consider the Stokes phenomenon for the solutions of some partial differential equations with variable coefficients in two complex variables, where initial data are holomorphic. We use the theory of (moment) summability and the theory of hyperfunctions to describe Stokes lines and jumps across these Stokes lines.


title: FreSCo: Frequency-Domain Scan Context for LiDAR-based Place Recognition with Translation and Rotation Invariance

abstract: Place recognition plays a crucial role in re-localization and loop closure detection tasks for robots and vehicles. This paper seeks a well-defined global descriptor for LiDAR-based place recognition. Compared to local descriptors, global descriptors show remarkable performance in urban road scenes but are usually viewpoint-dependent. To this end, we propose a simple yet robust global descriptor dubbed FreSCo that decomposes the viewpoint difference during revisit and achieves both translation and rotation invariance by leveraging Fourier Transform and circular shift technique. Besides, a fast two-stage pose estimation method is proposed to estimate the relative pose after place retrieval by utilizing the compact 2D point clouds extracted from the original data. Experiments show that FreSCo exhibited superior performance than contemporaneous methods on sequences of different scenes from multiple datasets. Code will be publicly available at https://github.com/soytony/FreSCo.


title: Lepton mass matrix from double covering of $A_4$ modular flavor symmetry

abstract: We study a double covering of modular $A_4$ flavor symmetry in which we construct lepton models in cases of canonical seesaw and radiative seesaw models. Through $\chi$ square numerical analysis, we show some predictions for the cases, depending on normal and inverted hierarchies.


title: On upper bounds for the multi-fold chromatic numbers of the plane

abstract: The multi-fold chromatic number of the plane $\chi_m$ is the smallest number of colors $k$, sufficient to color each point of the Euclidean plane in exactly $m$ colors, so that for any pair of points at a unit distance from each other, two corresponding $m$-subsets of $k$-set do not contain any common color. We consider upper bounds for $m$-fold chromatic numbers of the plane. Our main result is that for any $m$ the inequality $\chi_m<(1+2/\sqrt3)^2\cdot m+3.501$ holds.


title: Type systems and maximal subgroups of Thompson's group $V$

abstract: We introduce the concept of a type system~$\Part$, that is, a partition on the set of finite words over the alphabet~$\{0,1\}$ compatible with the partial action of Thompson's group~$V$, and associate a subgroup~$\Stab{V}{\Part}$ of~$V$. We classify the finite simple type systems and show that the stabilizers of various simple type systems, including all finite simple type systems, are maximal subgroups of~$V$. We also find an uncountable family of pairwise non-isomorphic maximal subgroups of~$V$. These maximal subgroups occur as stabilizers of infinite simple type systems and have not been described in previous literature: specifically, they do not arise as stabilizers in $V$ of finite sets of points in Cantor space. Finally, we show that two natural conditions on subgroups of $V$ (both related to primitivity) are each satisfied only by $V$ itself, giving new ways to recognise when a subgroup of $V$ is not actually proper.


title: A 6-chromatic odd-distance graph in the plane

abstract: Two vertices of an odd-distance graph are connected by an edge if and only if their Euclidean distance is an odd integer. We construct a 6-chromatic odd-distance graph in the plane.


title: On the plane and its coloring

abstract: We provide a human-verifiable proof that, in a certain sense, the chromatic number of the plane is exactly 7.


title: SC-Transformer++: Structured Context Transformer for Generic Event Boundary Detection

abstract: This report presents the algorithm used in the submission of Generic Event Boundary Detection (GEBD) Challenge at CVPR 2022. In this work, we improve the existing Structured Context Transformer (SC-Transformer) method for GEBD. Specifically, a transformer decoder module is added after transformer encoders to extract high quality frame features. The final classification is performed jointly on the results of the original binary classifier and a newly introduced multi-class classifier branch. To enrich motion information, optical flow is introduced as a new modality. Finally, model ensemble is used to further boost performance. The proposed method achieves 86.49% F1 score on Kinetics-GEBD test set. which improves 2.86% F1 score compared to the previous SOTA method.


title: Tiling the plane with hexagons: improved separations for $k$-colourings

abstract: It has been common knowledge since 1950 that seven colours can be assigned to tiles of an infinite honeycomb with cells of unit diameter such that no two tiles of the same colour are closer than $d(7)=\frac{\sqrt{7}}{2}$ apart. Various authors have described tilings using $k>7$ colours, giving corresponding values for $d(k)$, but it is generally unknown whether these are the largest possible for a given $k$. Here, for many $k$, we describe tilings with larger values of $d(k)$ than previously reported.


title: Decoherence by Optical Phonons in GaN Defect Single-Photon Emitters

abstract: In most single-photon defect emitters, such as those in SiC and diamond, interaction with low-energy acoustic phonons determines the temperature dependence of the decoherence rate and the resulting broadening of the ZPL with the temperature obeys a power law. GaN hosts bright and stable single-photon emitters in the 600 nm to 700 nm wavelength range with strong ZPLs even at room temperature. In this work, we study the temperature dependence of the ZPL spectra of GaN SPEs integrated with solid immersion lenses with the goal of understanding the relevant decoherence mechanisms. At temperatures below ~50 K, the ZPL lineshape is found to be Gaussian and the ZPL linewidth is temperature independent and dominated by spectral diffusion. Above ~50 K, the linewidth increases monotonically with the temperature and the lineshape evolves into a Lorentzian. Quite remarkably, the temperature dependence of the linewidth does not follow a power law. We propose a model in which decoherence caused by absorption/emission of optical phonons in an elastic Raman process determines the temperature dependence of the lineshape and the linewidth. Our model explains the temperature dependence of the ZPL linewidth and lineshape in the entire 10 K to 270 K temperature range explored in this work. The ~19 meV optical phonon energy extracted by fitting the model to the data matches remarkably well the ~18 meV zone center energy of the lowest optical phonon band (E2(low)) in GaN. Our work sheds light on the mechanisms responsible for linewidth broadening in GaN SPEs. Since a low energy optical phonon band (E2(low)) is a feature of most group III-V nitrides with a wurtzite crystal structure, including hBN and AlN, we expect our proposed mechanism to play an important role in defect emitters in these materials as well.


title: Cold-mode and hot-mode accretion in galaxy formation: an entropy approach

abstract: We have analysed two cosmological zoom simulations with $M_{\rm vir}\sim 10^{12}{\rm\,M}_\odot$ from the NIHAO series, both with and without feedback. We show that an entropy criterion based on the equation of state of the intergalactic medium can successfully separate cold- and hot-mode accretion. The shock-heated gas has non-negligible turbulent support and cools inefficiently. In the simulations without feedback, only a small fraction ($\sim 20$ per cent) of the stellar mass comes from baryons that have been in the hot circumgalactic medium, although quantitative conclusions should be taken with caution due to our small-number statistics. With feedback, the fraction is larger because of the reaccretion of gas heated by supernovae, which has lower entropies and shorter cooling times than the gas heated by accretion shocks. We have compared the results of NIHAO to predictions of the GalICS 2.1 semianalytic model of galaxy formation. The shock-stability criterion implemented in GalICS 2.1 successfully reproduces the transition from cold- to hot-mode accretion.


title: Distilling a Pretrained Language Model to a Multilingual ASR Model

abstract: Multilingual speech data often suffer from long-tailed language distribution, resulting in performance degradation. However, multilingual text data is much easier to obtain, yielding a more useful general language model. Hence, we are motivated to distill the rich knowledge embedded inside a well-trained teacher text model to the student speech model. We propose a novel method called the Distilling a Language model to a Speech model (Distill-L2S), which aligns the latent representations of two different modalities. The subtle differences are handled by the shrinking mechanism, nearest-neighbor interpolation, and a learnable linear projection layer. We demonstrate the effectiveness of our distillation method by applying it to the multilingual automatic speech recognition (ASR) task. We distill the transformer-based cross-lingual language model (InfoXLM) while fine-tuning the large-scale multilingual ASR model (XLSR-wav2vec 2.0) for each language. We show the superiority of our method on 20 low-resource languages of the CommonVoice dataset with less than 100 hours of speech data.


title: Thermodynamics of Permutation-Invariant Quantum Many-Body Systems: A Group-Theoretical Framework

abstract: Quantum systems of indistinguishable particles are commonly described using the formalism of second quantisation, which relies on the assumption that any admissible quantum state must be either symmetric or anti-symmetric under particle permutations. Coherence-induced many-body effects such as superradiance, however, can arise even in systems whose constituents are not fundamentally indistinguishable as long as all relevant dynamical observables are permutation-invariant. Such systems are not confined to symmetric or anti-symmetric states and therefore require a different theoretical approach. Focusing on non-interacting systems, here we combine tools from representation theory and thermodynamically consistent master equations to develop such a framework. We characterise the structure and properties of the steady states emerging in permutation-invariant ensembles of arbitrary multi-level systems that are collectively weakly coupled to a thermal environment. As an application of our general theory, we further explore how these states can in principle be used to enhance the performance of quantum thermal machines. Our group-theoretical framework thereby makes it possible to analyse various limiting cases that would not be accessible otherwise. In addition, it allows us to show that the properties of multi-level ensembles differ qualitatively from those of spin ensembles, which have been investigated earlier using the standard Clebsch-Gordan theory. Our results have a large scope for future generalisations and pave the way for systematic investigations of collective effects arising from permutation-invariance in quantum thermodynamics.


title: A Contextual Ranking and Selection Method for Personalized Medicine

abstract: Problem definition: Personalized medicine (PM) seeks the best treatment for each patient among a set of available treatment methods. Since a specific treatment does not work well on all patients, traditionally, the best treatment was selected based on the doctor's personal experience and expertise, which is subject to human errors. In the meantime, stochastic models have been well developed in the literature for a lot of major diseases. This gives rise to a simulation-based solution for PM, which uses the simulation tool to evaluate the performance for pairs of treatment and patient biometric characteristics, and based on that, selects the best treatment for each patient characteristics. Methodology/results: In this research, we extend the ranking and selection (R&S) model in simulation-based decision making to solving PM. The biometric characteristics of a patient is treated as a context for R&S, and we call it contextual ranking and selection (CR&S). We consider two formulations of CR&S with small and large context spaces respectively and develop new techniques for solving them and identifying the rate-optimal budget allocation rules. Based on them, two selection algorithms are proposed, which can be shown to be numerically superior via a set of tests on abstract and real-world examples. Managerial implications: This research provides a systematic way of conducting simulation-based decision-making for PM. To improve the overall decision quality for the possible contexts, more simulation efforts should be devoted to contexts in which it is difficult to distinguish between the best treatment and non-best treatments, and our results quantify the optimal tradeoff of the simulation efforts between the pairs of contexts and treatments.


title: New inflationary exact solution from Lie symmetries

abstract: For the inflaton field we determine a new exact solution by using the Lie symmetry analysis. Specifically, we construct a second-order differential master equation for arbitrary scalar field potential by assuming that the spectral index for the density perturbations $n_{s}$ and the scalar to tensor ratio $r$ are related as $n_{s}-1=h\left( r\right) $. Function $h\left( r\right) $ is classified according to the admitted Lie symmetries for the master equation. The possible admitted Lie symmetries form the $A_{2}$, $A_{3,2}$, $A_{3,3}$ and $sl\left( 3,R\right) $ Lie algebras. The new inflationary solution is recovered by the Lie symmetries of the $A_{3,3}$ algebra. Scalar field potential is derived explicitly, while we compare the resulting spectral indices with the observations.


title: Painlev\'e analysis for the cosmological field equations in Weyl Integrable Spacetime

abstract: We apply singularity analysis to investigate the integrability properties of the gravitational field equations in Weyl Integrable Spacetime for a spatially flat Friedmann--Lema\^itre--Robertson--Walker background spacetime induced with an ideal gas. We find that the field equations possess the Painlev\'e property in the presence of the cosmological constant and the analytic solution is given by a left Laurent expansion.


title: Optimized numerical gradient and Hessian estimation for variational quantum algorithms

abstract: Sampling noisy intermediate-scale quantum devices is a fundamental step that converts coherent quantum-circuit outputs to measurement data for running variational quantum algorithms that utilize gradient and Hessian methods in cost-function optimization tasks. This step, however, introduces estimation errors in the resulting gradient or Hessian computations. To minimize these errors, we discuss tunable numerical estimators, which are the finite-difference (including their generalized versions) and scaled parameter-shift estimators [introduced in Phys. Rev. A 103, 012405 (2021)], and propose operational circuit-averaged methods to optimize them. We show that these optimized numerical estimators offer estimation errors that drop exponentially with the number of circuit qubits for a given sampling-copy number, revealing a direct compatibility with the barren-plateau phenomenon. In particular, there exists a critical sampling-copy number below which an optimized difference estimator gives a smaller average estimation error in contrast to the standard (analytical) parameter-shift estimator, which exactly computes gradient and Hessian components. Moreover, this critical number grows exponentially with the circuit-qubit number. Finally, by forsaking analyticity, we demonstrate that the scaled parameter-shift estimators beat the standard unscaled ones in estimation accuracy under any situation, with comparable performances to those of the difference estimators within significant copy-number ranges, and are the best ones if larger copy numbers are affordable.


title: On filamentation in the dense plasma focus

abstract: Striking pictures showing filamentary structures in plasma focus have intrigued researchers from the early days of plasma focus research. A definitive understanding of their occurrence, origin, structure and role in plasma focus physics is still not in sight as summarized in a recent comprehensive review. This is because they are often not observed in a "standard mode" of plasma focus operation with pure deuterium, particularly in large installations, but are found in smaller experiments or those with gaseous admixtures. This has led to the suspicion that filaments are not a native feature of the plasma focus phenomenon. Recent success in observation of filaments in PF-1000 in a pure deuterium operation by a novel modification of the interferometer system that allows simultaneous interferometry and schlieren photography changes this situation. This Letter looks at the implications of this development in the larger context of plasma focus physics. Conceptualization of filamentation as a native feature of the traveling current distribution behind an ionizing strong shock wave is shown to be a feasible paradigm that can be formulated as a computable model for filamentation in the plasma focus.


title: SmartCut Er:LiNbO3 with high optical coherence enabling optical thickness control

abstract: Integrated photonics capable of incorporating rare earth ions with high optical coherence is desirable for realizing efficient quantum transducers, compact quantum memories, and hybrid quantum systems. Here we describe a photonic platform based on the SmartCut erbium-doped lithium niobate thin film, and explore its stable optical transitions at telecom wavelength in a dilution refrigerator. Optical coherence time of up to 180\,$\mu$s, rivaling the value of bulk crystals, is achieved in optical ridge waveguides and ring resonators. With this integrated platform, we demonstrate tunable light-ion interaction and flexible control of optical thickness by exploiting long waveguides, whose lengths are in principle variable. This unique ability to obtain high optical density using a low concentration ions further leads to the observation of multi-echo pulse trains in centimeter-long waveguides. Our results establish a promising photonic platform for quantum information processing with rare earth ions.


title: High cooperativity coupling of rare earth spins with planar superconducting resonator

abstract: Interfacing superconducting microwave resonator with rare earth doped crystals presents a promising hybrid quantum system for applications including spin-assisted transducers and memories. The coupling strength between spins of rare earth ions and the microwave photons is characterized by the cooperativity. Here we report an ultra-high cooperativity $C \sim$ 650 between rare earth spins and a planar superconducting microwave resonator that features a highly uniform magnetic field for harnessing the strong anisotropic coupling strength of erbium doped yttrium orthosilicate. This cooperativity rivals that from a bulk dielectric resonator and paves a path for efficiently coupling of spins with microwave photons on an integrated platform.


title: Feedback Dynamics of the Low-Income Rental Housing Market: Exploring Policy Responses to COVID-19

abstract: The COVID-19 recession threatens mass housing insecurity that undermines economic recovery. Unprecedented federal policy responses halt court-ordered evictions, but questions remain whether policies adequately account for dynamics that drive landlord-tenant interactions including accumulations of rental and mortgage arrears, rental unit availability, and low-income housing options. A system dynamics model probes complex feedback dynamics driving tenant and landlord decision-making in the low-income rental housing market pre- and post-pandemic protections. Feedback loops highlight tradeoffs considered by low-income tenants and landlords in the context of scarcity and uncertainty. Simulations suggest the eviction moratorium reduced evictions by 51% before its expiration in late 2021, but rental arrears, overcrowding, and homelessness remained high. Federal emergency rental assistance further contributed to keeping evictions low, but showed only modest effects on housing insecurity and homelessness. More rapid allocation of funds would substantially increase impact. Failure to address underlying financial hardship and limited affordable housing undermine COVID recovery.


title: BIMS-PU: Bi-Directional and Multi-Scale Point Cloud Upsampling

abstract: The learning and aggregation of multi-scale features are essential in empowering neural networks to capture the fine-grained geometric details in the point cloud upsampling task. Most existing approaches extract multi-scale features from a point cloud of a fixed resolution, hence obtain only a limited level of details. Though an existing approach aggregates a feature hierarchy of different resolutions from a cascade of upsampling sub-network, the training is complex with expensive computation. To address these issues, we construct a new point cloud upsampling pipeline called BIMS-PU that integrates the feature pyramid architecture with a bi-directional up and downsampling path. Specifically, we decompose the up/downsampling procedure into several up/downsampling sub-steps by breaking the target sampling factor into smaller factors. The multi-scale features are naturally produced in a parallel manner and aggregated using a fast feature fusion method. Supervision signal is simultaneously applied to all upsampled point clouds of different scales. Moreover, we formulate a residual block to ease the training of our model. Extensive quantitative and qualitative experiments on different datasets show that our method achieves superior results to state-of-the-art approaches. Last but not least, we demonstrate that point cloud upsampling can improve robot perception by ameliorating the 3D data quality.


title: Sentiment Analysis with R: Natural Language Processing for Semi-Automated Assessments of Qualitative Data

abstract: Sentiment analysis is a sub-discipline in the field of natural language processing and computational linguistics and can be used for automated or semi-automated analyses of text documents. One of the aims of these analyses is to recognize an expressed attitude as positive or negative as it can be contained in comments on social media platforms or political documents and speeches as well as fictional and nonfictional texts. Regarding analyses of comments on social media platforms, this is an extension of the previous tutorial on semi-automated screenings of social media network data. A longitudinal perspective regarding social media comments as well as cross-sectional perspectives regarding fictional and nonfictional texts, e.g. entire books and libraries, can lead to extensive text documents. Their analyses can be simplified and accelerated by using sentiment analysis with acceptable inter-rater reliability. Therefore, this tutorial introduces the basic functions for performing a sentiment analysis with R and explains how text documents can be analysed step by step - regardless of their underlying formatting. All prerequisites and steps are described in detail and associated codes are available on GitHub. A comparison of two political speeches illustrates a possible use case.


title: Machine Learning-based Biological Ageing Estimation Technologies: A Survey

abstract: In recent years, there are various methods of estimating Biological Age (BA) have been developed. Especially with the development of machine learning (ML), there are more and more types of BA predictions, and the accuracy has been greatly improved. The models for the estimation of BA play an important role in monitoring healthy aging, and could provide new tools to detect health status in the general population and give warnings to sub-healthy people. We will mainly review three age prediction methods by using ML. They are based on blood biomarkers, facial images, and structural neuroimaging features. For now, the model using blood biomarkers is the simplest, most direct, and most accurate method. The face image method is affected by various aspects such as race, environment, etc., the prediction accuracy is not very good, which cannot make a great contribution to the medical field. In summary, we are here to track the way forward in the era of big data for us and other potential general populations and show ways to leverage the vast amounts of data available today.


title: Review on Social Behavior Analysis of Laboratory Animals: From Methodologies to Applications

abstract: As the bridge between genetic and physiological aspects, animal behaviour analysis is one of the most significant topics in biology and ecological research. However, identifying, tracking and recording animal behaviour are labour intensive works that require professional knowledge. To mitigate the spend for annotating data, researchers turn to computer vision techniques for automatic label algorithms, since most of the data are recorded visually. In this work, we explore a variety of behaviour detection algorithms, covering traditional vision methods, statistical methods and deep learning methods. The objective of this work is to provide a thorough investigation of related work, furnishing biologists with a scratch of efficient animal behaviour detection methods. Apart from that, we also discuss the strengths and weaknesses of those algorithms to provide some insights for those who already delve into this field.


title: $Ab\ initio$ molecular dynamics of temporary anions using complex absorbing potentials

abstract: Dissociative electron attachment, that is, the cleavage of chemical bonds induced by low-energy electrons, is difficult to model with standard quantum-chemical methods because the involved anions are not bound but subject to autodetachment. We present here a new computational development for simulating the dynamics of temporary anions on complex-valued potential energy surfaces. The imaginary part of these surfaces describes electron loss, whereas the gradient of the real part represents the force on the nuclei. In our method, the forces are computed analytically based on Hartree-Fock theory with a complex absorbing potential. $Ab\ initio$ molecular dynamics simulations for the temporary anions of dinitrogen, ethylene, chloroethane, and the five mono- to tetrachlorinated ethylenes show qualitative agreement with experiments and offer mechanistic insights into dissociative electron attachments. The results also demonstrate how our method evenhandedly deals with molecules that may undergo dissociation upon electron attachment and those which only undergo autodetachment.

categories: physics.chem-ph physics.atm-clus physics.bio-ph physics.class-ph physics.comp-ph


title: Diagnostic Communication and Visual System based on Vehicle UDS Protocol

abstract: Unified Diagnostic Services (UDS) is a diagnostic communication protocol used in electronic control units (ECUs) within automotive electronics, which is specified in the ISO 14229-1. It is derived from ISO 14230-3 (KWP2000) and the now obsolete ISO 15765-3 (Diagnostic Communication over Controller Area Network (DoCAN). 'Unified' in this context means that it is an international and not a company-specific standard. By now this communication protocol is used in all new ECUs made by Tier 1 suppliers of Original Equipment Manufacturer (OEM), and is incorporated into other standards, such as AUTOSAR. The ECUs in modern vehicles control nearly all functions, including electronic fuel injection (EFI), engine control, the transmission, anti-lock braking system, door locks, braking, window operation, and more.


title: BackdoorBench: A Comprehensive Benchmark of Backdoor Learning

abstract: Backdoor learning is an emerging and vital topic for studying deep neural networks' vulnerability (DNNs). Many pioneering backdoor attack and defense methods are being proposed, successively or concurrently, in the status of a rapid arms race. However, we find that the evaluations of new methods are often unthorough to verify their claims and accurate performance, mainly due to the rapid development, diverse settings, and the difficulties of implementation and reproducibility. Without thorough evaluations and comparisons, it is not easy to track the current progress and design the future development roadmap of the literature. To alleviate this dilemma, we build a comprehensive benchmark of backdoor learning called BackdoorBench. It consists of an extensible modular-based codebase (currently including implementations of 8 state-of-the-art (SOTA) attacks and 9 SOTA defense algorithms) and a standardized protocol of complete backdoor learning. We also provide comprehensive evaluations of every pair of 8 attacks against 9 defenses, with 5 poisoning ratios, based on 5 models and 4 datasets, thus 8,000 pairs of evaluations in total. We present abundant analysis from different perspectives about these 8,000 evaluations, studying the effects of different factors in backdoor learning. All codes and evaluations of BackdoorBench are publicly available at \url{https://backdoorbench.github.io}.


title: BRL/Pisa/IIT SoftHand: A Low-cost, 3D-Printed, Underactuated, Tendon-Driven Hand with Soft and Adaptive Synergies

abstract: This paper introduces the BRL/Pisa/IIT (BPI) SoftHand: a single actuator-driven, low-cost, 3D-printed, tendon-driven, underactuated robot hand that can be used to perform a range of grasping tasks. Based on the adaptive synergies of the Pisa/IIT SoftHand, we design a new joint system and tendon routing to facilitate the inclusion of both soft and adaptive synergies, which helps us balance durability, affordability and grasping performance of the hand. The focus of this work is on the design, simulation, synergies and grasping tests of this SoftHand. The novel phalanges are designed and printed based on linkages, gear pairs and geometric restraint mechanisms, and can be applied to most tendon-driven robotic hands. We show that the robot hand can successfully grasp and lift various target objects and adapt to hold complex geometric shapes, reflecting the successful adoption of the soft and adaptive synergies. We intend to open-source the design of the hand so that it can be built cheaply on a home 3D-printer. For more detail: https://sites.google.com/view/bpi-softhandtactile-group-bri/brlpisaiit-softhand-design


title: Space-resolved Chemical Information from Infrared Extinction Spectra

abstract: Based on the classical Lorentz model of the index of refraction, a new method is presented for the extraction of the complex index of refraction from the extinction efficiency of homogeneous and layered dielectric spheres that simultaneously removes scattering effects and corrects measured extinction spectra for baseline shifts, tilts, curvature, and scaling. No reference spectrum is required and the method automatically satisfies the Kramers-Kronig relations. Thus, the method yields pure absorbance spectra for unambiguous interpretation of the chemical information of the sample. In the case of homogeneous spheres, the method also determines the radius of the sphere. In the case of layered spheres, the method determines the radii of the layers and the substances within each layer. Only a single-element detector is required. Using simulated $Q_{ext}$ data of polymethyl-methacrylate (PMMA) and polystyrene homogeneous and layered spheres we show that our reconstruction algorithm is reliable and accurately extracts pure absorbance spectra from $Q_{ext}$ data. Reconstructing the pure absorbance spectrum from a published, experimentally measured raw absorbance spectrum shows that our method also works for uncorrected spectra, reliably removes scattering effects and, given shape information, simultaneously corrects for spectral distortions.


title: Enhanced Deep Animation Video Interpolation

abstract: Existing learning-based frame interpolation algorithms extract consecutive frames from high-speed natural videos to train the model. Compared to natural videos, cartoon videos are usually in a low frame rate. Besides, the motion between consecutive cartoon frames is typically nonlinear, which breaks the linear motion assumption of interpolation algorithms. Thus, it is unsuitable for generating a training set directly from cartoon videos. For better adapting frame interpolation algorithms from nature video to animation video, we present AutoFI, a simple and effective method to automatically render training data for deep animation video interpolation. AutoFI takes a layered architecture to render synthetic data, which ensures the assumption of linear motion. Experimental results show that AutoFI performs favorably in training both DAIN and ANIN. However, most frame interpolation algorithms will still fail in error-prone areas, such as fast motion or large occlusion. Besides AutoFI, we also propose a plug-and-play sketch-based post-processing module, named SktFI, to refine the final results using user-provided sketches manually. With AutoFI and SktFI, the interpolated animation frames show high perceptual quality.


title: The Yield Volume Fraction approach to the description of the stress-strain curve of a nickel-base superalloy

abstract: The stress-strain curves of most metallic alloys are often described using the relatively simple Ramberg-Osgood relationship. Whilst this description captures the overall stress-strain curve under monotonic tensile loading with reasonable overall accuracy, it often presents significant errors in the immediate post-yield region where the interplay between the elastic and plastic strains is particularly significant. This study proposes and develops a new approach to the description of the tensile stress-strain curve based on the Yield Volume Fraction (YVF) function. The YVF description provides an excellent match to experimental stress-strain curves based on a physically meaningful parameter that corresponds to the cumulative volume fraction of the polycrystal that undergoes yielding during monotonic deformation. The statistical nature of the polycrystal yield phenomenon is highlighted by the fact that the YVF model achieves good agreement with observations when the lognormal and extreme value distributions are employed to express the cumulative density function for the total yield volume fraction, and the probability density function for the incremental yield volume fraction, respectively. This proposed approach is compared with crystal plasticity finite element (CPFE) simulations and the Ramberg-Osgood model, along with experimental observations. The results highlight the potential of more extensive use of statistical methods in the description of material deformation response for improved design.


title: Spatial correlation of a particle-hole pair with a repulsive isovector interaction

abstract: We study the spatial correlation of a particle-hole pair in the isovector channel in $^{56}$Co and $^{40}$K nuclei. To this end, we employ the Hartree-Fock+Tamm-Dancoff approximation with the Skyrme interaction. We find a large concentration of the two-body density at positions where the neutron particle and the proton hole states locate on the opposite side to each other with respect to the core nucleus. This feature originates from a repulsive nature of the isovector residual interaction, which is in stark contrast to the dineutron correlation with an attractive pairing interaction between the valence neutrons discussed e.g., in $^{11}$Li and $^6$He. A possible experimental implication of the repulsive correlation is also discussed.


title: Application of a simple short-range attraction long-range repulsion colloidal model towards predicting the viscosity of protein solutions

abstract: Some hard sphere colloidal models have been criticized for inaccurately predicting the solution viscosity of complex biological molecules like proteins. Competing short-range attractions and long-range repulsions, also known as SALR interactions, have been thought to affect the microstructure of a protein solution at low to moderate ionic strength. However, such interactions have been implicated primarily in causing phase transition, protein gelation, or reversible cluster formation and their effect on protein solution viscosity change is not fully understood. In this work we show the application of a hard sphere colloidal model with SALR interactions towards predicting the viscosity of dilute to semi-dilute protein solutions. The comparison is performed for a globular shaped albumin and Y-shaped therapeutic monoclonal antibody that are not explained by previous colloidal models. The model predictions show that it is the coupling between attractions and repulsions that give rise to the observed experimental trends in solution viscosity as a function of pH, concentration, and ionic strength. The parameters of the model are obtained from measurements of the second virial coefficient and net surface charge/zeta-potential, without additional fitting of the viscosity.


title: Fast generation of arbitrary optical focus array

abstract: We report a novel method to generate arbitrary optical focus arrays (OFAs). Our approach rapidly produces computer-generated holograms (CGHs) to precisely control the positions and the intensities of the foci. This is achieved by replacing the fast Fourier transform (FFT) operation in the conventional iterative Fourier-transform algorithm (IFTA) with a linear algebra one, identifying/removing zero elements from the matrices, and employing a generalized weighting strategy. On the premise of accelerating the calculation speed by >70 times, we demonstrate OFA with 99% intensity precision in the experiment. Our method proves effective and is applicable for the systems in which real-time OFA generation is essential.


title: Synthesizing Personalized Non-speech Vocalization from Discrete Speech Representations

abstract: We formulated non-speech vocalization (NSV) modeling as a text-to-speech task and verified its viability. Specifically, we evaluated the phonetic expressivity of HUBERT speech units on NSVs and verified our model's ability to control over speaker timbre even though the training data is speaker few-shot. In addition, we substantiated that the heterogeneity in recording conditions is the major obstacle for NSV modeling. Finally, we discussed five improvements over our method for future research. Audio samples of synthesized NSVs are available on our demo page: https://resemble-ai.github.io/reLaugh.


title: Statistical inference with implicit SGD: proximal Robbins-Monro vs. Polyak-Ruppert

abstract: The implicit stochastic gradient descent (ISGD), a proximal version of SGD, is gaining interest in the literature due to its stability over (explicit) SGD. In this paper, we conduct an in-depth analysis of the two modes of ISGD for smooth convex functions, namely proximal Robbins-Monro (proxRM) and proximal Poylak-Ruppert (proxPR) procedures, for their use in statistical inference on model parameters. Specifically, we derive non-asymptotic point estimation error bounds of both proxRM and proxPR iterates and their limiting distributions, and propose on-line estimators of their asymptotic covariance matrices that require only a single run of ISGD. The latter estimators are used to construct valid confidence intervals for the model parameters. Our analysis is free of the generalized linear model assumption that has limited the preceding analyses, and employs feasible procedures. Our on-line covariance matrix estimators appear to be the first of this kind in the ISGD literature.


title: Evaluation of Semantic Answer Similarity Metrics

abstract: There are several issues with the existing general machine translation or natural language generation evaluation metrics, and question-answering (QA) systems are indifferent in that context. To build robust QA systems, we need the ability to have equivalently robust evaluation systems to verify whether model predictions to questions are similar to ground-truth annotations. The ability to compare similarity based on semantics as opposed to pure string overlap is important to compare models fairly and to indicate more realistic acceptance criteria in real-life applications. We build upon the first to our knowledge paper that uses transformer-based model metrics to assess semantic answer similarity and achieve higher correlations to human judgement in the case of no lexical overlap. We propose cross-encoder augmented bi-encoder and BERTScore models for semantic answer similarity, trained on a new dataset consisting of name pairs of US-American public figures. As far as we are concerned, we provide the first dataset of co-referent name string pairs along with their similarities, which can be used for training.


title: Emergence of steady currents due to strong prethermalization

abstract: A steady current between baths is a manifestation of the prethermalization phenomenon, a quasi-equilibrium dynamical process with weak conserved quantity breaking. We consider two finite nonintegrable many-body baths each following the eigenstate thermalization hypothesis, and each prepared in a random product state with fixed and different energy constraints, i.e., within the mean energy ensemble. Such an initialization, not being constrained to superpositions or mixtures of many-body eigenstates, opens the door to experimental realization and also significantly simplifies numerical simulations. We show that such dynamical process is typical as the current variance decreases exponentially with respect to the size of baths. We also demonstrate that the emerging current is prethermalized in a strong sense, analogously to strong thermalization, meaning that the current values stay close to the microcanonical one for most of the time.


title: Global regularity of 2D generalized incompressible magnetohydrodynamic equations

abstract: In this paper, we are concerned with the two-dimensional (2D) incompressible magnetohydrodynamic (MHD) equations with velocity dissipation given by $(-\Delta)^{\alpha}$ and magnetic diffusion given by reducing about logarithmic diffusion from standard Laplacian diffusion. More precisely, we establish the global regularity of solutions to the system as long as the power $\alpha$ is a positive constant. In addition, we prove several global \emph{a priori} bounds for the case $\alpha=0$. In particular, our results significantly improve previous works and take us one step closer to a complete resolution of the global regularity issue on the 2D resistive MHD equations, namely, the case when the MHD equations only have standard Laplacian magnetic diffusion.


title: Learning to Evolve Structural Ensembles of Unfolded and Disordered Proteins Using Experimental Solution Data

abstract: We have developed a Generative Recurrent Neural Networks (GRNN) that learns the probability of the next residue torsions $X_{i+1}=\ [\phi_{i+1},\psi_{i+1},\omega _{i+1}, \chi_{i+1}]$ from the previous residue in the sequence $X_i$ to generate new IDP conformations. In addition, we couple the GRNN with a Bayesian model, X-EISD, in a reinforcement learning step that biases the probability distributions of torsions to take advantage of experimental data types such as J-couplingss, NOEs and PREs. We show that updating the generative model parameters according to the reward feedback on the basis of the agreement between structures and data improves upon existing approaches that simply reweight static structural pools for disordered proteins. Instead the GRNN "DynamICE" model learns to physically change the conformations of the underlying pool to those that better agree with experiment.


title: Covering $b$-Symbol Metric Codes and the Generalized Singleton Bound

abstract: Symbol-pair codes were proposed for the application in high density storage systems, where it is not possible to read individual symbols. Yaakobi, Bruck and Siegel proved that the minimum pair-distance of binary linear cyclic codes satisfies $d_2 \geq \lceil 3d_H/2 \rceil$ and introduced $b$-symbol metric codes in 2016. In this paper covering codes in $b$-symbol metrics are considered. Some examples are given to show that the Delsarte bound and the Norse bound for covering codes in the Hamming metric are not true for covering codes in the pair metric. We give the redundancy bound on covering radius of linear codes in the $b$-symbol metric and give some optimal codes attaining this bound. Then we prove that there is no perfect linear symbol-pair code with the minimum pair distance $7$ and there is no perfect $b$-symbol metric code if $b\geq \frac{n+1}{2}$. Moreover a lot of cyclic and algebraic-geometric codes are proved non-perfect in the $b$-symbol metric. The covering radius of the Reed-Solomon code in the $b$-symbol metric is determined. As an application the generalized Singleton bound on the sizes of list-decodable $b$-symbol metric codes is also presented. Then an upper bound on lengths of general MDS symbol-pair codes is proved.


title: Crypto Makes AI Evolve

abstract: Adopting cryptography has given rise to a significant evolution in Artificial Intelligence (AI). This paper studies the path and stages of this evolution. We start with reviewing existing relevant surveys, noting their shortcomings, especially the lack of a close look at the evolution process and solid future roadmap. These shortcomings justify the work of this paper. Next, we identify, define and discuss five consequent stages in the evolution path, including Crypto-Sensitive AI, Crypto-Adapted AI, Crypto-Friendly AI, Crypto-Enabled AI, Crypto-Protected AI. Then, we establish a future roadmap for further research in this area, focusing on the role of quantum-inspired and bio-inspired AI.


title: Degenerations to secant cubic hypersurfaces and limiting Hodge structure

abstract: The secant variety of the Veronese surface is a singular cubic fourfold. The degeneration of Hodge structures of one-parameter degenerations to this secant cubic fourfold is a key ingredient for B.~Hassett and R.~Laza in studying the moduli space of cubic fourfolds via the period mapping. We generalize some of their results to the cubic hypersurface that is the secant variety of a Severi variety. Specifically, we study the limit mixed Hodge structures associated to one-parameter degenerations to the secant cubic hypersurface. Considering S.~Usui's partial compactification of a period domain for Hodge structures of general weights, we apply the limit mixed Hodge structure to characterize a local extension of the period map for the corresponding cubic hypersurfaces.


title: Properties of black hole vortex in Einstein's gravity

abstract: We investigate the influence of the matter field and the gauge field on the metric functions of the AdS$_3$ spacetime of the Maxwell-Higgs model. By considering a matter field with a solitonic profile with the ability to adjust the field variable from kink to compact-like configurations, the appearance of black hole solutions is noticed for an event horizon at $r_{+} \approx 1.5$. An interesting result is displayed when analyzing the influence of matter field compactification on the metric functions. As we obtain compact-like field configurations the metric functions tend to a ``linearized behavior''. However, the compactification of the field does not change the structure of the horizon of the magnetic black hole vortex. With the ADM formalism, the mass of the black hole vortex is calculated, and its numerical results are presented. By analyzing the so-called ADM mass, it is observed that the mass of the black hole vortex increases as the cosmological constant becomes more negative, and this coincides with the vortex core becoming smaller. Nonetheless, this mass tends to decrease as the solitonic profile of the matter field becomes more compacted. Then, the black hole temperature study is performed using the tunneling formalism. In this case, it is perceived that the cosmological constant, and the $\alpha$-parameter, will influence the Bekenstein-Hawking temperature. In other words, the temperature of the structure increases as these parameters increase.


title: SKTR: Trace Recovery from Stochastically Known Logs

abstract: Developments in machine learning together with the increasing usage of sensor data challenge the reliance on deterministic logs, requiring new process mining solutions for uncertain, and in particular stochastically known, logs. In this work we formulate {trace recovery}, the task of generating a deterministic log from stochastically known logs that is as faithful to reality as possible. An effective trace recovery algorithm would be a powerful aid for maintaining credible process mining tools for uncertain settings. We propose an algorithmic framework for this task that recovers the best alignment between a stochastically known log and a process model, with three innovative features. Our algorithm, SKTR, 1) handles both Markovian and non-Markovian processes; 2) offers a quality-based balance between a process model and a log, depending on the available process information, sensor quality, and machine learning predictiveness power; and 3) offers a novel use of a synchronous product multigraph to create the log. An empirical analysis using five publicly available datasets, three of which use predictive models over standard video capturing benchmarks, shows an average relative accuracy improvement of more than 10 over a common baseline.


title: Can Convolution Neural Networks Be Used for Detection of Gravitational Waves from Precessing Black Hole Systems?

abstract: Current searches for gravitational waves from black hole binaries with LIGO and Virgo observatories are limited to using the analytical models computed for the systems with spins of the black holes aligned with the orbital angular momentum of the binary. The observation of black hole binaries with precessing spins (spins misaligned with the orbital angular momentum) could provide unique astrophysical insights into the formation of these sources; thus, it is crucial to design a search scheme to detect compact binaries with precession spins. It has been shown that the detection of compact binaries carrying precessing spins is not achievable with aligned-spins template waveforms. Efforts have been made to construct the template banks to detect the precessing binaries using the matched filtering based detection pipelines. However, in the absence of robust methods and huge computational requirements, the precessing searches, more or less, still remain a challenge. This work introduces a detection scheme for the binary black holes to classify them into aligned and precessing systems using a convolution neural network (\CNN). We treat the detection of the $\GW$ signals from $\BBH$ systems as a classification problem. Our architecture first classifies data as $\GW$ signals originated from binary black holes ($\BBH$) or noise and then it further classifies the detected $\BBH$ systems as precessing or non-precessing (aligned/anti-aligned) systems. Our classifier with an accuracy of $\approx$ 99\% classifies between noise and the signal and with an accuracy of $\approx$ 91\% it classifies the detected signals into aligned and precessing signals. We have also extended our analysis for a multi-detector framework and tested the performance of our designed architecture on $\O1$, $\O2$ and $\O3$ data to identify the detected $\BBH$ events as aligned and precessing events.


title: Guided Exploration in Reinforcement Learning via Monte Carlo Critic Optimization

abstract: The class of deep deterministic off-policy algorithms is effectively applied to solve challenging continuous control problems. Current approaches commonly utilize random noise as an exploration method, which has several drawbacks, including the need for manual adjustment for a given task and the absence of exploratory calibration during the training process. We address these challenges by proposing a novel guided exploration method that uses an ensemble of Monte Carlo Critics for calculating exploratory action correction. The proposed method enhances the traditional exploration scheme by dynamically adjusting exploration. Subsequently, we present a novel algorithm that leverages the proposed exploratory module for both policy and critic modification. The presented algorithm demonstrates superior performance compared to modern reinforcement learning algorithms across a variety of problems in the DMControl suite.


title: Learning to Infer 3D Shape Programs with Differentiable Renderer

abstract: Given everyday artifacts, such as tables and chairs, humans recognize high-level regularities within them, such as the symmetries of a table, the repetition of its legs, while possessing low-level priors of their geometries, e.g., surfaces are smooth and edges are sharp. This kind of knowledge constitutes an important part of human perceptual understanding and reasoning. Representations of and how to reason in such knowledge, and the acquisition thereof, are still open questions in artificial intelligence (AI) and cognitive science. Building on the previous proposal of the \emph{3D shape programs} representation alone with the accompanying neural generator and executor from \citet{tian2019learning}, we propose an analytical yet differentiable executor that is more faithful and controllable in interpreting shape programs (particularly in extrapolation) and more sample efficient (requires no training). These facilitate the generator's learning when ground truth programs are not available, and should be especially useful when new shape-program components are enrolled either by human designers or -- in the context of library learning -- algorithms themselves. Preliminary experiments on using it for adaptation illustrate the aforesaid advantages of the proposed module, encouraging similar methods being explored in building machines that learn to reason with the kind of knowledge described above, and even learn this knowledge itself.


title: Chiral $Z^\prime$ in FASER, FASER2, DUNE, and ILC beam dump experiments

abstract: The origin of neutrino mass is a big unsolved problem of the Standard Model (SM) that motivate us to consider beyond the SM (BSM) scenarios where SM-singlet right-handed neutrinos (RHNs) are introduced to explain the origin of the light neutrino masses through the seesaw mechanism. There is a variety of ways which could lead us to this goal and one of them is a general U$(1)$ extension of the SM. In this scenario, three SM-singlet RHNs are introduced to cancel the gauge and mixed gauge gravity anomalies. After anomaly cancellation, we notice that the left- and right-handed charged fermions are differently charged under the general U$(1)$ gauge group evolving a chiral scenario. After the breaking of the general U$(1)$ symmetry, a neutral BSM gauge boson $(Z^\prime)$ acquires mass and it is a free parameter. Such $Z^\prime$, being lighter than $5$ GeV, could be probed at the intensity and lifetime frontiers like FASER, FASER2, DUNE, and ILC beam dump experiments. The estimated bounds are needed to be compared with the existing bounds. We find that existing constraints from Orsay, Nomad, PS191, KEK, LSND, CHARM experiments, and cosmological scenario like SN1987A can be compared in our case once estimated for chiral scenarios. Finally, we compare the parameter spaces showing viable ones that could be probed by FASER, FASER2, DUNE, and ILC beam dump experiments and already excluded regions from Orsay, Nomad, PS191, KEK, LSND, CHARM, and SN1987A for a chiral scenario.


title: Marginal $T\bar{T}$-Like Deformation and ModMax Theories in Two Dimensions

abstract: Recently, the ModMax theory has been proposed as a unique conformal nonlinear extension of electrodynamics. We have shown in [1] that this modification can be reproduced a marginal $T\bar{T}$-like deformation from pure Maxwell theory. Further, this deformation is solved by using a perturbative approach. In this letter, we will investigate another ModMax-like deformation for a two-dimensional (2D) scalar field theory. In this regard, we first find a marginal $T\bar{T}$-like deformation in two dimensions and then reproduce the MM-like Lagrangian from a multiple 2D scalar field theory.


title: Finding Proper Time Intervals for Dynamic Network Extraction

abstract: Extracting a proper dynamic network for modelling a time-dependent complex system is an important issue. Building a correct model is related to finding out critical time points where a system exhibits considerable change. In this work, we propose to measure network similarity to detect proper time intervals. We develop three similarity metrics, node, link, and neighborhood similarities, for any consecutive snapshots of a dynamic network. Rather than a label or a user-defined threshold, we use statistically expected values of proposed similarities under a null-model to state whether the system changes critically. We experimented on two different data sets with different temporal dynamics: The Wi-Fi access points logs of a university campus and Enron emails. Results show that, first, proposed similarities reflect similar signal trends with network topological properties with less noisy signals, and their scores are scale invariant. Second, proposed similarities generate better signals than adjacency correlation with optimal noise and diversity. Third, using statistically expected values allows us to find different time intervals for a system, leading to the extraction of non-redundant snapshots for dynamic network modelling.


title: Optimal Regulation of Prosumers and Consumers in Smart Energy Communities

abstract: In smart energy communities, households of a particular geographical location make a cooperative group to achieve the community's social welfare. Prosumers are the users that both consume and produce energy. In this paper, we develop stochastic and distributed algorithms to regulate the number of consumers and the number of prosumers with heterogeneous energy sources in the smart energy community. In the community, each prosumer has one of the heterogeneous energy sources such as solar photovoltaic panels or wind turbines installed in their household. The prosumers and consumers decide in a probabilistic way when to be active. They keep their information private and do not need to share it with other prosumers or consumers in the community. Moreover, we consider a central server that keeps track of the total number of active prosumers and consumers and sends feedback signals in the community at each time step; the prosumers and consumers use these signals to calculate their probabilistic intent. We present experimental results to check the efficacy of the algorithms. We observe that the average number of times prosumers and consumers are active reaches the optimal value over time, and the community asymptotically achieves the social optimum value.


title: Topology-aware Generalization of Decentralized SGD

abstract: This paper studies the algorithmic stability and generalizability of decentralized stochastic gradient descent (D-SGD). We prove that the consensus model learned by D-SGD is $\mathcal{O}{(N^{-1}+m^{-1} +\lambda^2)}$-stable in expectation in the non-convex non-smooth setting, where $N$ is the total sample size, $m$ is the worker number, and $1+\lambda$ is the spectral gap that measures the connectivity of the communication topology. These results then deliver an $\mathcal{O}{(N^{-(1+\alpha)/2}+ m^{-(1+\alpha)/2}+\lambda^{1+\alpha} + \phi_{\mathcal{S}})}$ in-average generalization bound, which is non-vacuous even when $\lambda$ is closed to $1$, in contrast to vacuous as suggested by existing literature on the projected version of D-SGD. Our theory indicates that the generalizability of D-SGD is positively correlated with the spectral gap, and can explain why consensus control in initial training phase can ensure better generalization. Experiments of VGG-11 and ResNet-18 on CIFAR-10, CIFAR-100 and Tiny-ImageNet justify our theory. To our best knowledge, this is the first work on the topology-aware generalization of vanilla D-SGD. Code is available at https://github.com/Raiden-Zhu/Generalization-of-DSGD.


title: UltraMNIST Classification: A Benchmark to Train CNNs for Very Large Images

abstract: Convolutional neural network (CNN) approaches available in the current literature are designed to work primarily with low-resolution images. When applied on very large images, challenges related to GPU memory, smaller receptive field than needed for semantic correspondence and the need to incorporate multi-scale features arise. The resolution of input images can be reduced, however, with significant loss of critical information. Based on the outlined issues, we introduce a novel research problem of training CNN models for very large images, and present 'UltraMNIST dataset', a simple yet representative benchmark dataset for this task. UltraMNIST has been designed using the popular MNIST digits with additional levels of complexity added to replicate well the challenges of real-world problems. We present two variants of the problem: 'UltraMNIST classification' and 'Budget-aware UltraMNIST classification'. The standard UltraMNIST classification benchmark is intended to facilitate the development of novel CNN training methods that make the effective use of the best available GPU resources. The budget-aware variant is intended to promote development of methods that work under constrained GPU memory. For the development of competitive solutions, we present several baseline models for the standard benchmark and its budget-aware variant. We study the effect of reducing resolution on the performance and present results for baseline models involving pretrained backbones from among the popular state-of-the-art models. Finally, with the presented benchmark dataset and the baselines, we hope to pave the ground for a new generation of CNN methods suitable for handling large images in an efficient and resource-light manner.


title: MIRAC-5: A ground-based mid-IR instrumentwith the potential to detect ammonia in gas giants

abstract: We present the fifth incarnation of the Mid-Infrared Array Camera (MIRAC-5) instrument which will use a new GeoSnap (3 - 13 microns) detector. Advances in adaptive optics (AO) systems and detectors are enabling ground-based mid-infrared systems capable of high spatial resolution and deep contrast. As one of the only 3 - 13 micron cameras used in tandem with AO, MIRAC-5 will be complementary to the James Webb Space Telescope (JWST) and capable of characterizing gas giant exoplanets and imaging forming protoplanets (helping to characterize their circumplanetary disks). We describe key features of the MIRAC-5 GeoSnap detector, a long-wave Mercury-Cadmium-Telluride (MCT) array produced by Teledyne Imaging Sensors (TIS), including its high quantum efficiency (> 65%), large well-depth, and low noise. We summarize MIRAC-5's important capabilities, including prospects for obtaining the first continuum mid-infrared measurements for several gas giants and the first 10.2-10.8 micron NH3 detection in the atmosphere of the warm companion GJ 504b (Teff ~550 K) within 8 hours of observing time. Finally, we describe plans for future upgrades to MIRAC-5 such as adding a coronagraph. MIRAC-5 will be commissioned on the MMT utilizing the new MAPS AO system in late 2022 with plans to move to Magellan with the MagAO system in the future.


title: Minority Report: A Graph Network Oracle for In Situ Visualization

abstract: In situ visualization techniques are hampered by a lack of foresight: crucial simulation phenomena can be missed due to a poor sampling rate or insufficient detail at critical timesteps. Keeping a human in the loop is impractical, and defining statistical triggers can be difficult. This paper demonstrates the potential for using a machine-learning-based simulation surrogate as an oracle to identify expected critical regions of a large-scale simulation. These critical regions are used to drive the in situ analysis, providing greater data fidelity and analysis resolution with an equivalent I/O budget to a traditional in situ framework. We develop a distributed asynchronous in situ visualization by integrating TACC Galaxy with CB-Geo MPM for material point simulation of granular flows. We employ a PyTorch-based 3D Graph Network Simulator (GNS) trained on granular flow problems as an oracle to predict the dynamics of granular flows. Critical regions of interests are manually tagged in GNS for in situ rendering in MPM.


title: Orbital Angular Momenta and Geometric Phase Characteristics of Spin-polarized Components of a General Paraxial Beam-field

abstract: We explore a subtle and fundamental nature of spin-orbit interaction (SOI) in a general paraxial beam-field by mathematically characterizing the orbital angular momentum (OAM) flux densities of the spin-polarized component fields via Barnett's flux determination formalism. We show the application of our formalism by considering the special case of a Brewster-reflected paraxial beam, for which we explore specific details such as non-canonical vortex phase structures and single-photon interpretation of the field function. The phases of the spin-component fields are interpreted as geometric phases; and we devise an experimental method of direct measurement of these phases by transferring the spatial phase information to the polarization domain -- thus demonstrating a classical analog von Neumann measurement. Our complete mathematical characterization of SOI and its relevance to the direct measurement of geometric phase can find potential application in future methods exploring OAM and geometric phase characteristics in other general optical systems.


title: Defense against adversarial attacks on deep convolutional neural networks through nonlocal denoising

abstract: Despite substantial advances in network architecture performance, the susceptibility of adversarial attacks makes deep learning challenging to implement in safety-critical applications. This paper proposes a data-centric approach to addressing this problem. A nonlocal denoising method with different luminance values has been used to generate adversarial examples from the Modified National Institute of Standards and Technology database (MNIST) and Canadian Institute for Advanced Research (CIFAR-10) data sets. Under perturbation, the method provided absolute accuracy improvements of up to 9.3% in the MNIST data set and 13% in the CIFAR-10 data set. Training using transformed images with higher luminance values increases the robustness of the classifier. We have shown that transfer learning is disadvantageous for adversarial machine learning. The results indicate that simple adversarial examples can improve resilience and make deep learning easier to apply in various applications.


title: Topological photonics by breaking the degeneracy of line node singularities in semimetal-like photonic crystals

abstract: Degeneracy is an omnipresent phenomenon in various physical systems, which has its roots in the preservation of geometrical symmetry. In electronic and photonic crystal systems, very often this degeneracy can be broken by virtue of strong interactions between photonic modes of the same energy, where the level repulsion and the hybridization between modes causes the emergence of photonic bandgaps. However, most often this phenomenon does not lead to a complete and inverted bandgap formation over the entire Brillouin zone. Here, by systematically breaking the symmetry of a two-dimensional square photonic crystal, we investigate the formation of Dirac points, line node singularities, and inverted bandgaps. The formation of this complete bandgap is due to the level repulsion between degenerate modes along the line nodes of a semimetal-like photonic crystal, over the entire Brillouin zone. Our numerical experimentations are performed by a home-build numerical framework based on a multigrid finite element method. The developed numerical toolbox and our observations pave the way towards designing complete bandgap photonic crystals and exploring the role of symmetry on the optical behaviour of even more complicated orders in photonic crystal systems.


title: How large should be the redundant numbers of copy to make a rare event probable

abstract: The redundancy principle provides the framework to study how rare events are made possible with probability 1 in accelerated time, by making many copies of similar random searchers. But what is $n$ large? To estimate large $n$ with respect to the geometrical properties of a domain and the dynamics, we present here a criteria based on splitting probabilities between a small fraction of the exploration space associated to an activation process and other absorbing regions where trajectories can be terminated. We obtain explicit computations especially when there is a killing region located inside the domain that we compare with stochastic simulations. We present also examples of extreme trajectories with killing in dimension 2. For a large $n$, the optimal trajectories avoid penetrating inside the killing region. Finally we discuss some applications to cell biology.


title: A SIQRB delayed model for cholera and optimal control treatment

abstract: We improve a recent mathematical model for cholera by adding a time delay that represents the time between the instant at which an individual becomes infected and the instant at which he begins to have symptoms of cholera disease. We prove that the delayed cholera model is biologically meaningful and analyze the local asymptotic stability of the equilibrium points for positive time delays. An optimal control problem is proposed and analyzed, where the goal is to obtain optimal treatment strategies, through quarantine, that minimize the number of infective individuals and the bacterial concentration, as well as treatment costs. Necessary optimality conditions are applied to the delayed optimal control problem, with a $L^1$ type cost functional. We show that the delayed cholera model fits better the cholera outbreak that occurred in the Department of Artibonite -- Haiti, from 1 November 2010 to 1 May 2011, than the non-delayed model. Considering the data of the cholera outbreak in Haiti, we solve numerically the delayed optimal control problem and propose solutions for the outbreak control and eradication.


title: Improving Data-driven Heterogeneous Treatment Effect Estimation Under Structure Uncertainty

abstract: Estimating how a treatment affects units individually, known as heterogeneous treatment effect (HTE) estimation, is an essential part of decision-making and policy implementation. The accumulation of large amounts of data in many domains, such as healthcare and e-commerce, has led to increased interest in developing data-driven algorithms for estimating heterogeneous effects from observational and experimental data. However, these methods often make strong assumptions about the observed features and ignore the underlying causal model structure, which can lead to biased HTE estimation. At the same time, accounting for the causal structure of real-world data is rarely trivial since the causal mechanisms that gave rise to the data are typically unknown. To address this problem, we develop a feature selection method that considers each feature's value for HTE estimation and learns the relevant parts of the causal structure from data. We provide strong empirical evidence that our method improves existing data-driven HTE estimation methods under arbitrary underlying causal structures. Our results on synthetic, semi-synthetic, and real-world datasets show that our feature selection algorithm leads to lower HTE estimation error.


title: ECG Classification based on Wasserstein Scalar Curvature

abstract: Electrocardiograms (ECG) analysis is one of the most important ways to diagnose heart disease. This paper proposes an efficient ECG classification method based on Wasserstein scalar curvature to comprehend the connection between heart disease and mathematical characteristics of ECG. The newly proposed method converts an ECG into a point cloud on the family of Gaussian distribution, where the pathological characteristics of ECG will be extracted by the Wasserstein geometric structure of the statistical manifold. Technically, this paper defines the histogram dispersion of Wasserstein scalar curvature, which can accurately describe the divergence between different heart diseases. By combining medical experience with mathematical ideas from geometry and data science, this paper provides a feasible algorithm for the new method, and the theoretical analysis of the algorithm is carried out. Digital experiments on the classical database with large samples show the new algorithm's accuracy and efficiency when dealing with the classification of heart disease.


title: Explicit kinematic equations for degree-4 rigid origami vertices, Euclidean and non-Euclidean

abstract: We derive new algebraic equations for the folding angle relationships in completely general degree-four rigid-foldable origami vertices, including both Euclidean (developable) and non-Euclidean cases. These equations in turn lead to novel, elegant equations for the general developable degree-four case. We compare our equations to previous results in the literature and provide two examples of how the equations can be used: In analyzing a family of square twist pouches with discrete configuration spaces, and for proving that a new folding table design made with hyperbolic vertices has a single folding mode.


title: Modelling the Spread of SARS-CoV2 and its variants. Comparison with Real Data. Relations that have to be Satisfied to Achieve the Total Regression of the SARS-CoV2 Infection

abstract: This work provides an overview on deterministic and stochastic models that have previously been proposed by us to study the transmission dynamics of the Coronavirus Disease 2019 (COVID-19) in Europe and USA. Briefly, we describe realistic deterministic and stochastic models for the evolution of the COVID-19 pandemic, subject to the lockdown and quarantine measures, which take into account the time-delay for recovery or death processes. Realistic dynamic equations for the entire process have been derived by adopting the so-called "kinetic-type reactions approach". The lockdown and the quarantine measures are modelled by some kind of inhibitor reactions where susceptible and infected individuals can be "trapped" into inactive states. The dynamics for the recovered people is obtained by accounting people who are only traced back to hospitalised infected people. To model the role of the Hospitals we take inspiration from the Michaelis-Menten's enzyme-substrate reaction model (the so-called "MM reaction") where the "enzyme" is associated to the "available hospital beds", the "substrate" to the "infected people", and the "product" to the "recovered people", respectively. The statistical properties of the models, in particular the relevant correlation functions and the probability density functions, have duly been evaluated. We validate our theoretical predictions with a large series of experimental data for Italy, Germany, France, Belgium and United States, and we also compare data for Italy and Belgium with the theoretical predictions of the logistic model. We found that our predictions are in good agreement with the real world since the onset of COVID 19, contrary to the the logistics model that only applies in the first days of the pandemic. In the final part of the work, we can find the (theoretical) relationships that should be satisfied to obtain the disappearance of the virus.


title: TEVR: Improving Speech Recognition by Token Entropy Variance Reduction

abstract: This paper presents TEVR, a speech recognition model designed to minimize the variation in token entropy w.r.t. to the language model. This takes advantage of the fact that if the language model will reliably and accurately predict a token anyway, then the acoustic model doesn't need to be accurate in recognizing it. We train German ASR models with 900 million parameters and show that on CommonVoice German, TEVR scores a very competitive 3.64% word error rate, which outperforms the best reported results by a relative 16.89% reduction in word error rate. We hope that releasing our fully trained speech recognition pipeline to the community will lead to privacy-preserving offline virtual assistants in the future.


title: RandStainNA: Learning Stain-Agnostic Features from Histology Slides by Bridging Stain Augmentation and Normalization

abstract: Stain variations often decrease the generalization ability of deep learning based approaches in digital histopathology analysis. Two separate proposals, namely stain normalization (SN) and stain augmentation (SA), have been spotlighted to reduce the generalization error, where the former alleviates the stain shift across different medical centers using template image and the latter enriches the accessible stain styles by the simulation of more stain variations. However, their applications are bounded by the selection of template images and the construction of unrealistic styles. To address the problems, we unify SN and SA with a novel RandStainNA scheme, which constrains variable stain styles in a practicable range to train a stain agnostic deep learning model. The RandStainNA is applicable to stain normalization in a collection of color spaces i.e. HED, HSV, LAB. Additionally, we propose a random color space selection scheme to gain extra performance improvement. We evaluate our method by two diagnostic tasks i.e. tissue subtype classification and nuclei segmentation, with various network backbones. The performance superiority over both SA and SN yields that the proposed RandStainNA can consistently improve the generalization ability, that our models can cope with more incoming clinical datasets with unpredicted stain styles. The codes is available at https://github.com/yiqings/RandStainNA.


title: Eigenvalue asymptotics for a class of multi-variable Hankel matrices

abstract: A one-variable Hankel matrix $H_a$ is an infinite matrix $H_a=[a(i+j)]_{i,j\geq0}$. Similarly, for any $d\geq2$, a $d$-variable Hankel matrix is defined as $H_{\mathbf{a}}=[\mathbf{a}(\mathbf{i}+\mathbf{j})]$, where $\mathbf{i}=(i_1,\dots,i_d)$ and $\mathbf{j}=(j_1,\dots,j_d)$, with $i_1,\dots,i_d,j_1,\dots,j_d\geq0$. For $\gamma>0$, A. Pushnitski and D. Yafaev proved that the eigenvalues of the compact one-variable Hankel matrices $H_a$ with $a(j)=j^{-1}(\log j)^{-\gamma}$, for $j\geq2$, obey the asymptotics $\lambda_n(H_a)\sim C_\gamma n^{-\gamma}$, as $n\to+\infty$, where the constant $C_\gamma$ is calculated explicitly. This paper presents the following $d$-variable analogue. Let $\gamma>0$ and $a(j)=j^{-d}(\log j)^{-\gamma}$, for $j\geq2$. If $\mathbf{a}(j_1,\dots,j_d)=a(j_1+\dots+j_d)$, then $H_{\mathbf{a}}$ is compact and its eigenvalues follow the asymptotics $\lambda_n(H_{\mathbf{a}})\sim C_{d,\gamma}n^{-\gamma}$, as $n\to+\infty$, where the constant $C_{d,\gamma}$ is calculated explicitly.


title: Travel time reliability in transportation networks: A review of methodological developments

abstract: The unavoidable travel time variability in transportation networks, resulted from the widespread supply side and demand side uncertainties, makes travel time reliability (TTR) be a common and core interest of all the stakeholders in transportation systems, including planners, travelers, service providers, and managers. This common and core interest stimulates extensive studies on modeling TTR. Researchers have developed a range of theories and models of TTR, many of which have been incorporated into transportation models, policies, and project appraisals. Adopting the network perspective, this paper aims to provide an integrated framework for reviewing the methodological developments of modeling TTR in transportation networks, including its characterization, evaluation and valuation, and traffic assignment. Specifically, the TTR characterization provides a whole picture of travel time distribution in transportation networks. TTR evaluation and TTR valuation (known as the value of reliability, VOR) simply and intuitively interpret abstract characterized TTR to be well understood by different stakeholders of transportation systems. TTR-based traffic assignment investigates the effects of TTR on the individual users travel behavior and consequently the collective network flow pattern. As the above three topics are mainly separately studied in different disciplines and research areas, the integrated framework allows us to better understand their relationships and may contribute to developing possible combinations of TTR modeling philosophy. Also, the network perspective enables to focus on common challenges of modeling TTR, especially the uncertainty propagation from the uncertainty sources to the TTR at spatial levels including link, route, and the entire network. Some directions for future research are discussed in the era of new data environment, applications, and emerging technologies.


title: Submillimeter-wave cornea phantom sensing over an extended depth of field with an axicon-generated Bessel beam

abstract: The feasibility of a 220 - 330 GHz zero order axicon generated Bessel beam for corneal water content was explored. Simulation and experimental data from the 25-degree cone angle hyperbolic-axicon lens illuminating metallic spherical targets demonstrate a monotonically decreasing, band integrated, backscatter intensity for increasing radius of curvature from 7 - 11 mm, when lens reflector and optical axis are aligned. Further, for radii >= 9.5 mm, maximum signal was obtained with a 1 mm transverse displacement between lens and reflector optical axes arising from spatial correlation between main lobe and out of phase side lobes. Thickness and permittivity parameter estimation experiments were performed on an 8 mm radius of curvature, 1 mm thick fused quartz dome over a 10 mm axial span. Extracted thickness and permittivity varied by less than ~ 25 $\mu$m and 0.2 respectively after correction for superluminal velocity. Estimated water permittivity and thickness of water backed gelatin phantoms showed significantly more variation due to a time varying radius of curvature.


title: Render unto Numerics: Orthogonal Polynomial Neural Operator for PDEs with Non-periodic Boundary Conditions

abstract: By learning the mappings between infinite function spaces using carefully designed neural networks, the operator learning methodology has exhibited significantly more efficiency than traditional methods in solving complex problems such as differential equations, but faces concerns about their accuracy and reliability. To overcomes these limitations, combined with the structures of the spectral numerical method, a general neural architecture named spectral operator learning (SOL) is introduced, and one variant called the orthogonal polynomial neural operator (OPNO), developed for PDEs with Dirichlet, Neumann and Robin boundary conditions (BCs), is proposed later. The strict BC satisfaction properties and the universal approximation capacity of the OPNO are theoretically proven. A variety of numerical experiments with physical backgrounds show that the OPNO outperforms other existing deep learning methodologies, as well as the traditional 2nd-order finite difference method (FDM) with a considerably fine mesh (with the relative errors reaching the order of 1e-6), and is up to almost 5 magnitudes faster than the traditional method.


title: Constraining MOdified Gravity with the S2 Star

abstract: We have used publicly available kinematic data for the S2 star to constrain the parameter space of MOdified Gravity. Integrating geodesics and using a Markov Chain Monte Carlo algorithm we have provided with the first constraint on the scales of the Galactic Centre for the parameter $\alpha$ of the theory, which represents the fractional increment of the gravitational constant $G$ with respect to its Newtonian value. Namely, $\alpha \lesssim 0.662$ at 99.7% confidence level (where $\alpha = 0$ reduces the theory to General Relativity).


title: Towards Modern Card Games with Large-Scale Action Spaces Through Action Representation

abstract: Axie infinity is a complicated card game with a huge-scale action space. This makes it difficult to solve this challenge using generic Reinforcement Learning (RL) algorithms. We propose a hybrid RL framework to learn action representations and game strategies. To avoid evaluating every action in the large feasible action set, our method evaluates actions in a fixed-size set which is determined using action representations. We compare the performance of our method with the other two baseline methods in terms of their sample efficiency and the winning rates of the trained models. We empirically show that our method achieves an overall best winning rate and the best sample efficiency among the three methods.


title: The Bandwagon Effect: Not Just Another Bias

abstract: Optimizing recommender systems based on user interaction data is mainly seen as a problem of dealing with selection bias, where most existing work assumes that interactions from different users are independent. However, it has been shown that in reality user feedback is often influenced by earlier interactions of other users, e.g. via average ratings, number of views or sales per item, etc. This phenomenon is known as the bandwagon effect. In contrast with previous literature, we argue that the bandwagon effect should not be seen as a problem of statistical bias. In fact, we prove that this effect leaves both individual interactions and their sample mean unbiased. Nevertheless, we show that it can make estimators inconsistent, introducing a distinct set of problems for convergence in relevance estimation. Our theoretical analysis investigates the conditions under which the bandwagon effect poses a consistency problem and explores several approaches for mitigating these issues. This work aims to show that the bandwagon effect poses an underinvestigated open problem that is fundamentally distinct from the well-studied selection bias in recommendation.


title: Sequential Reattempt of Telecloning

abstract: The task of a telecloning protocol is to send an arbitrary qubit possessed by a sender to multiple receivers. Instead of performing Bell measurement at the sender's node, if one applies unsharp measurement, we show that the shared state can be recycled for further telecloning protocol. Specifically, in case of a single sender and two receivers, the maximal attempting number, which is defined as the maximum number of rounds used by the channel to obtain quantum advantage in the fidelity, turns out to be three both for optimal and nonoptimal shared states for telecloning while the maximal number reduces to two in case of three receivers. Although the original telecloning with quantum advantage being possible for arbitrary numbers of receivers, we report that the recycling of resources is not possible in telecloning involving a single sender and more than three receivers, thereby demonstrating a no-go theorem. We also connect the maximal achievable fidelities in each round with the bipartite entanglement content of the reduced state between the sender and one of the receivers as well as with the monogamy score of entanglement.


title: Static and dynamic magnetization control of extrinsic multiferroics by the converse magneto-photostrictive effect

abstract: In this work, photostrictive manipulations of static and dynamic magnetic properties are demonstrated in an extrinsic multiferroic composite. The photostriction is achieved with visible light in the blue region of the spectrum. The composites consist of 5 nm or 10 nm magnetostrictive Fe$_{81}$Ga$_{19}$ thin films coupled to a piezoelectric (011)-Pb(Mg$_{1/3}$Nb$_{2/3}$)O$_3$-Pb(Zr,Ti)O$_3$ substrate. Angular dependent magnetization reversals properties are largely enhanced or reduced under a converse magneto-photostrictive effect (CMPE). The CMPE strength is analysed with a novel coefficient named the converse magneto-photostrictive coupling coefficient. This coefficient is proposed as a general approach to analyse and to compare different extrinsic multiferroics under the converse magneto-photostrictive effect. Its thickness dependence reveals that the CMPE strength decreases with an increase of the Fe$_{81}$Ga$_{19}$ thickness. Experimental evidence for a control of dynamic magnetic properties under CMPE is then revealed by ferromagnetic resonance measurements. Resonant fields are shifted under CMPE, whereas their linewidths remain constant. Furthermore, resonant field shifts can be either positive or negative depending on the in-plane angle. The largest shift under CMPE of +5.7 % is obtained for the 5 nm sample. Our study shows that the CMPE provides an efficient approach for a control of not only the static but also the dynamic magnetic properties in extrinsic multiferroics.


title: Anatomy-Guided Weakly-Supervised Abnormality Localization in Chest X-rays

abstract: Creating a large-scale dataset of abnormality annotation on medical images is a labor-intensive and costly task. Leveraging weak supervision from readily available data such as radiology reports can compensate lack of large-scale data for anomaly detection methods. However, most of the current methods only use image-level pathological observations, failing to utilize the relevant anatomy mentions in reports. Furthermore, Natural Language Processing (NLP)-mined weak labels are noisy due to label sparsity and linguistic ambiguity. We propose an Anatomy-Guided chest X-ray Network (AGXNet) to address these issues of weak annotation. Our framework consists of a cascade of two networks, one responsible for identifying anatomical abnormalities and the second responsible for pathological observations. The critical component in our framework is an anatomy-guided attention module that aids the downstream observation network in focusing on the relevant anatomical regions generated by the anatomy network. We use Positive Unlabeled (PU) learning to account for the fact that lack of mention does not necessarily mean a negative label. Our quantitative and qualitative results on the MIMIC-CXR dataset demonstrate the effectiveness of AGXNet in disease and anatomical abnormality localization. Experiments on the NIH Chest X-ray dataset show that the learned feature representations are transferable and can achieve the state-of-the-art performances in disease classification and competitive disease localization results. Our code is available at https://github.com/batmanlab/AGXNet


title: p-Meta: Towards On-device Deep Model Adaptation

abstract: Data collected by IoT devices are often private and have a large diversity across users. Therefore, learning requires pre-training a model with available representative data samples, deploying the pre-trained model on IoT devices, and adapting the deployed model on the device with local data. Such an on-device adaption for deep learning empowered applications demands data and memory efficiency. However, existing gradient-based meta learning schemes fail to support memory-efficient adaptation. To this end, we propose p-Meta, a new meta learning method that enforces structure-wise partial parameter updates while ensuring fast generalization to unseen tasks. Evaluations on few-shot image classification and reinforcement learning tasks show that p-Meta not only improves the accuracy but also substantially reduces the peak dynamic memory by a factor of 2.5 on average compared to state-of-the-art few-shot adaptation methods.


title: Binary and Multinomial Classification through Evolutionary Symbolic Regression

abstract: We present three evolutionary symbolic regression-based classification algorithms for binary and multinomial datasets: GPLearnClf, CartesianClf, and ClaSyCo. Tested over 162 datasets and compared to three state-of-the-art machine learning algorithms -- XGBoost, LightGBM, and a deep neural network -- we find our algorithms to be competitive. Further, we demonstrate how to find the best method for one's dataset automatically, through the use of a state-of-the-art hyperparameter optimizer.