title: Low-frequency monitoring of flare star binary CR Draconis: Long-term electron-cyclotron maser emission

abstract: Recently detected coherent low-frequency radio emission from M dwarf systems shares phenomenological similarities with emission produced by magnetospheric processes from the gas giant planets of our Solar System. Such beamed electron-cyclotron maser emission can be driven by a star-planet interaction or a breakdown in co-rotation between a rotating plasma disk and a stellar magnetosphere. Both models suggest that the radio emission could be periodic. Here we present the longest low-frequency interferometric monitoring campaign of an M dwarf system, composed of twenty-one $\approx$8 hour epochs taken in two series of observing blocks separated by a year. We achieved a total on-source time of 6.5 days. We show that the M dwarf binary CR Draconis has a low-frequency 3$\sigma$ detection rate of 90$^{+5}_{-8}$% when a noise floor of $\approx$0.1 mJy is reached, with a median flux density of 0.92 mJy, consistent circularly polarised handedness, and a median circularly polarised fraction of 66%. We resolve three bright radio bursts in dynamic spectra, revealing the brightest is elliptically polarised, confined to 4 MHz of bandwidth centred on 170 MHz, and reaches a flux density of 205 mJy. The burst structure is mottled, indicating it consists of unresolved sub-bursts. Such a structure shares a striking resemblance with the low-frequency emission from Jupiter. We suggest the near-constant detection of high brightness temperature, highly-circularly-polarised radiation that has a consistent circular polarisation handedness implies the emission is produced via the electron-cyclotron maser instability. Optical photometric data reveal the system has a rotation period of 1.984$\pm$0.003 days. We observe no periodicity in the radio data, but the sampling of our radio observations produces a window function that would hide the near two-day signal.


title: Altered Local Uniformization Of Rigid-Analytic Spaces

abstract: We prove a version of Temkin's local altered uniformization theorem. We show that for any rig-smooth, quasi-compact and quasi-separated admissible formal $\mathcal{O}_K$-model $\mathfrak{X}$, there is a finite extension $K'/K$ such that $\mathfrak{X}_{\mathcal{O}_{K'}}$ locally admits a rig-\'etale morphism $g\colon \mathfrak{X}' \to \mathfrak{X}_{\mathcal{O}_{K'}}$ and a rig-isomorphism $h\colon \mathfrak{X}" \to \mathfrak{X}'$ with $\mathfrak{X}'$ being a successive semi-stable curve fibration over $\mathcal{O}_{K'}$ and $\mathfrak{X}"$ being a poly-stable formal $\mathcal{O}_{K'}$-scheme. Moreover, $\mathfrak{X}'$ admits an action of a finite group $G$ such that $g\colon \mathfrak{X}' \to \mathfrak{X}_{\mathcal{O}_{K'}}$ is $G$-invariant, and the adic generic fiber $\mathfrak{X}'_{K'}$ becomes a $G$-torsor over its quasi-compact open image $U=g_{K'}(\mathfrak{X}'_{K'})$. Also, we study properties of the quotient map $\mathfrak{X}'/G \to \mathfrak{X}_{\mathcal{O}_{K'}}$ and show that it can be obtained as a composition of open immersions and rig-isomorphisms.


title: Private life of the Liouville field that causes new anomalies in the Nambu-Goto string

abstract: I consider higher-order terms of the Seeley expansion of the heat kernel, which for smooth metrics are suppressed as inverse powers of the UV cutoff $\Lambda$, and demonstrate how they result in an anomalous contribution to the string effective action after doing uncertainties $\Lambda^{-2}\times \Lambda^2$. For the Polyakov string these anomalies precisely reproduce at one loop the result of KPZ-DDK obtained for the Liouville theory by the conformal field theory technique. For the Nambu-Goto string I find a deviation from this result which shows that the two string formulations may differ.


title: Bayesian Transformer Language Models for Speech Recognition

abstract: State-of-the-art neural language models (LMs) represented by Transformers are highly complex. Their use of fixed, deterministic parameter estimates fail to account for model uncertainty and lead to over-fitting and poor generalization when given limited training data. In order to address these issues, this paper proposes a full Bayesian learning framework for Transformer LM estimation. Efficient variational inference based approaches are used to estimate the latent parameter posterior distributions associated with different parts of the Transformer model architecture including multi-head self-attention, feed forward and embedding layers. Statistically significant word error rate (WER) reductions up to 0.5\% absolute (3.18\% relative) and consistent perplexity gains were obtained over the baseline Transformer LMs on state-of-the-art Switchboard corpus trained LF-MMI factored TDNN systems with i-Vector speaker adaptation. Performance improvements were also obtained on a cross domain LM adaptation task requiring porting a Transformer LM trained on the Switchboard and Fisher data to a low-resource DementiaBank elderly speech corpus.


title: Enhancing nonclassical bosonic correlations in a Quantum Walk network through experimental control of disorder

abstract: The presence of disorder and inhomogeneities in quantum networks has often been unexpectedly beneficial for both quantum and classical resources. Here, we experimentally realize a controllable inhomogenous Quantum Walk dynamics, which can be exploited to investigate the effect of coherent disorder on the quantum correlations between two indistinguishable photons. Through the imposition of suitable disorder configurations, we observe two photon states which exhibit an enhancement in the quantum correlations between two modes of the network, compared to the case of an ordered Quantum Walk. Different configurations of disorder can steer the system towards different realizations of such an enhancement, thus allowing spatial and temporal manipulation of quantum correlations.


title: Calculating DMFT forces in ab-initio ultrasoft pseudopotential formalism

abstract: In this paper, we show how to calculate analytical atomic forces within self-consistent density functional theory + dynamical mean-field theory (DFT+DMFT) approach in the case when ultra-soft or norm-conserving pseudopotentials are used. We show how to treat the non-local projection terms arising within the pseudopotential formalism and circumvent the problem of non-orthogonality of the Kohn-Sham eigenvectors. Our approach is, in principle, independent of the DMFT solver employed, and here was tested with the Hubbard I solver. We benchmark our formalism by comparing against the forces calculated in Ce$_{2}$O$_{3}$ and PrO$_2$ by numerical differentiation of the total free energy, as well as by comparing the energy profiles against the numerically integrated analytical forces.


title: Black-box model risk in finance

abstract: Machine learning models are increasingly used in a wide variety of financial settings. The difficulty of understanding the inner workings of these systems, combined with their wide applicability, has the potential to lead to significant new risks for users; these risks need to be understood and quantified. In this sub-chapter, we will focus on a well studied application of machine learning techniques, to pricing and hedging of financial options. Our aim will be to highlight the various sources of risk that the introduction of machine learning emphasises or de-emphasises, and the possible risk mitigation and management strategies that are available.


title: Lowest-cost virus suppression

abstract: Analysis of policies for managing epidemics require simultaneously an economic and epidemiological perspective. We adopt a cost-of-policy framework to model both the virus spread and the cost of handling the pandemic. Because it is harder and more costly to fight the pandemic when the circulation is higher, we find that the optimal policy is to go to zero or near-zero case numbers. Without imported cases, if a region is willing to implement measures to prevent spread at one level in number of cases, it must also be willing to prevent the spread with at a lower level, since it will be cheaper to do so and has only positive other effects. With imported cases, if a region is not coordinating with other regions, we show the cheapest policy is continually low but nonzero cases due to decreasing cost of halting imported cases. When it is coordinating, zero is cost-optimal. Our analysis indicates that within Europe cooperation targeting a reduction of both within country transmission, and between country importation risk, should help achieve lower transmission and reduced costs.


title: CoBiToM Project -- I. Contact Binaries Towards Merging

abstract: Binary and multiple stellar systems are numerous in our solar neighborhood with 80 per cent of the solar-type stars being members of systems with high order multiplicity. The Contact Binaries Towards Merging (CoBiToM) Project is a programme that focuses on contact binaries and multiple stellar systems, as a key for understanding stellar nature. The goal is to investigate stellar coalescence and merging processes, as the final state of stellar evolution of low-mass contact binary systems. Obtaining observational data of approximately 100 eclipsing binaries and multiple systems and more than 400 archival systems, the programme aspires to give insights for their physical and orbital parameters and their temporal variations, e.g. the orbital period modulation, spot activity etc. Gravitational phenomena in multiple-star environments will be linked with stellar evolution. A comprehensive analysis will be conducted, in order to investigate the possibility of contact binaries to host planets, as well as the link between inflated hot Jupiters and stellar mergers. The innovation of CoBiToM Project is based on a multi-method approach and a detailed investigation, that will shed light for the first time on the origin of stellar mergers and rapidly rotating stars. In this work we describe the scientific rationale, the observing facilities to be used and the methods that will be followed to achieve the goals of CoBiToM Project and we present the first results as an example of the current research on evolution of contact binary systems.


title: Improving Scene Graph Classification by Exploiting Knowledge from Texts

abstract: Training scene graph classification models requires a large amount of annotated image data. Meanwhile, scene graphs represent relational knowledge that can be modeled with symbolic data from texts or knowledge graphs. While image annotation demands extensive labor, collecting textual descriptions of natural scenes requires less effort. In this work, we investigate whether textual scene descriptions can substitute for annotated image data. To this end, we employ a scene graph classification framework that is trained not only from annotated images but also from symbolic data. In our architecture, the symbolic entities are first mapped to their correspondent image-grounded representations and then fed into the relational reasoning pipeline. Even though a structured form of knowledge, such as the form in knowledge graphs, is not always available, we can generate it from unstructured texts using a transformer-based language model. We show that by fine-tuning the classification pipeline with the extracted knowledge from texts, we can achieve ~8x more accurate results in scene graph classification, ~3x in object classification, and ~1.5x in predicate classification, compared to the supervised baselines with only 1% of the annotated images.


title: Quasi-Global Momentum: Accelerating Decentralized Deep Learning on Heterogeneous Data

abstract: Decentralized training of deep learning models is a key element for enabling data privacy and on-device learning over networks. In realistic learning scenarios, the presence of heterogeneity across different clients' local datasets poses an optimization challenge and may severely deteriorate the generalization performance. In this paper, we investigate and identify the limitation of several decentralized optimization algorithms for different degrees of data heterogeneity. We propose a novel momentum-based method to mitigate this decentralized training difficulty. We show in extensive empirical experiments on various CV/NLP datasets (CIFAR-10, ImageNet, and AG News) and several network topologies (Ring and Social Network) that our method is much more robust to the heterogeneity of clients' data than other existing methods, by a significant improvement in test performance ($1\% \!-\! 20\%$). Our code is publicly available.


title: Referring Segmentation in Images and Videos with Cross-Modal Self-Attention Network

abstract: We consider the problem of referring segmentation in images and videos with natural language. Given an input image (or video) and a referring expression, the goal is to segment the entity referred by the expression in the image or video. In this paper, we propose a cross-modal self-attention (CMSA) module to utilize fine details of individual words and the input image or video, which effectively captures the long-range dependencies between linguistic and visual features. Our model can adaptively focus on informative words in the referring expression and important regions in the visual input. We further propose a gated multi-level fusion (GMLF) module to selectively integrate self-attentive cross-modal features corresponding to different levels of visual features. This module controls the feature fusion of information flow of features at different levels with high-level and low-level semantic information related to different attentive words. Besides, we introduce cross-frame self-attention (CFSA) module to effectively integrate temporal information in consecutive frames which extends our method in the case of referring segmentation in videos. Experiments on benchmark datasets of four referring image datasets and two actor and action video segmentation datasets consistently demonstrate that our proposed approach outperforms existing state-of-the-art methods.


title: $k$-Anonymity in Practice: How Generalisation and Suppression Affect Machine Learning Classifiers

abstract: The protection of private information is a crucial issue in data-driven research and business contexts. Typically, techniques like anonymisation or (selective) deletion are introduced in order to allow data sharing, e. g. in the case of collaborative research endeavours. For use with anonymisation techniques, the $k$-anonymity criterion is one of the most popular, with numerous scientific publications on different algorithms and metrics. Anonymisation techniques often require changing the data and thus necessarily affect the results of machine learning models trained on the underlying data. In this work, we conduct a systematic comparison and detailed investigation into the effects of different $k$-anonymisation algorithms on the results of machine learning models. We investigate a set of popular $k$-anonymisation algorithms with different classifiers and evaluate them on different real-world datasets. Our systematic evaluation shows that with an increasingly strong $k$-anonymity constraint, the classification performance generally degrades, but to varying degrees and strongly depending on the dataset and anonymisation method. Furthermore, Mondrian can be considered as the method with the most appealing properties for subsequent classification.


title: Continuous-Time Model-Based Reinforcement Learning

abstract: Model-based reinforcement learning (MBRL) approaches rely on discrete-time state transition models whereas physical systems and the vast majority of control tasks operate in continuous-time. To avoid time-discretization approximation of the underlying process, we propose a continuous-time MBRL framework based on a novel actor-critic method. Our approach also infers the unknown state evolution differentials with Bayesian neural ordinary differential equations (ODE) to account for epistemic uncertainty. We implement and test our method on a new ODE-RL suite that explicitly solves continuous-time control systems. Our experiments illustrate that the model is robust against irregular and noisy data, is sample-efficient, and can solve control problems which pose challenges to discrete-time MBRL methods.


title: Lower Bounds on the Integraliy Ratio of the Subtour LP for the Traveling Salesman Problem

abstract: In this paper we investigate instances with high integrality ratio of the subtour LP. We develop a procedure to generate families of Euclidean TSP instances whose integrality ratios converge to $\frac{4}{3}$ and may have a different structure than the instances currently known from the literature. Moreover, we compute the instances maximizing the integrality ratio for Rectilinear TSP with up to 10 vertices. Based on these instances we give families of instances whose integrality ratio converge to $\frac{4}{3}$ for Rectilinear, Multidimensional Rectilinear and Euclidean TSP that have similar structures. We show that our instances for Multidimensional Rectilinear TSP and the known instances for Metric TSP maximize the integrality ratio under certain assumptions. We also investigate the concept of local optimality with respect to integrality ratio and develop several algorithms to find instances with high integrality ratio. Furthermore, we describe a family of instances that are hard to solve in practice. The currently fastest TSP solver Concorde needs more than two days to solve an instance from the family with 52 vertices.


title: Substitutional effects in TiFe for hydrogen storage: a comprehensive review

abstract: The search for suitable materials for solid-state stationary storage of green hydrogen is pushing the implementation of efficient renewable energy systems. This involves rational design and modification of cheap alloys for effective storage in mild conditions of temperature and pressure. Among many intermetallic compounds described in the literature, TiFe-based systems have recently regained vivid interest as materials for practical applications since they are low-cost and they can be tuned to match required pressure and operation conditions. This work aims to provide a comprehensive review of publications involving chemical substitution in TiFe-based compounds for guiding compound design and materials selection in current and future hydrogen storage applications. Mono- and multi-substituted compounds modify TiFe thermodynamics and are beneficial for many hydrogenation properties. They will be reviewed and deeply discussed, with a focus on manganese substitution.


title: A new geometric condition equivalent to the maximum angle condition for tetrahedrons

abstract: For a tetrahedron, suppose that all internal angles of faces and all dihedral angles are less than a fixed constant $C$ that is smaller than $\pi$. Then, it is said to satisfy the maximum angle condition with the constant $C$. The maximum angle condition is important in the error analysis of Lagrange interpolation on tetrahedrons. This condition ensures that we can obtain an error estimation, even on certain kinds of anisotropic tetrahedrons. In this paper, using two quantities that represent the geometry of tetrahedrons, we present an equivalent geometric condition to the maximum angle condition for tetrahedrons.


title: Supersymmetric quantum field theory with exotic symmetry in 3+1 dimensions and fermionic fracton phases

abstract: We propose a supersymmetric quantum field theory with exotic symmetry related to fracton phases. We use superfield formalism and write down the action of a supersymmetric version of the $\varphi$ theory in 3+1 dimensions. It contains a large number of ground states due to the fermionic higher pole subsystem symmetry. Its residual entropy is proportional to the area instead of the volume. This theory has a self-duality similar to that of the $\varphi$ theory. We also write down the action of a supersymmetric version of a tensor gauge theory, and discuss BPS fractons.


title: Constant Approximating k-Clique is W[1]-hard

abstract: For every graph $G$, let $\omega(G)$ be the largest size of complete subgraph in $G$. This paper presents a simple algorithm which, on input a graph $G$, a positive integer $k$ and a small constant $\epsilon>0$, outputs a graph $G'$ and an integer $k'$ in $2^{\Theta(k^5)}\cdot |G|^{O(1)}$-time such that (1) $k'\le 2^{\Theta(k^5)}$, (2) if $\omega(G)\ge k$, then $\omega(G')\ge k'$, (3) if $\omega(G)<k$, then $\omega(G')< (1-\epsilon)k'$. This implies that no $f(k)\cdot |G|^{O(1)}$-time algorithm can distinguish between the cases $\omega(G)\ge k$ and $\omega(G)<k/c$ for any constant $c\ge 1$ and computable function $f$, unless $FPT= W[1]$.


title: COLOGNE: Coordinated Local Graph Neighborhood Sampling

abstract: Representation learning for graphs enables the application of standard machine learning algorithms and data analysis tools to graph data. Replacing discrete unordered objects such as graph nodes by real-valued vectors is at the heart of many approaches to learning from graph data. Such vector representations, or embeddings, capture the discrete relationships in the original data by representing nodes as vectors in a high-dimensional space. In most applications graphs model the relationship between real-life objects and often nodes contain valuable meta-information about the original objects. While being a powerful machine learning tool, embeddings are not able to preserve such node attributes. We address this shortcoming and consider the problem of learning discrete node embeddings such that the coordinates of the node vector representations are graph nodes. This opens the door to designing interpretable machine learning algorithms for graphs as all attributes originally present in the nodes are preserved. We present a framework for coordinated local graph neighborhood sampling (COLOGNE) such that each node is represented by a fixed number of graph nodes, together with their attributes. Individual samples are coordinated and they preserve the similarity between node neighborhoods. We consider different notions of similarity for which we design scalable algorithms. We show theoretical results for all proposed algorithms. Experiments on benchmark graphs evaluate the quality of the designed embeddings and demonstrate how the proposed embeddings can be used in training interpretable machine learning algorithms for graph data.


title: Forecasting the Evolution of Hydrogen Vehicle Fleet in the UK usingGrowth and Lotka-Volterra Models

abstract: Road vehicles play an important role in the UK's energy systems and are a critical component in reducing the reliance on fossil fuels and mitigating emissions. A dynamic model of vehicle fleet, based on predator-prey concepts, is presented. It allows to predict the evolution of the hydrogen based vehicle's role in the UK's vehicle fleet and the sensitivity of this growth to the supply chain. In addition to this, this model is used to predict the demand of hydrogen for the passenger vehicle fleet for various scenarios. A key result is that the amount of hydrogen required to support a huge network of hydrogen based vehicles is currently not practical, regarding the infrastructure required and the cost to build such an infrastructure. In order to mitigate that, the policy focus should move primarily from hydrogen based vehicles to first encompass range extenders in the transport energy system.


title: The curse of clouds

abstract: In recent years, a vast increase in spectroscopic observations of transiting exoplanets has for the first time allowed us to search for broad trends in their atmospheric properties. Analysis of these observations has revealed that, even for the highly irradiated hot Jupiters, aerosol is a common presence and must be accounted for in modelling efforts. An additional challenge for hot Jupiters is the large variation in temperature across the planet, which is likely to result in partial or patchy cloud cover. As our observational capability is due to increase further with the launch of the James Webb Space Telescope, anticipated in autumn 2021, community efforts are underway to prepare modelling and analysis tools capable of recovering information about variable and patchy cloud coverage on hot exoplanets


title: Potential origin of the state-dependent high-energy tail in the black hole microquasar Cygnus X-1 as seen with INTEGRAL

abstract: 0.1-10 MeV observations of the black hole microquasar Cygnus X-1 have shown the presence of a spectral feature in the form of a power law in addition to the standard black body and Comptonization components observed by INTEGRAL. This so-called "high-energy tail" has recently been shown to be strong in its hard spectral state and interpreted as high-energy part of the emission from a compact jet. This result was, however, obtained from a data set dominated by hard state observations. In the soft state, only upper limits on the presence and hence the potential parameters of a high-energy tail could be derived. Using an extended data set we aim at obtaining better constraints on the properties of this spectral component in both states. We make use of data obtained from 15 years of observations with the INTEGRAL satellite. The data set is separated into the different states and we analyse stacked state-resolved spectra obtained from the X-ray monitors, the gamma-ray imager, and the gamma-ray spectrometer onboard. A high-energy component is detected in both states confirming its earlier detection in the hard state and its suspected presence in the soft state with INTEGRAL. We first characterize the high-energy tail components in the two states through a model-independent, phenomenological analysis. We then apply physical models based on hybrid Comptonization. The spectra are well modeled in all cases, with a similar goodness of the fits. While in the phenomenological approach the high-enery tail has similar indices in both states, the fits with the physical models seem to indicate different properties. We discuss the potential origins of the high-energy components in both states, and favor an interpretation where the part of the high-energy component is due to a compact jet in the hard state and hybrid Comptonization in either a magnetised or non-magnetised corona in the soft state.


title: Two-component nonlinear wave of the Hirota equation

abstract: Using the generalized perturbation reduction method the Hirota equation is transformed to the coupled nonlinear Schr\"odinger equations for auxiliary functions. A solution in the form of a two-component vector nonlinear pulse is obtained. The components of the pulse oscillate with the sum and difference of the frequencies and the wave numbers. Explicit analytical expressions for the shape and parameters of the two-component nonlinear pulse are presented.


title: Structured Diversification Emergence via Reinforced Organization Control and Hierarchical Consensus Learning

abstract: When solving a complex task, humans will spontaneously form teams and to complete different parts of the whole task, respectively. Meanwhile, the cooperation between teammates will improve efficiency. However, for current cooperative MARL methods, the cooperation team is constructed through either heuristics or end-to-end blackbox optimization. In order to improve the efficiency of cooperation and exploration, we propose a structured diversification emergence MARL framework named {\sc{Rochico}} based on reinforced organization control and hierarchical consensus learning. {\sc{Rochico}} first learns an adaptive grouping policy through the organization control module, which is established by independent multi-agent reinforcement learning. Further, the hierarchical consensus module based on the hierarchical intentions with consensus constraint is introduced after team formation. Simultaneously, utilizing the hierarchical consensus module and a self-supervised intrinsic reward enhanced decision module, the proposed cooperative MARL algorithm {\sc{Rochico}} can output the final diversified multi-agent cooperative policy. All three modules are organically combined to promote the structured diversification emergence. Comparative experiments on four large-scale cooperation tasks show that {\sc{Rochico}} is significantly better than the current SOTA algorithms in terms of exploration efficiency and cooperation strength.


title: Generative Models as Distributions of Functions

abstract: Generative models are typically trained on grid-like data such as images. As a result, the size of these models usually scales directly with the underlying grid resolution. In this paper, we abandon discretized grids and instead parameterize individual data points by continuous functions. We then build generative models by learning distributions over such functions. By treating data points as functions, we can abstract away from the specific type of data we train on and construct models that are agnostic to discretization. To train our model, we use an adversarial approach with a discriminator that acts on continuous signals. Through experiments on a wide variety of data modalities including images, 3D shapes and climate data, we demonstrate that our model can learn rich distributions of functions independently of data type and resolution.


title: A Lagrangian perspective on nonautonomous advection-diffusion processes in the low-diffusivity limit

abstract: We study mass preserving transport of passive tracers in the low-diffusivity limit using Lagrangian coordinates. Over finite-time intervals, the solution-operator of the nonautonomous diffusion equation is approximated by that of a time-averaged diffusion equation. We show that leading order asymptotics that hold for functions [Krol, 1991] extend to the dominant nontrivial singular value. This answers questions raised in [Karrasch & Keller, 2020]. The generator of the time-averaged diffusion/heat semigroup is a Laplace operator associated to a weighted manifold structure on the material manifold. We show how geometrical properties of this weighted manifold directly lead to physical transport quantities of the nonautonomous equation in the low-diffusivity limit.

categories: math.AP math-ph math.DG math.DS math.MP math.SP


title: Exploring high-frequency eddy-current testing for sub-aperture defect characterisation using parametric-manifold mapping

abstract: Accurate characterisation of small defects remains a challenge in non-destructive testing (NDT). In this paper, a principle-component parametric-manifold mapping approach is applied to single-frequency eddy-current defect characterisation problems for surface breaking defects in a planar half-space. A broad 1-8 MHz frequency-range FE-circuit model & calibration approach is developed & validated to simulate eddy-current scans of surface-breaking notch defects. This model is used to generate parametric defect databases for surface breaking defects in an aluminium planar half-space and defect characterisation of experimental measurements performed. Parametric-manifold mapping was conducted in N-dimensional principle component space, reducing the dimensionality of the characterisation problem. In a study characterising slot depth, the model & characterisation approach is shown to accurately invert the depth with greater accuracy than a simple amplitude inversion method with normalised percentage characterisation errors of 38% and 17% respectively measured at 2.0 MHz across 5 slot depths between 0.26 - 2.15 mm. The approach is used to characterise the depth of a sloped slot demonstrating good accuracy up to ~2.0 mm in depth over a broad range of sub-resonance frequencies, indicating applications in geometric feature inversion. Finally the technique is applied to finite rectangular notch defects of surface extents smaller than the diameter of the inspection coil (sub-aperture) over a range of frequencies. The results highlight the limitations in characterising these defects and indicate how the inherent instabilities in resonance can severely limit characterisation at these frequencies.


title: Towards photoassociation processes of ultracold rubidium trimers

abstract: We theoretically investigate the prospects for photoassociation (PA) of Rb$_3$, in particular at close range. We provide an overview of accessible states and possible transitions. The major focus is placed on the calculation of equilibrium structures, the survey of spin-orbit effects and the investigation of transition dipole moments. Furthermore we discuss Franck-Condon overlaps and special aspects of trimers including the (pseudo) Jahn-Teller effect and the resulting topology of adiabatic potential-energy surfaces. With this we identify concrete and suitable PA transitions to potentially produce long-lived trimer bound states. Calculations are performed using the multireference configuration-interaction method together with a large-core effective core potential and a core-polarization potential with a large uncontracted even-tempered basis set.


title: Diverse Single Image Generation with Controllable Global Structure

abstract: Image generation from a single image using generative adversarial networks is quite interesting due to the realism of generated images. However, recent approaches need improvement for such realistic and diverse image generation, when the global context of the image is important such as in face, animal, and architectural image generation. This is mainly due to the use of fewer convolutional layers for mainly capturing the patch statistics and, thereby, not being able to capture global statistics very well. We solve this problem by using attention blocks at selected scales and feeding a random Gaussian blurred image to the discriminator for training. Our results are visually better than the state-of-the-art particularly in generating images that require global context. The diversity of our image generation, measured using the average standard deviation of pixels, is also better.


title: Fast discovery of multidimensional subsequences for robust trajectory classification

abstract: Trajectory classification tasks became more complex as large volumes of mobility data are being generated every day and enriched with new sources of information, such as social networks and IoT sensors. Fast classification algorithms are essential for discovering knowledge in trajectory data for real applications. In this work we propose a method for fast discovery of subtrajectories with the reduction of the search space and the optimization of the MASTERMovelets method, which has proven to be effective for discovering interpretable patterns in classification problems.


title: Distribution Adaptive INT8 Quantization for Training CNNs

abstract: Researches have demonstrated that low bit-width (e.g., INT8) quantization can be employed to accelerate the inference process. It makes the gradient quantization very promising since the backward propagation requires approximately twice more computation than forward one. Due to the variability and uncertainty of gradient distribution, a lot of methods have been proposed to attain training stability. However, most of them ignore the channel-wise gradient distributions and the impact of gradients with different magnitudes, resulting in the degradation of final accuracy. In this paper, we propose a novel INT8 quantization training framework for convolutional neural network to address the above issues. Specifically, we adopt Gradient Vectorized Quantization to quantize the gradient, based on the observation that layer-wise gradients contain multiple distributions along the channel dimension. Then, Magnitude-aware Clipping Strategy is introduced by taking the magnitudes of gradients into consideration when minimizing the quantization error, and we present a theoretical derivation to solve the quantization parameters of different distributions. Experimental results on broad range of computer vision tasks, such as image classification, object detection and video classification, demonstrate that the proposed Distribution Adaptive INT8 Quantization training method has achieved almost lossless training accuracy for different backbones, including ResNet, MobileNetV2, InceptionV3, VGG and AlexNet, which is superior to the state-of-the-art techniques. Moreover, we further implement the INT8 kernel that can accelerate the training iteration more than 200% under the latest Turing architecture, i.e., our method excels on both training accuracy and speed.


title: The role of heat generation and fluid flow in plasmon-enhanced reduction-oxidation reactions

abstract: Recently, we have shown that thermal effects play a crucial role in speeding up the rate of bond-dissociation reactions. This was done by applying a simple temperature-shifted Arrhenius Law to the experimental data, corroborated with detailed account of the heat diffusion occurring within the relevant samples and identification of errors in the temperature measurements. Here, we provide three important extensions of our previous studies. First, we analyze thermal effects in reduction-oxidation (redox) reactions, where charge transfer is an integral part of the reaction. Second, we analyze not only the spatial distribution of the temperature, but also its temporal dynamics. Third, we also model the fluid convection and stirring. An analysis of two exemplary experimental studies allows us to show that thermal effects can explain the experimental data in one of experiments (Baumberg and coworkers), but not in the other (Jain and coworkers), showing that redox reactions are not necessarily driven by non-thermal charge carriers.


title: Trivializable and quaternionic subriemannian structure on $\mathbb{S}^7$ and subelliptic heat kernel

abstract: On the seven dimensional Euclidean sphere $\mathbb{S}^7$ we compare two subriemannian structures with regards to various geometric and analytical properties. The first structure is called trivializable and the underlying distribution $\mathcal{H}_T$ is induced by a Clifford module structure of $\mathbb{R}^8$. More precisely, $\mathcal{H}_T$ is rank $4$, bracket generating of step two and generated by globally defined vector fields. The distribution $\mathcal{H}_{Q}$ of the second structure is of rank 4 and step two as well and obtained as the horizontal distribution in the quaternionic Hopf fibration $\mathbb{S}^3\hookrightarrow\mathbb{S}^7\rightarrow\mathbb{S}^4$. Answering a question in arXiv:0901.1406 we first show that $\mathcal{H}_{Q}$ does not admit a global nowhere vanishing smooth section. In both cases we determine the Popp measures, the intrinsic sublaplacians $\Delta_{sub}^T$ and $\Delta_{sub}^{Q}$ and the nilpotent approximations. We conclude that both subriemannian structures are not locally isometric and we discuss properties of the isometry group. By determining the first heat invariant of the sublaplacians it is shown that both structures are also not isospectral in the subriemannian sense.


title: Possible Pressure-Induced Charge-Density Wave Quantum Critical Point in LuPd2In

abstract: We investigated the effect of application of hydrostatic pressure on the charge-density wave (CDW) state in Lu(Pt$_{1-x}$Pd$_x$)$_2$In by electrical-resistivity measurements. In Lu(Pt$_{0.7}$Pd$_{0.3}$)$_{2}$In we find an increase of the CDW transition temperature upon application of pressure, which is not expected based on simple volume arguments, but in line with results of a theoretical work by Kim et al. [Phys. Rev. Lett. 125, 157001 (2020).]. Combining experimental and theoretical results suggests the existence of a CDW quantum critical point in stoichiometric LuPd$_2$In around $p\approx20$ GPa.


title: Prime and semiprime submodules of $R^n$ and a related Nullstellensatz for $M_n(R)$

abstract: Let $R$ be a commutative ring with $1$ and $n$ a natural number. We say that a submodule $N$ of $R^n$ is semiprime if for every $f=(f_1,\ldots,f_n) \in R^n$ such that $f_i f \in N$ for $i=1,\ldots,n$ we have $f \in N$. Our main result is that every semiprime submodule of $R^n$ is equal to the intersection of all prime submodules containing it. It follows that every semiprime left ideal of $M_n(R)$ is equal to the intersection of all prime left ideals that contain it. For $R=k[x_1,\ldots,x_d]$ where $k$ is an algebraically closed field we can rephrase this result as a Nullstellensatz for $M_n(R)$: For every $G_1,\ldots,G_m,F \in M_n(R)$, $F$ belongs to the smallest semiprime left ideal of $M_n(R)$ that contains $G_1,\ldots,G_m$ iff for every $a \in k^d$ and $v \in k^n$ such that $G_1(a)v=\ldots=G_m(a)v=0$ we have $F(a)v=0$.


title: On robust theorems due to Bolzano, Weierstrass, Cantor, and Jordan

abstract: Reverse Mathematics (RM hereafter) is a program in the foundations of mathematics where the aim is to identify the minimal axioms needed to prove a given theorem from ordinary, i.e. non-set theoretic, mathematics. This program has unveiled surprising regularities: the minimal axioms are very often equivalent to the theorem over the base theory, a weak system of 'computable mathematics', while most theorems are either provable in this base theory, or equivalent to one of only four logical systems. The latter plus the base theory are called the 'Big Five' and the associated equivalences are robust following Montalban, i.e. stable under small variations of the theorems at hand. Working in Kohlenbach's higher-order RM, we obtain two long series of equivalences based on theorems due to Bolzano, Weierstrass, Jordan, and Cantor; these equivalences are extremely robust and have no counterpart among the Big Five systems, as they are strictly between the base theory and the higher-order counterpart of weak Koenig's lemma. Thus, higher-order RM is much richer than its second-order cousin, boasting (at least) two extra 'Big' systems.


title: Quantum Corrected Polymer Black Hole Thermodynamics: Mass Relations and Logarithmic Entropy Correction

abstract: In this paper, we continue the analysis of the effective model of quantum Schwarzschild black holes recently proposed by some of the authors in [1,2]. In the resulting spacetime the central singularity is resolved by a black-to-white hole bounce, quantum effects become relevant at a unique mass independent curvature scale, while they become negligible in the low curvature region near the horizon and classical geometry is approached asymptotically. This is the case independently of the relation between the black and white hole masses, which are thus freely specifiable independent observables. A natural question then arises about the phenomenological implications of the resulting non-singular effective spacetime and whether some specific relation between the masses can be singled out from a phenomenological perspective. Here we focus on the thermodynamic properties of the effective polymer black hole and analyse the corresponding quantum corrections as functions of black and white hole masses. The study of the relevant thermodynamic quantities such as temperature, specific heat and horizon entropy reveals that the effective spacetime generically admits an extremal minimal-sized configuration of quantum-gravitational nature characterised by vanishing temperature and entropy. For large masses, the classically expected results are recovered at leading order and quantum corrections are negligible, thus providing us with a further consistency check of the model. The explicit form of the corrections depends on the specific relation among the masses. In particular, a first-order logarithmic correction to the entropy is obtained for a quadratic mass relation. The latter corresponds to the case of proper finite length effects which turn out to be compatible with a minimal length generalised uncertainty principle associated with an extremal Planck-sized black hole.


title: Transparency to hybrid open access through publisher-provided metadata: An article-level study of Elsevier

abstract: With the growth of open access (OA), the financial flows in scholarly journal publishing have become increasingly complex, but comprehensive data and transparency into these flows are still lacking. The opaqueness is especially concerning for hybrid OA, where subscription-based journals publish individual articles as OA if an optional fee is paid. This study addresses the lack of transparency by leveraging Elsevier article metadata and provides the first publisher-level study of hybrid OA uptake and invoicing. Our results show that Elsevier's hybrid OA uptake has grown steadily but slowly from 2015-2019, doubling the number of hybrid OA articles published per year and increasing the share of OA articles in Elsevier's hybrid journals from 2.6% to 3.7% of all articles. Further, we find that most hybrid OA articles were invoiced directly to authors, followed by articles invoiced through agreements with research funders, institutions, or consortia, with only a few funding bodies driving hybrid OA uptake. As such, our findings point to the role of publishing agreements and OA policies in hybrid OA publishing. Our results further demonstrate the value of publisher-provided metadata to improve the transparency in scholarly publishing by linking invoicing data to bibliometrics.


title: Performance of the CMS muon trigger system in proton-proton collisions at $\sqrt{s} =$ 13 TeV

abstract: The muon trigger system of the CMS experiment uses a combination of hardware and software to identify events containing a muon. During Run 2 (covering 2015-2018) the LHC achieved instantaneous luminosities as high as 2 $\times$ 10$^{34}$cm$^{-2}$s$^{-1}$ while delivering proton-proton collisions at $\sqrt{s} =$ 13 TeV. The challenge for the trigger system of the CMS experiment is to reduce the registered event rate from about 40 MHz to about 1 kHz. Significant improvements important for the success of the CMS physics program have been made to the muon trigger system via improved muon reconstruction and identification algorithms since the end of Run 1 and throughout the Run 2 data-taking period. The new algorithms maintain the acceptance of the muon triggers at the same or even lower rate throughout the data-taking period despite the increasing number of additional proton-proton interactions in each LHC bunch crossing. In this paper, the algorithms used in 2015 and 2016 and their improvements throughout 2017 and 2018 are described. Measurements of the CMS muon trigger performance for this data-taking period are presented, including efficiencies, transverse momentum resolution, trigger rates, and the purity of the selected muon sample. This paper focuses on the single- and double-muon triggers with the lowest sustainable transverse momentum thresholds used by CMS. The efficiency is measured in a transverse momentum range from 8 to several hundred GeV.


title: mecor: An R package for measurement error correction in linear regression models with a continuous outcome

abstract: Measurement error in a covariate or the outcome of regression models is common, but is often ignored, even though measurement error can lead to substantial bias in the estimated covariate-outcome association. While several texts on measurement error correction methods are available, these methods remain seldomly applied. To improve the use of measurement error correction methodology, we developed mecor, an R package that implements measurement error correction methods for regression models with continuous outcomes. Measurement error correction requires information about the measurement error model and its parameters. This information can be obtained from four types of studies, used to estimate the parameters of the measurement error model: an internal validation study, a replicates study, a calibration study and an external validation study. In the package mecor, regression calibration methods and a maximum likelihood method are implemented to correct for measurement error in a continuous covariate in regression analyses. Additionally, methods of moments methods are implemented to correct for measurement error in the continuous outcome in regression analyses. Variance estimation of the corrected estimators is provided in closed form and using the bootstrap.


title: Quantum dynamics of Mn$^{2+}$ in dimethylammonium magnesium formate

abstract: Dimethylammonium magnesium formate, [(CH$_3$)$_2$NH$_2$][Mg(HCOO)$_3$] or DMAMgF, is a model to study high temperature hybrid perovskite-like dielectrics. This compound displays a phase transition from para to ferroelectric at about 260~K. Using multifrequency electron spin resonance in continuous wave and pulsed modes, we herein present the quantum dynamic of Mn$^{2+}$ ion probe in DMAMgF. In the high temperature paraelectric phase, we observe a large distribution of the zero field splitting that is attributed to high local disorder and further supported by DFT computations. In the low temperature ferroelectric phase, a single structure phase is detected and shown to contain two magnetic structures. The complex EPR signals were identifed by the means of Rabi oscillation method combined to crystal fields kernel density estimation.


title: Average Behaviour in Discrete-Time Imprecise Markov Chains: A Study of Weak Ergodicity

abstract: We study the limit behaviour of upper and lower bounds on expected time averages in imprecise Markov chains; a generalised type of Markov chain where the local dynamics, traditionally characterised by transition probabilities, are now represented by sets of `plausible' transition probabilities. Our first main result is a necessary and sufficient condition under which these upper and lower bounds, called upper and lower expected time averages, will converge as time progresses towards infinity to limit values that do not depend on the process' initial state. Our condition is considerably weaker than that needed for ergodic behaviour; a similar notion which demands that marginal upper and lower expectations of functions at a single time instant converge to so-called limit-or steady state-upper and lower expectations. For this reason, we refer to our notion as `weak ergodicity'. Our second main result shows that, as far as this weakly ergodic behaviour is concerned, one should not worry about which type of independence assumption to adopt-epistemic irrelevance, complete independence or repetition independence. The characterisation of weak ergodicity as well as the limit values of upper and lower expected time averages do not depend on such a choice. Notably, this type of robustness is not exhibited by the notion of ergodicity and the related inferences of limit upper and lower expectations. Finally, though limit upper and lower expectations are often used to provide approximate information about the limit behaviour of time averages, we show that such an approximation is sub-optimal and that it can be significantly improved by directly using upper and lower expected time averages.


title: A Numerical-Analytical Method for Constructing Periodic Solutions of the Lorenz System

abstract: This article describes a method for constructing approximations to periodic solutions of dynamic Lorenz system with classical values of the system parameters. The author obtained a system of nonlinear algebraic equations in general form concerning of the cyclic frequency, constant terms and amplitudes of harmonics that make up harmonic approximations to the desired solutions. The initial approximation for the Newton method is selected, which converges to a solution describing a periodic solution different from the equilibrium position. The results of a computational experiment are presented. The results are verified using high-precision calculations.


title: An Improvement for Quantum Tunneling Radiation of Fermions in a Stationary Kerr-Newman Black Hole Spacetime

abstract: By introducing a specific etheric-like vector in the Dirac equation with Lorentz Invariance Violation (LIV) in the curved spacetime, an improved method for quantum tunneling radiation of fermions is proposed. As an example, we apply this new method to a charged axisymmetric Kerr-Newman black hole. Firstly, considering LIV theory, we derive a modified dynamical equation of fermion with spin 1/2 in the Kerr-Newman black hole spacetime. Then we solve the equation and find the increase or decrease of black hole's Hawking temperature and entropy are related to constants $a$ and $c$ of the Dirac equation with LIV in the curved spacetime. As $c$ is positive, the new Hawking temperature is about $ \frac{\sqrt{1+2a+2cmk_r^2}}{\sqrt{1+2a}}$ times higher than that without modification, but the entropy will decrease. We also make a brief discussion for the case of high spin fermions.


title: Avaddon ransomware: an in-depth analysis and decryption of infected systems

abstract: The commoditization of Malware-as-a-Service (MaaS) allows criminals to obtain financial benefits at a low risk and with little technical background. One such popular product in the underground economy is ransomware. In ransomware attacks, data from infected systems is held hostage (encrypted) until a fee is paid to the criminals. This modus operandi disrupts legitimate businesses, which may become unavailable until the data is restored. A recent blackmailing strategy adopted by criminals is to leak data online from the infected systems if the ransom is not paid. Besides reputational damage, data leakage might produce further economical losses due to fines imposed by data protection laws. Thus, research on prevention and recovery measures to mitigate the impact of such attacks is needed to adapt existing countermeasures to new strains. In this work, we perform an in-depth analysis of Avaddon, a ransomware offered in the underground economy as an affiliate program business. This has infected and leaked data from at least 23 organizations. Additionally, it runs Distributed Denial-of-Service (DDoS) attacks against victims that do not pay the ransom. We first provide an analysis of the criminal business model from the underground economy. Then, we identify and describe its technical capabilities. We provide empirical evidence of links between this variant and a previous family, suggesting that the same group was behind the development and, possibly, the operation of both campaigns. Finally, we describe a method to decrypt files encrypted with Avaddon in real time. We implement and test the decryptor in a tool that can recover the encrypted data from an infected system, thus mitigating the damage caused by the ransomware. The tool is released open-source so it can be incorporated in existing Antivirus engines.


title: The Exact Rate Memory Tradeoff for Small Caches with Coded Placement

abstract: The idea of coded caching was introduced by Maddah-Ali and Niesen who demonstrated the advantages of coding in caching problems. To capture the essence of the problem, they introduced the $(N, K)$ canonical cache network in which $K$ users with independent caches of size $M$ request files from a server that has $N$ files. Among other results, the caching scheme and lower bounds proposed by them led to a characterization of the exact rate memory tradeoff when $M\geq \frac{N}{K}(K-1)$. These lower bounds along with the caching scheme proposed by Chen et al. led to a characterization of the exact rate memory tradeoff when $M\leq \frac{1}{K}$. In this paper we focus on small caches where $M\in \left[0,\frac{N}{K}\right]$ and derive new lower bounds. For the case when $\big\lceil\frac{K+1}{2}\big\rceil\leq N \leq K$ and $M\in \big[\frac{1}{K},\frac{N}{K(N-1)}\big]$, our lower bounds demonstrate that the caching scheme introduced by G{\'o}mez-Vilardeb{\'o} is optimal and thus extend the characterization of the exact rate memory tradeoff. For the case $1\leq N\leq \big\lceil\frac{K+1}{2}\big\rceil$, we show that the new lower bounds improve upon the previously known lower bounds.


title: Ensembling object detectors for image and video data analysis

abstract: In this paper, we propose a method for ensembling the outputs of multiple object detectors for improving detection performance and precision of bounding boxes on image data. We further extend it to video data by proposing a two-stage tracking-based scheme for detection refinement. The proposed method can be used as a standalone approach for improving object detection performance, or as a part of a framework for faster bounding box annotation in unseen datasets, assuming that the objects of interest are those present in some common public datasets.


title: Multi-scale GCN-assisted two-stage network for joint segmentation of retinal layers and disc in peripapillary OCT images

abstract: An accurate and automated tissue segmentation algorithm for retinal optical coherence tomography (OCT) images is crucial for the diagnosis of glaucoma. However, due to the presence of the optic disc, the anatomical structure of the peripapillary region of the retina is complicated and is challenging for segmentation. To address this issue, we developed a novel graph convolutional network (GCN)-assisted two-stage framework to simultaneously label the nine retinal layers and the optic disc. Specifically, a multi-scale global reasoning module is inserted between the encoder and decoder of a U-shape neural network to exploit anatomical prior knowledge and perform spatial reasoning. We conducted experiments on human peripapillary retinal OCT images. The Dice score of the proposed segmentation network is 0.820$\pm$0.001 and the pixel accuracy is 0.830$\pm$0.002, both of which outperform those from other state-of-the-art techniques.


title: Performance of the diamond-based beam-loss monitor system of Belle II

abstract: We designed, constructed and have been operating a system based on single-crystal synthetic diamond sensors, to monitor the beam losses at the interaction region of the SuperKEKB asymmetric-energy electron-positron collider. The system records the radiation dose-rates in positions close to the inner detectors of the Belle II experiment, and protects both the detector and accelerator components against destructive beam losses, by participating in the beam-abort system. It also provides complementary information for the dedicated studies of beam-related backgrounds. We describe the performance of the system during the commissioning of the accelerator and during the first physics data taking.


title: Automatic variational inference with cascading flows

abstract: The automation of probabilistic reasoning is one of the primary aims of machine learning. Recently, the confluence of variational inference and deep learning has led to powerful and flexible automatic inference methods that can be trained by stochastic gradient descent. In particular, normalizing flows are highly parameterized deep models that can fit arbitrarily complex posterior densities. However, normalizing flows struggle in highly structured probabilistic programs as they need to relearn the forward-pass of the program. Automatic structured variational inference (ASVI) remedies this problem by constructing variational programs that embed the forward-pass. Here, we combine the flexibility of normalizing flows and the prior-embedding property of ASVI in a new family of variational programs, which we named cascading flows. A cascading flows program interposes a newly designed highway flow architecture in between the conditional distributions of the prior program such as to steer it toward the observed data. These programs can be constructed automatically from an input probabilistic program and can also be amortized automatically. We evaluate the performance of the new variational programs in a series of structured inference problems. We find that cascading flows have much higher performance than both normalizing flows and ASVI in a large set of structured inference problems.


title: Geometrical constraints on curvature from galaxy-lensing cross-correlations

abstract: Accurate constraints on curvature provide a powerful probe of inflation. However, curvature constraints based on specific assumptions of dark energy may lead to unreliable conclusions when used to test inflation models. To avoid this, it is important to obtain constraints that are independent on assumptions for dark energy. In this paper, we investigate such constraints on curvature from the geometrical probe constructed from galaxy-lensing cross-correlations. We study comprehensively the cross-correlations of galaxy with magnification, measured from type Ia supernovae's brightnesses ("$g\kappa^{\rm SN}$"), with shear ("$g\kappa^{\rm g}$"), and with CMB lensing ("$g\kappa^{\rm CMB}$"). We find for the LSST and Stage IV CMB surveys, "$g\kappa^{\rm SN}$" , "$g\kappa^{\rm g}$" and "$g\kappa^{\rm CMB}$" can be detected with signal-to-noise ratio $S/N=104,\ 2291,\ 1842$ respectively. When combined with supernovae Hubble diagram ("SN") to constrain curvature, we find galaxy-lensing cross-correlation becomes increasingly important with more degrees of freedom allowed in dark energy. Without any priors, we obtain error on $\Omega_K$ of $0.723$ from "SN + $g\kappa^{\rm SN}$", $0.0417$ from "SN + $g\kappa^{\rm g}$", and $0.04$ from "SN + $g\kappa^{\rm g}$ + $g\kappa^{\rm CMB}$" for the LSST and Stage IV CMB surveys. The last one is more competitive than a Stage IV BAO survey ("BAO"). When galaxy-lensing cross-correlations are added to the combined probe of "SN + BAO + CMB", where "CMB" stands for Planck measurement for the CMB acoustic scale, we obtain constraint on $\Omega_K$ of $0.0013$, which is a factor of 7 improvement from "SN + BAO + CMB". We study improvements in these results from increasing the high redshift extension of supernovae.


title: DetCo: Unsupervised Contrastive Learning for Object Detection

abstract: Unsupervised contrastive learning achieves great success in learning image representations with CNN. Unlike most recent methods that focused on improving accuracy of image classification, we present a novel contrastive learning approach, named DetCo, which fully explores the contrasts between global image and local image patches to learn discriminative representations for object detection. DetCo has several appealing benefits. (1) It is carefully designed by investigating the weaknesses of current self-supervised methods, which discard important representations for object detection. (2) DetCo builds hierarchical intermediate contrastive losses between global image and local patches to improve object detection, while maintaining global representations for image recognition. Theoretical analysis shows that the local patches actually remove the contextual information of an image, improving the lower bound of mutual information for better contrastive learning. (3) Extensive experiments on PASCAL VOC, COCO and Cityscapes demonstrate that DetCo not only outperforms state-of-the-art methods on object detection, but also on segmentation, pose estimation, and 3D shape prediction, while it is still competitive on image classification. For example, on PASCAL VOC, DetCo-100ep achieves 57.4 mAP, which is on par with the result of MoCov2-800ep. Moreover, DetCo consistently outperforms supervised method by 1.6/1.2/1.0 AP on Mask RCNN-C4/FPN/RetinaNet with 1x schedule. Code will be released at \href{https://github.com/xieenze/DetCo}{\color{blue}{\tt github.com/xieenze/DetCo}}.


title: The Phase Diagram of a Deep Potential Water Model

abstract: Using the Deep Potential methodology, we construct a model that reproduces accurately the potential energy surface of the SCAN approximation of density functional theory for water, from low temperature and pressure to about 2400 K and 50 GPa, excluding the vapor stability region. The computational efficiency of the model makes it possible to predict its phase diagram using molecular dynamics. Satisfactory overall agreement with experimental results is obtained. The fluid phases, molecular and ionic, and all the stable ice polymorphs, ordered and disordered, are predicted correctly, with the exception of ice III and XV that are stable in experiments, but metastable in the model. The evolution of the atomic dynamics upon heating, as ice VII transforms first into ice VII$''$ and then into an ionic fluid, reveals that molecular dissociation and breaking of the ice rules coexist with strong covalent fluctuations, explaining why only partial ionization was inferred in experiments.


title: AI-based Blackbox Code Deobfuscation: Understand, Improve and Mitigate

abstract: Code obfuscation aims at protecting Intellectual Property and other secrets embedded into software from being retrieved. Recent works leverage advances in artificial intelligence with the hope of getting blackbox deobfuscators completely immune to standard (whitebox) protection mechanisms. While promising, this new field of AI-based blackbox deobfuscation is still in its infancy. In this article we deepen the state of AI-based blackbox deobfuscation in three key directions: understand the current state-of-the-art, improve over it and design dedicated protection mechanisms. In particular, we define a novel generic framework for AI-based blackbox deobfuscation encompassing prior work and highlighting key components; we are the first to point out that the search space underlying code deobfuscation is too unstable for simulation-based methods (e.g., Monte Carlo Tres Search used in prior work) and advocate the use of robust methods such as S-metaheuritics; we propose the new optimized AI-based blackbox deobfuscator Xyntia which significantly outperforms prior work in terms of success rate (especially with small time budget) while being completely immune to the most recent anti-analysis code obfuscation methods; and finally we propose two novel protections against AI-based blackbox deobfuscation, allowing to counter Xyntia's powerful attacks.


title: The propagation and decay of a coastal vortex on a shelf

abstract: A coastal eddy is modelled as a barotropic vortex propagating along a coastal shelf. If the vortex speed matches the phase speed of any coastal trapped shelf wave modes, a shelf wave wake is generated leading to a flux of energy from the vortex into the wave field. Using a simply shelf geometry, we determine analytic expressions for the wave wake and the leading order flux of wave energy. By considering the balance of energy between the vortex and wave field, this energy flux is then used to make analytic predictions for the evolution of the vortex speed and radius under the assumption that the vortex structure remains self similar. These predictions are examined in the asymptotic limit of small rotation rate and shelf slope and tested against numerical simulations. If the vortex speed does not match the phase speed of any shelf wave, steady vortex solutions are expected to exist. We present a numerical approach for finding these nonlinear solutions and examine the parameter dependence of their structure.


title: Homotopy invariant in time-reversal and twofold rotation symmetric systems

abstract: The primary goal of this paper is to study topological invariants in two dimensional twofold rotation and time-reversal symmetric spinful systems. In this paper, firstly we build a new homotopy invariant based on the lifting of the Wilson loop to the universal covering group of the special orthogonal group. Furthermore, we prove that the invariant we built agrees with the K theory invariant. We go beyond the previous understanding of the Wilson loop unwinding in more than two occupied bands by finding an obstruction of such unwinding. Then, within this formalism, we show two examples that have the same Wilson loop spectrum but belong to different topological classes. Finally, we present a tight binding model realizing the non-trivial phase.


title: Smart non-intrusive appliance identification using a novel local power histogramming descriptor with an improved k-nearest neighbors classifier

abstract: Non-intrusive load monitoring (NILM) is a key cost-effective technology for monitoring power consumption and contributing to several challenges encountered when transiting to an efficient, sustainable, and competitive energy efficiency environment. This paper proposes a smart NILM system based on a novel local power histogramming (LPH) descriptor, in which appliance power signals are transformed into 2D space and short histograms are extracted to represent each device. Specifically, short local histograms are drawn to represent individual appliance consumption signatures and robustly extract appliance-level data from the aggregated power signal. Furthermore, an improved k-nearest neighbors (IKNN) algorithm is presented to reduce the learning computation time and improve the classification performance. This results in highly improving the discrimination ability between appliances belonging to distinct categories. A deep evaluation of the proposed LPH-IKNN based solution is investigated under different data sets, in which the proposed scheme leads to promising performance. An accuracy of up to 99.65% and 98.51% has been achieved on GREEND and UK-DALE data sets, respectively. While an accuracy of more than 96% has been attained on both WHITED and PLAID data sets. This proves the validity of using 2D descriptors to accurately identify appliances and create new perspectives for the NILM problem.


title: Stability Analysis and State-Feedback Stabilization of LPV Time-Delay Systems with Piecewise Constant Parameters subject to Spontaneous Poissonian Jumps

abstract: This paper discusses the stability analysis of linear parameter varying systems with a parameter-dependent delay where the parameters are assumed to be stochastic piecewise constants under spontaneous Poissonian jumps. Based on stochastic Lyapunov-Krasovskii functionals, we also provide sufficient synthesis conditions for the gain-scheduled state-feedback controller with memory in terms of parameter-dependent linear matrix inequalities (LMIs). Such synthesis conditions are computationally intractable due to the presence of integral terms. However, we show that these LMIs can be equivalently represented by integral-free LMIs, which are computationally tractable. Finally, we illustrate the applicability of the results through examples.


title: Berry-Esseen bounds of second moment estimators for Gaussian processes observed at high frequency

abstract: Let $Z:=\{Z_t,t\geq0\}$ be a stationary Gaussian process. We study two estimators of $\mathbb{E}[Z_0^2]$, namely $\widehat{f}_T(Z):= \frac{1}{T} \int_{0}^{T} Z_{t}^{2}dt$, and $\widetilde{f}_n(Z) :=\frac{1}{n} \sum_{i =1}^{n} Z_{t_{i}}^{2}$, where $ t_{i} = i \Delta_{n}$, $ i=0,1,\ldots, n $, $\Delta_{n}\rightarrow 0$ and $ T_{n} := n \Delta_{n}\rightarrow \infty$. We prove that the two estimators are strongly consistent and establish Berry-Esseen bounds for a central limit theorem involving $\widehat{f}_T(Z)$ and $\widetilde{f}_n(Z)$. We apply these results to asymptotically stationary Gaussian processes and estimate the drift parameter for Gaussian Ornstein-Uhlenbeck processes.


title: Broader terms curriculum mapping: Using natural language processing and visual-supported communication to create representative program planning experiences

abstract: Accreditation bodies call for curriculum development processes open to all stakeholders, reflecting viewpoints of students, industry, university faculty and society. However, communication difficulties between faculty and non-faculty groups leave unexplored an immense collaboration potential. Using classification of learning objectives, natural language processing, and data visualization, this paper presents a method to deliver program plan representations that are universal, self-explanatory, and empowering. A simple example shows how the method contributes to representative program planning experiences and a case study is used to confirm the method's accuracy and utility.


title: Evidence for multiband superconductivity and charge density waves in Ni-doped ZrTe$_2$

abstract: We carried out a comprehensive study of the electronic, magnetic, and thermodynamic properties of Ni-doped ZrTe$_2$. High quality Ni$_{0.04}$ZrTe$_{1.89}$ single crystals show a possible coexistence of charge density waves (CDW, T$_{CDW}\approx287$\,K) with superconductivity (T$_c\approx 4.1$\,K), which we report here for the first time. The temperature dependence of the lower (H$_{c_1}$) and upper (H$_{c_2}$) critical magnetic fields both deviate significantly from the behaviors expected in conventional single-gap s-wave superconductors. However, the behaviors of the normalized superfluid density $\rho_s(T)$ and H$_{c_2}(T)$ can be described well using a two-gap model for the Fermi surface, in a manner consistent with conventional multiband superconductivity. Electrical resistivity and specific heat measurements show clear anomalies centered near 287\,K consistent with a CDW phase transition. Additionally, electronic-structure calculations support the coexistence of electron-phonon multiband superconductivity and CDW order due to the compensated disconnected nature of the electron- and hole-pockets at the Fermi surface. Our electronic structure calculations also suggest that ZrTe$_2$ could reach a non-trivial topological type-II Dirac semimetallic state. These findings highlight that Ni-doped ZrTe2 can be uniquely important for probing the coexistence of superconducting and CDW ground states in an electronic system with non-trivial topology.


title: Compensation of Multicore Fiber Skew Effects for Radio over Fiber mmWave Antenna Beamforming

abstract: In 5G networks, a Radio over Fiber architecture utilizing multicore fibers can be adopted for the transmission of mmwave signals feeding phased array antennas. The mmwave signals undergo phase shifts imposed by optical true time delay networks, to provide squint free beams. Multicore fibers are used to transfer the phase shifted optical signals. However, the intercore static skew of these fibers, if not compensated, distorts the radiation pattern. We propose an efficient method to compensate the differential delays, without full equalization of the transmission path lengths, reducing the power loss and complexity. Statistical analysis shows that regardless of the skew distribution, the frequency response can be estimated with respect to the rms skew delays. Simulation analysis of the complete Radio over Fiber and RF link validates the method.


title: Categorical computation

abstract: In quantum computing, the computation is achieved by linear operators in or between Hilbert spaces. In this work, we explore a new computation scheme, in which the linear operators in quantum computing are replaced by (higher) functors between two (higher) categories. If from Turing computing to quantum computing is the first quantization of computation, then this new scheme can be viewed as the second quantization of computation. The fundamental problem in realizing this idea is how to realize a (higher) functor physically. We provide a theoretical idea of realizing (higher) functors physically based on the physics of topological orders.


title: Construction of complex solutions to nonlinear partial differential equations using simpler solutions

abstract: The paper describes a number of simple but quite effective methods for constructing exact solutions of PDEs, that involve a relatively small amount of intermediate calculations. The methods employ two main ideas: (i) simple exact solutions can serve to construct more complex solutions of the equations under consideration and (ii) exact solutions of some equations can serve to construct solutions of other, more complex equations. In particular, we propose a method for constructing complex solutions from simple solutions using translation and scaling. We show that in some cases, rather complex solutions can be obtained by adding one or more terms to simpler solutions. There are situations where nonlinear superposition allows us to construct a complex composite solution using similar simple solutions. We also propose a few methods for constructing complex exact solutions to linear and nonlinear PDEs by introducing complex-valued parameters into simpler solutions. The effectiveness of the methods is illustrated by a large number of specific examples (over 30 in total). These include nonlinear heat/diffusion equations, wave type equations, Klein--Gordon type equations, hydrodynamic boundary layer equations, Navier--Stokes equations, and some other PDEs. Apart from exact solutions to `ordinary' PDEs, we also describe some exact solutions to more complex nonlinear delay PDEs. Along with the unknown function at the current time, $u=u(x,t)$, these equations contain the same function at a past time, $w=u(x,t-\tau)$, where $\tau>0$ is the delay time. Furthermore, we look at nonlinear partial functional-differential equations of the pantograph type, which in addition to the unknown $u=u(x,t)$, also contain the same functions with dilated or contracted arguments, $w=u(px,qt)$, where $p$ and $q$ are scaling parameters.


title: Classification of Handwritten Names of Cities and Handwritten Text Recognition using Various Deep Learning Models

abstract: This article discusses the problem of handwriting recognition in Kazakh and Russian languages. This area is poorly studied since in the literature there are almost no works in this direction. We have tried to describe various approaches and achievements of recent years in the development of handwritten recognition models in relation to Cyrillic graphics. The first model uses deep convolutional neural networks (CNNs) for feature extraction and a fully connected multilayer perceptron neural network (MLP) for word classification. The second model, called SimpleHTR, uses CNN and recurrent neural network (RNN) layers to extract information from images. We also proposed the Bluechet and Puchserver models to compare the results. Due to the lack of available open datasets in Russian and Kazakh languages, we carried out work to collect data that included handwritten names of countries and cities from 42 different Cyrillic words, written more than 500 times in different handwriting. We also used a handwritten database of Kazakh and Russian languages (HKR). This is a new database of Cyrillic words (not only countries and cities) for the Russian and Kazakh languages, created by the authors of this work.


title: g-SiC6 Monolayer: A New Graphene-like Dirac Cone Material with a High Fermi Velocity

abstract: Two-dimensional (2D) materials with Dirac cones have been intrigued by many unique properties, i.e., the effective masses of carriers close to zero and Fermi velocity of ultrahigh, which yields a great possibility in high-performance electronic devices. In this work, using first-principles calculations, we have predicted a new Dirac cone material of silicon carbide with the new stoichiometries, named g-SiC6 monolayer, which is composed of sp2 hybridized with a graphene-like structure. The detailed calculations have revealed that g-SiC6 has outstanding dynamical, thermal, and mechanical stabilities, and the mechanical and electronic properties are still isotropic. Of great interest is that the Fermi velocity of g-SiC6 monolayer is the highest in silicon carbide Dirac materials until now. The Dirac cone of the g-SiC6 is controllable by an in-plane uniaxial strain and shear strain, which is promised to realize a direct application in electronics and optoelectronics. Moreover, we found that new stoichiometries AB6 (A, B = C, Si, and Ge) compounds with the similar SiC6 monolayer structure are both dynamics stable and possess Dirac cones, and their Fermi velocity was also calculated in this paper. Given the outstanding properties of those new types of silicon carbide monolayer, which is a promising 2D material for further exploring the potential applications.


title: Autocompact objects of Ab5 categories

abstract: The aim of the paper is to describe autocompact objects in Ab5-categories, i.e. objects in cocomplete abelian categories with exactness preserving filtered colimits of exact sequences, whose covariant Hom-functor commutes with copowers of the object itself. A characterization of non-autocompact object is given, a general criterion of autocompactness of an object via the structure of its endomorphism ring is presented and a criterion of autocompactness of products is proven.


title: Spinning test body orbiting around a Kerr black hole: Eccentric equatorial orbits and their asymptotic gravitational-wave fluxes

abstract: We use the frequency and time domain Teukolsky formalism to calculate gravitational-wave fluxes from a spinning body on a bound eccentric equatorial orbit around a Kerr black hole. The spinning body is represented as a point particle following the pole-dipole approximation of the Mathisson-Papapetrou-Dixon equations. Reformulating these equations we are not only able to find the trajectory of a spinning particle in terms of its constants of motion, but also to provide a method to calculate the azimuthal and the radial frequency of this trajectory. Using these orbital quantities, we introduce the machinery to calculate through the frequency domain Teukolsky formalism the energy and the angular momentum fluxes at infinity, and at the horizon, along with the gravitational strain at infinity. We crosscheck the results obtained from the frequency domain approach with the results obtained from a time domain Teukolsky equation solver called Teukode.


title: Cohomology of $(\varphi,\Gamma)$-modules over pseudorigid spaces

abstract: We study the cohomology of families of $(\varphi,\Gamma)$-modules with coefficients in pseudoaffinoid algebras. We prove that they have finite cohomology, and we deduce an Euler characteristic formula and Tate local duality. We classify rank-$1$ $(\varphi, \Gamma)$-modules and deduce that triangulations of pseudorigid families of $(\varphi,\Gamma)$-modules can be interpolated, extending a result of [KPX14]. We then apply this to study extended eigenvarieties at the boundary of weight space, proving in particular that the eigencurve is proper at the boundary and that Galois representations attached to certain characteristic $p$ points are trianguline.


title: Probing charge density wave phases and the Mott transition in $1T$-TaS$_2$ by inelastic light scattering

abstract: We present a polarization-resolved, high-resolution Raman scattering study of the three consecutive charge density wave (CDW) regimes in $1T$-TaS$_2$ single crystals, supported by \textit{ab initio} calculations. Our analysis of the spectra within the low-temperature commensurate (C-CDW) regime shows $\mathrm{P3}$ symmetry of the system, thus excluding the previously proposed triclinic stacking of the "star-of-David" structure, and promoting trigonal or hexagonal stacking instead. The spectra of the high-temperature incommensurate (IC-CDW) phase directly project the phonon density of states due to the breaking of the translational invariance, supplemented by sizeable electron-phonon coupling. Between 200 and 352\,K, our Raman spectra show contributions from both the IC-CDW and the C-CDW phase, indicating their coexistence in the so-called nearly-commensurate (NC-CDW) phase. The temperature-dependence of the symmetry-resolved Raman conductivity indicates the stepwise reduction of the density of states in the CDW phases, followed by a Mott transition within the C-CDW phase. We determine the size of the Mott gap to be $\Omega_{\rm gap}\approx 170-190$ meV, and track its temperature dependence.


title: Learning How to Search: Generating Effective Test Cases Through Adaptive Fitness Function Selection

abstract: Search-based test generation is guided by feedback from one or more fitness functions - scoring functions that judge solution optimality. Choosing informative fitness functions is crucial to meeting the goals of a tester. Unfortunately, many goals - such as forcing the class-under-test to throw exceptions, increasing test suite diversity, and attaining Strong Mutation Coverage - do not have effective fitness function formulations. We propose that meeting such goals requires treating fitness function identification as a secondary optimization step. An adaptive algorithm that can vary the selection of fitness functions could adjust its selection throughout the generation process to maximize goal attainment, based on the current population of test suites. To test this hypothesis, we have implemented two reinforcement learning algorithms in the EvoSuite unit test generation framework, and used these algorithms to dynamically set the fitness functions used during generation for the three goals identified above. We have evaluated our framework, EvoSuiteFIT, on a set of Java case examples. EvoSuiteFIT techniques attain significant improvements for two of the three goals, and show limited improvements on the third when the number of generations of evolution is fixed. Additionally, for two of the three goals, EvoSuiteFIT detects faults missed by the other techniques. The ability to adjust fitness functions allows strategic choices that efficiently produce more effective test suites, and examining these choices offers insight into how to attain our testing goals. We find that adaptive fitness function selection is a powerful technique to apply when an effective fitness function does not already exist for achieving a testing goal.


title: Facial Expression Recognition on a Quantum Computer

abstract: We address the problem of facial expression recognition and show a possible solution using a quantum machine learning approach. In order to define an efficient classifier for a given dataset, our approach substantially exploits quantum interference. By representing face expressions via graphs, we define a classifier as a quantum circuit that manipulates the graphs adjacency matrices encoded into the amplitudes of some appropriately defined quantum states. We discuss the accuracy of the quantum classifier evaluated on the quantum simulator available on the IBM Quantum Experience cloud platform, and compare it with the accuracy of one of the best classical classifier.


title: A Multi-Arm Bandit Approach To Subset Selection Under Constraints

abstract: We explore the class of problems where a central planner needs to select a subset of agents, each with different quality and cost. The planner wants to maximize its utility while ensuring that the average quality of the selected agents is above a certain threshold. When the agents' quality is known, we formulate our problem as an integer linear program (ILP) and propose a deterministic algorithm, namely \dpss\ that provides an exact solution to our ILP. We then consider the setting when the qualities of the agents are unknown. We model this as a Multi-Arm Bandit (MAB) problem and propose \newalgo\ to learn the qualities over multiple rounds. We show that after a certain number of rounds, $\tau$, \newalgo\ outputs a subset of agents that satisfy the average quality constraint with a high probability. Next, we provide bounds on $\tau$ and prove that after $\tau$ rounds, the algorithm incurs a regret of $O(\ln T)$, where $T$ is the total number of rounds. We further illustrate the efficacy of \newalgo\ through simulations. To overcome the computational limitations of \dpss, we propose a polynomial-time greedy algorithm, namely \greedy, that provides an approximate solution to our ILP. We also compare the performance of \dpss\ and \greedy\ through experiments.


title: Bergman kernel and period map for curves

abstract: As for any symmetric space the tangent space to Siegel upper-half space is endowed with an operation coming from the Lie bracket on the Lie algebra. We consider the pull-back of this operation to the moduli space of curves via the Torelli map. We characterize it in terms of the geometry of the curve, using the Bergman kernel form associated to the curve. It is known that the second fundamental form of the Torelli map outside the hyperelliptic locus can be seen as the multiplication by a certain meromorphic form. Our second result says that the Bergman kernel form is the harmonic representative - in a suitable sense - of this meromorphic form.


title: On exact division and divisibility testing for sparse polynomials

abstract: No polynomial-time algorithm is known to test whether a sparse polynomial G divides another sparse polynomial $F$. While computing the quotient Q=F quo G can be done in polynomial time with respect to the sparsities of F, G and Q, this is not yet sufficient to get a polynomial-time divisibility test in general. Indeed, the sparsity of the quotient Q can be exponentially larger than the ones of F and G. In the favorable case where the sparsity #Q of the quotient is polynomial, the best known algorithm to compute Q has a non-linear factor #G#Q in the complexity, which is not optimal. In this work, we are interested in the two aspects of this problem. First, we propose a new randomized algorithm that computes the quotient of two sparse polynomials when the division is exact. Its complexity is quasi-linear in the sparsities of F, G and Q. Our approach relies on sparse interpolation and it works over any finite field or the ring of integers. Then, as a step toward faster divisibility testing, we provide a new polynomial-time algorithm when the divisor has a specific shape. More precisely, we reduce the problem to finding a polynomial S such that QS is sparse and testing divisibility by S can be done in polynomial time. We identify some structure patterns in the divisor G for which we can efficiently compute such a polynomial~S.


title: Mixed three-point functions of conserved currents in three-dimensional superconformal field theory

abstract: We consider mixed three-point correlation functions of the supercurrent and flavour current in three-dimensional $1 \leq \mathcal{N} \leq 4$ superconformal field theories. Our method is based on the decomposition of the relevant tensors into irreducible components to guarantee that all possible tensor structures are systematically taken into account. We show that only parity even structures appear in the correlation functions. In addition to the previous results obtained in arXiv:1503.04961, it follows that supersymmetry forbids parity odd structures in three-point functions involving the supercurrent and flavour current multiplets.


title: Consensus Control for Decentralized Deep Learning

abstract: Decentralized training of deep learning models enables on-device learning over networks, as well as efficient scaling to large compute clusters. Experiments in earlier works reveal that, even in a data-center setup, decentralized training often suffers from the degradation in the quality of the model: the training and test performance of models trained in a decentralized fashion is in general worse than that of models trained in a centralized fashion, and this performance drop is impacted by parameters such as network size, communication topology and data partitioning. We identify the changing consensus distance between devices as a key parameter to explain the gap between centralized and decentralized training. We show in theory that when the training consensus distance is lower than a critical quantity, decentralized training converges as fast as the centralized counterpart. We empirically validate that the relation between generalization performance and consensus distance is consistent with this theoretical observation. Our empirical insights allow the principled design of better decentralized training schemes that mitigate the performance drop. To this end, we provide practical training guidelines and exemplify its effectiveness on the data-center setup as the important first step.


title: Observations of the long-lasting activity of the distant Comets 29P Schwassmann-Wachmann 1, C/2003 WT42 (LINEAR) and C/2002 VQ94 (LINEAR)

abstract: We investigated three comets, which are active at large heliocentric distances, using observations obtained at the 6-m BTA telescope (SAO RAS, Russia) in the photometric mode of the focal reducer SCORPIO. The three comets, 29P/Schwassmann-Wachmann 1, C/2003 WT42 (LINEAR), and C/2002 VQ94 (LINEAR), were observed after their perihelion passages at heliocentric distances between 5.5 and 7.08 AU. The dust production rates in terms of Afrho was measured for these comets. Using the retrieved values, an average dust production rate was derived under different model assumptions. A tentative calculation of the total mass loss of the comet nucleus within a certain observation period was executed. We calculated the corresponding thickness of the depleted uppermost layer where high-volatile ices completely sublimated. The results obtained in our study strongly support the idea that the observed activity of Comet SW1 requires a permanent demolition of the upper surface layers.


title: Learning Modality-Specific Representations with Self-Supervised Multi-Task Learning for Multimodal Sentiment Analysis

abstract: Representation Learning is a significant and challenging task in multimodal learning. Effective modality representations should contain two parts of characteristics: the consistency and the difference. Due to the unified multimodal annotation, existing methods are restricted in capturing differentiated information. However, additional uni-modal annotations are high time- and labor-cost. In this paper, we design a label generation module based on the self-supervised learning strategy to acquire independent unimodal supervisions. Then, joint training the multi-modal and uni-modal tasks to learn the consistency and difference, respectively. Moreover, during the training stage, we design a weight-adjustment strategy to balance the learning progress among different subtasks. That is to guide the subtasks to focus on samples with a larger difference between modality supervisions. Last, we conduct extensive experiments on three public multimodal baseline datasets. The experimental results validate the reliability and stability of auto-generated unimodal supervisions. On MOSI and MOSEI datasets, our method surpasses the current state-of-the-art methods. On the SIMS dataset, our method achieves comparable performance than human-annotated unimodal labels. The full codes are available at https://github.com/thuiar/Self-MM.


title: Spin drift-diffusion for two-subband quantum wells

abstract: Controlling the spin dynamics and spin lifetimes is one of the main challenges in spintronics. To this end, the study of the spin diffusion in two-dimensional electron gases (2DEGs) shows that when the Rashba and Dresselhaus spin-orbit couplings (SOC) are balanced, a persistent spin helix regime arises. There, a striped spin pattern shows a long lifetime, limited only by the cubic Dresselhaus SOC, and its dynamics can be controlled by in-plane drift fields. Here, we derive a spin diffusion equation for non-degenerate two-subbands 2DEGs. We show that the intersubband scattering rate, which is defined by the overlap of the subband densities, enters as a new nob to control the spin dynamics, and can be controlled by electric fields, being maximum for symmetric quantum wells. We find that for large intersubband couplings the dynamics follow an effective diffusion matrix given by approximately half of the subband-averaged matrices. This extra 1/2 factor arises from Matthiessen's rule summing over the intra- and intersubband scattering rates, and leads to a reduced diffusion constant and larger spin lifetimes. We illustrate our findings with numerical solutions of the diffusion equation with parameters extracted from realistic Schr\"odinger-Poisson calculations.


title: Fast and Accurate Amplitude Demodulation of Wideband Signals

abstract: Amplitude demodulation is a classical operation used in signal processing. For a long time, its effective applications in practice have been limited to narrowband signals. In this work, we generalize amplitude demodulation to wideband signals. We pose demodulation as a recovery problem of an oversampled corrupted signal and introduce special iterative schemes belonging to the family of alternating projection algorithms to solve it. Sensibly chosen structural assumptions on the demodulation outputs allow us to reveal the high inferential accuracy of the method over a rich set of relevant signals. This new approach surpasses current state-of-the-art demodulation techniques apt to wideband signals in computational efficiency by up to many orders of magnitude with no sacrifice in quality. Such performance opens the door for applications of the amplitude demodulation procedure in new contexts. In particular, the new method makes online and large-scale offline data processing feasible, including the calculation of modulator-carrier pairs in higher dimensions and poor sampling conditions, independent of the signal bandwidth. We illustrate the utility and specifics of applications of the new method in practice by using natural speech and synthetic signals.


title: Dynamics of spin-polarized impurity in ultracold Fermi gas

abstract: We show that the motion of spin-polarized impurity (ferron) in ultracold atomic gas is characterized by a certain critical velocity which can be traced back to the amount of spin imbalance inside the impurity. We have calculated the effective mass of ferron in two dimensions. We show that the effective mass scales with the surface of the ferron. We discuss the impact of these findings; in particular, we demonstrate that ferrons become unstable in the vicinity of a vortex.


title: Tamagawa numbers of elliptic curves with prescribed torsion subgroup or isogeny

abstract: We study Tamagawa numbers of elliptic curves with torsion $\mathbb{Z}/2\mathbb{Z}\oplus \mathbb{Z}/14\mathbb{Z}$ over cubic fields and of elliptic curves with an $n-$isogeny over $\mathbb{Q}$, for $n\in\{6,8,10,12,14,16,17,18,19,37,43,67,163\}$. Bruin and Najman proved that every elliptic curve with torsion $\mathbb{Z}/2\mathbb{Z}\oplus \mathbb{Z}/14\mathbb{Z}$ over a cubic field is a base change of an elliptic curve defined over $\mathbb{Q}$. We find that Tamagawa numbers of elliptic curves defined over $\mathbb{Q}$ with torsion $\mathbb{Z}/2\mathbb{Z}\oplus \mathbb{Z}/14\mathbb{Z}$ over a cubic field are always divisible by $14^2$, with each factor $14$ coming from a rational prime with split multiplicative reduction of type $I_{14k},$ one of which is always $p=2.$ The only exception is the curve 1922.e2, with $c_E=c_2=14.$ The same curves defined over cubic fields over which they have torsion subgroup $\mathbb{Z}/2\mathbb{Z}\oplus \mathbb{Z}/14\mathbb{Z}$ turn out to have the Tamagawa number divisible by $14^3$. As for $n-$isogenies, Tamagawa numbers of elliptic curves with an $18-$isogeny must be divisible by 4, while elliptic curves with an $n-$isogeny for the remaining $n$ from the mentioned set must have Tamagawa numbers divisible by 2, except for finite sets of specified curves.