title: Galilean invariant retarded electric interaction of moving charges

abstract: A Galilean invariant description of the retarded electric interaction of two moving charges is carried out, considering the EM action to propagate at the speed of light. Through the altering of the Li\'enard-Wiechert potential (LWP) a new retarded, electric potential called retarded Coulomb potential (RCP) is ordered to the moving charges. RCP depends on the velocities both of the interacting charges. The force law of the electric interaction of moving charges is determined by means of the second order approximation of RCP. The force law obtained is the Galilean invariant Webers force law, surprisingly. The rediscovery of the Webers force law from a retarded electric potential confirms its significance and proves it to be an approximated law, based on retardation. From the fact that the purely electric RCP provides not only the electric, but even the magnetic forces, a substantial ascertainment follows: In Galilean invariant description, magnetic phenomena are the manifestation of the retarded electric interaction exclusively.


title: Quantum annealing in the NISQ era: railway conflict management

abstract: We are in the Noisy Intermediate-Scale Quantum (NISQ) devices' era, in which quantum hardware has become available for application in real-world problems. However, demonstrating the usefulness of such NISQ devices are still rare. In this work, we consider a practical railway dispatching problem: delay and conflict management on single-track railway lines. We examine the issue of train dispatching consequences caused by the arrival of an already delayed train to the network segment being considered. This problem is computationally hard and needs to be solved almost in real-time. We introduce a quadratic unconstrained binary optimization (QUBO) model of this problem, compatible with the emerging quantum annealing technology. The model's instances can be executed on present-day quantum annealers. As a proof-of-concept, we solve selected real-life problems from the Polish railway network using D-Wave quantum annealers. As a reference, we also provide solutions calculated with classical methods, including those relevant to the community (linear integer programming) and a sophisticated algorithm based on tensor networks for solving Ising instances. Our preliminary results illustrate the degree of difficulty of real-life railway instances for the current quantum annealing technology. Moreover, our analysis shows that the new generation of quantum annealers (the advantage system) perform much worse on those instances than its predecessor.


title: The VLSAT-3 Benchmark Suite

abstract: This report presents VLSAT-3 (an acronym for "Very Large Boolean SATisfiability problems"),the third part of a benchmark suite to be used in scientific experimentsand software competitions addressing SAT and SMT (Satisfiability Modulo Theories) solving issues.VLSAT-3 contains 1200 (600~satisfiable and 600~unsatisfiable) quantifier-free first-order logic formulasof increasing complexity, proposed in SMT-LIB format under a permissive Creative Commons license.More than 90% of these benchmarks have been used during the 16th International Satisfiability Modulo TheoriesCompetition (SMT-COMP~2021).


title: PLACE dropout: A Progressive Layer-wise and Channel-wise Dropout for Domain Generalization

abstract: Domain generalization (DG) aims to learn a generic model from multiple observed source domains that generalizes well to arbitrary unseen target domains without further training. The major challenge in DG is that the model inevitably faces a severe overfitting issue due to the domain gap between source and target domains. To mitigate this problem, some dropout-based methods have been proposed to resist overfitting by discarding part of the representation of the intermediate layers. However, we observe that most of these methods only conduct the dropout operation in some specific layers, leading to an insufficient regularization effect on the model. We argue that applying dropout at multiple layers can produce stronger regularization effects, which could alleviate the overfitting problem on source domains more adequately than previous layer-specific dropout methods. In this paper, we develop a novel layer-wise and channel-wise dropout for DG, which randomly selects one layer and then randomly selects its channels to conduct dropout. Particularly, the proposed method can generate a variety of data variants to better deal with the overfitting issue. We also provide theoretical analysis for our dropout method and prove that it can effectively reduce the generalization error bound. Besides, we leverage the progressive scheme to increase the dropout ratio with the training progress, which can gradually boost the difficulty of training the model to enhance its robustness. Extensive experiments on three standard benchmark datasets have demonstrated that our method outperforms several state-of-the-art DG methods. Our code is available at https://github.com/lingeringlight/PLACEdropout.


title: On Baker-Gill-Solovay Oracle Turing Machines and Relativization Barrier

abstract: This work analyses the so-called "Relativization Barrier" with respect to the Baker-Gill-Solovay oracle Turing machine. We show that the {\em diagonalization} technique is a valid mathematical proof technique, but it has some prerequisites when referring to the "relativization barrier."


title: Does Proprietary Software Still Offer Protection of Intellectual Property in the Age of Machine Learning? -- A Case Study using Dual Energy CT Data

abstract: In the domain of medical image processing, medical device manufacturers protect their intellectual property in many cases by shipping only compiled software, i.e. binary code which can be executed but is difficult to be understood by a potential attacker. In this paper, we investigate how well this procedure is able to protect image processing algorithms. In particular, we investigate whether the computation of mono-energetic images and iodine maps from dual energy CT data can be reverse-engineered by machine learning methods. Our results indicate that both can be approximated using only one single slice image as training data at a very high accuracy with structural similarity greater than 0.98 in all investigated cases.

categories: cs.CR cs.CV cs.CY cs.LG eess.IV physics.med-ph


title: Dark Exciton Giant Rabi Oscillations with no External Magnetic Field

abstract: Multi-phonon physics is an emerging field that serves as a test bed for fundamental quantum physics and several applications in metrology, on-chip communication, among others. Quantum acoustic cavities or resonators are devices that are being used to study multi-phonon phenomena both theoretically and experimentally. In particular, we study a system consisting of a semiconductor quantum dot pumped by a driving laser, and coupled to an acoustic cavity. This kind of systems has proven to yield interesting multi-phonon phenomena, but the description of the quantum dot has been limited to a two-level system. This limitation restrains the complexity that a true semiconductor quantum dot can offer. Instead, in this work we consider a model where the quantum dot can have both bright and dark excitons, the latter being particularly useful due to their lower decoherence rates, because they do not present spontaneous photon emission. In this setup, we demonstrate that by fine-tuning the driving laser frequency, one is able to realise giant Rabi oscillations between the vacuum state and a dark exciton state with $N$-phonon bundles. From this, we highlight two outstanding features: first, we are able to create dark states excitations in the quantum dot without the usual external magnetic field needed to do so; and second, in a dissipative scenario where the acoustic cavity and the quantum dot suffer from losses, the system acts as a phonon gun able to emit $N$-phonon bundles.


title: Tropical Poincar\'e duality spaces

abstract: The tropical fundamental class of a rational balanced polyhedral fan induces cap products between tropical cohomology and tropical Borel-Moore homology. When all these cap products are isomorphisms, the fan is said to be a tropical Poincar\'e duality space. If all the stars of faces also are such spaces, such as for fans of matroids, the fan is called a local tropical Poincar\'e duality space. In this article, we first give some necessary conditions for fans to be tropical Poincar\'e duality spaces and a classification in dimension one. Next, we prove that tropical Poincar\'e duality for the stars of all faces of dimension greater than zero and a vanishing condition implies tropical Poincar\'e duality of the fan. This leads to necessary and sufficient conditions for a fan to be a local tropical Poincar\'e duality space. Finally, we use such fans to show that certain abstract balanced polyhedral spaces satisfy tropical Poincar\'e duality.


title: An interferometric method to estimate the eigenvalues of a Non-Hermitian two-level optical system

abstract: Non-Hermitian physics has found a fertile ground in optics. Recently, the study of mode degeneracies, i.e. exceptional points, has led to the discovery of intriguing and counterintuitive phenomena. Degeneracies are typically modeled through the coupled mode theory to determine the behaviour of eigenstates and eigenvalues. However, the complex nature of the eigenvalues makes hard their direct characterization from the response spectrum. Here, we demonstrate that a coherent interferometric excitation allows estimating both the real and imaginary parts of the eigenvalues. We studied the clockwise and counter-clockwise modes in an optical microresonators both in the case of Hermitian and non-Hermitian intermodal coupling. We show the conditions by which a resonant doublet, due to the dissipative coupling of counter-propagating modes caused by surface roughness backscattering, merges to a single Lorentzian. This permits to estimate the optimal quality factor of the microresonator in the absence of modal coupling caused by backscattering. Furthermore, we demonstrate that a taiji microresonator working at an exceptional point shows a degeneracy splitting only in one propagation direction and not in the other. This follows from the strongly non-Hermitian intermodal coupling caused by the inner S-shaped waveguide.


title: Pre-main sequence evolution of low-mass stars in Eddington-inspired Born-Infeld gravity

abstract: We study three aspects of the early-evolutionary phases in low-mass stars within Eddington-inspired Born-Infeld (EiBI) gravity, a viable extension of General Relativity. These aspects are concerned with the Hayashi tracks (i.e. the effective temperature-luminosity relation); the minimum mass required to belong to the main sequence; and the maximum mass allowed for a fully convective star within the main sequence. In all cases we find a dependence of these quantities not only on the theory's parameter, but also on the star's central density, a feature previously found in Palatini $f(R)$ gravity. Using this, we investigate the evolution of these quantities with the (sign of the) EiBI parameter, finding a shift in the Hayashi tracks in opposite directions in the positive/negative branches of it, and an increase (decrease) for positive (negative) parameter in the two masses above. We use these results to ellaborate on the chances to seek for traces of new physics in low-mass stars within this theory.


title: In-Network Processing for Low-Latency Industrial Anomaly Detection in Softwarized Networks

abstract: Modern manufacturers are currently undertaking the integration of novel digital technologies - such as 5G-based wireless networks, the Internet of Things (IoT), and cloud computing - to elevate their production process to a brand new level, the level of smart factories. In the setting of a modern smart factory, time-critical applications are increasingly important to facilitate efficient and safe production. However, these applications suffer from delays in data transmission and processing due to the high density of wireless sensors and the large volumes of data that they generate. As the advent of next-generation networks has made network nodes intelligent and capable of handling multiple network functions, the increased computational power of the nodes makes it possible to offload some of the computational overhead. In this paper, we show for the first time our IA-Net-Lite industrial anomaly detection system with the novel capability of in-network data processing. IA-Net-Lite utilizes intelligent network devices to combine data transmission and processing, as well as to progressively filter redundant data in order to optimize service latency. By testing in a practical network emulator, we showed that the proposed approach can reduce the service latency by up to 40%. Moreover, the benefits of our approach could potentially be exploited in other large-volume and artificial intelligence applications.


title: Representations of Deligne-Mostow lattices into PGL(3, C) -- Part II

abstract: We complete the classification of type preserving representations of Deligne-Mostow lattices with 3-fold symmetry into PGL(3,C) started in arXiv:2003.06466. In particular, we show local rigidity for all the representations where the generators we chose are of the same type as the generators of the Deligne-Mostow lattices. We use formal computations in SAGE and MAPLE to obtain the results. The code files are available on GitHub.


title: A low-cost wave-solar powered Unmanned Surface Vehicle

abstract: This paper presents a prototype of a low-cost Unmanned Surface Vehicle (USV) that is operated by wave and solar energy which can be used to minimize the cost of ocean data collection. The current prototype is a compact USV, with a length of 1.2m that can be deployed and recovered by two persons. The design includes an electrically operated winch that can be used to retract and lower the underwater unit. Several elements of the design make use of additive manufacturing and inexpensive materials. The vehicle can be controlled using radio frequency (RF) and a satellite communication, through a custom developed web application. Both the surface and underwater units were optimized with regard to drag, lift, weight, and price by using recommendation of previous research work and advanced materials. The USV could be used in water condition monitoring by measuring several parameters, such as dissolved oxygen, salinity, temperature, and pH.


title: Cosmological model with time varying deceleration parameter in $F(R,G)$ gravity

abstract: In this paper, we study the dynamical behaviour of the Universe in the $F(R,G)$ theory of gravity, where $R$ and $G$ respectively denote the Ricci scalar and Gauss-Bonnet invariant. Our wide analysis encompasses the energy conditions, cosmographic parameters, $Om(z)$ diagnostic, stability and the viability of reconstructing the referred model through a scalar field formalism. The model obtained here shows the quintessence like behaviour at late times.


title: Mass transfer and tidally tilted pulsation in the Algol-type system TZ Dra

abstract: Oscillating eclipsing Algols (oEAs) are remarkable systems which allow us to determine accurate fundamental stellar parameters (mass, radius) and probe the stellar interiors through pulsations. TZ\,Dra is an oEA system containing a $\delta$ Scuti component. To examine particular characteristics of such close systems including pulsations and mass transfer, we present a detailed photometric and spectroscopic study of TZ\,Dra. With the analysis of high-resolution spectra, the orbital parameters were determined by the radial velocity analysis and the atmospheric parameters were derived for the primary component. The binary modelling and the pulsational frequency analysis was carried out using the TESS data set. The H$\alpha$ line profiles show the signature of mass transfer from the cool to the hot binary component. The conclusion of mass transfer/mass loss in the system was supported by the analysis of the orbital period changes. As a result, it was found that there is $3.52 \times 10^{-9}$ $M_\odot$/year mass loss from the system most probably through the hotspot and stellar winds. Additionally, most pulsation frequencies originating from the primary component were found to be spaced by harmonics of the orbital frequencies in particular, twelve doublets spaced by $2f_{\rm orb}$ were detected from which we infer that this star a tidally tilted pulsator. A mean p-mode frequency spacing of $\approx 7.2 $d$^{-1}$ was found as well.


title: Piecewise survival models: a change-point analysis on herpes zoster associated pain data revisited and extended

abstract: For many diseases it is reasonable to assume that the hazard rate is not constant across time, but also that it changes in different time intervals. To capture this, we work here with a piecewise survival model. One of the major problems in such piecewise models is to determine the time points of change of the hazard rate. From the practical point of view this can provide very important information as it may reflect changes in the progress of a disease. We present piecewise Weibull regression models with covariates. The time points where change occurs are assumed unknown and need to be estimated. The equality of hazard rates across the distinct phases is also examined to verify the exact number of phases. An example based on herpes zoster data has been used to demonstrate the usefulness of the developed methodology.


title: Hidden variables in Mermin GHZ machine with quantum assistance

abstract: Three experiments, with an IBM superconducting quantum computer, are presented, where the setting combinations on a three qubit GHZ(like) state were selected by two additional assistant qubits. The average of the polynomial of Mermin for the three entangled qubits was calculated; the results showed violation of the inequality of Mermin. However, given that the assistant qubits selected, imposed and informed the type of settings, it was possible to interpret the results in terms of arranged relations among hidden variables of the assistants and the entanglement BEFORE each shot; the hidden variables may or may not be local depending on the way the qubits were initialized.


title: Low-rank Tensor Decomposition for Compression of Convolutional Neural Networks Using Funnel Regularization

abstract: Tensor decomposition is one of the fundamental technique for model compression of deep convolution neural networks owing to its ability to reveal the latent relations among complex structures. However, most existing methods compress the networks layer by layer, which cannot provide a satisfactory solution to achieve global optimization. In this paper, we proposed a model reduction method to compress the pre-trained networks using low-rank tensor decomposition of the convolution layers. Our method is based on the optimization techniques to select the proper ranks of decomposed network layers. A new regularization method, called funnel function, is proposed to suppress the unimportant factors during the compression, so the proper ranks can be revealed much easier. The experimental results show that our algorithm can reduce more model parameters than other tensor compression methods. For ResNet18 with ImageNet2012, our reduced model can reach more than twi times speed up in terms of GMAC with merely 0.7% Top-1 accuracy drop, which outperforms most existing methods in both metrics.


title: $SU(3)$ breaking effects in $B$ and $D$ meson lifetimes

abstract: In the heavy quark expansion (HQE) of the total decay rates of $B_s$ and $D_s^+$ mesons non-perturbative matrix elements of four quark operators are arising as phase space enhanced contributions. We present the first determination of $m_s$ effects to the dimension six matrix elements of these four quark operators via a heavy quark effective theory (HQET) sum rule analysis. In addition we calculate for the first time eye contractions of the four quark operators as well as matrix elements of penguin operators. For the perturbative part we solve the 3-loop contribution to the sum rule and we evaluate condensate contributions. In this study we work in the strict HQET limit and our results can also be used to estimate the size of the matrix element of the Darwin operator via equations of motion.


title: Blockchain Synchronous Trust Consensus Model

abstract: This work introduces a novel approach for the governance of a blockchain containing social constructs and technical viability for widescale applications for the next generation of distributed ledgers. Functional requirements for this new blockchain distributed ledger (BDL) were garnered from an analysis of the needs for large-scale applications. Applied research was employed as part of this endeavor to test the practicality and scalability of the solution outline. Novel features in this application draw together controls and enforcement for cybersecurity, digital content management, licensing, and configuration management. The Synchronous Trust Consensus Model applied research project named Project Philos was sponsored by the BlockChain Development Community (BCDC) with support from the University of Colorado. Research has followed both theorized conceptual and theory-to-practice models to prove the scientific soundness and the viability of incentive for community engagement. Results show that this new model proves the feasibility of an indefinitely expandable blockchain distributed ledger capability, while also providing a new participant incentive that is highly effective in engaging a community of practitioners.


title: On the quantum-mechanical singular harmonic oscillator

abstract: We obtain the eigenvalues and eigenfunctions of the singular harmonic oscillator $V(x)=\alpha/(2x^2)+x^2/2$ by means of the simple and straightforward Frobenius (power-series) method. From the behaviour of the eigenfunctions at origin we derive two branches for the eigenvalues for negative values of $\alpha$. We discuss the well known fact that there are square-integrable solutions only for some allowed discrete values of the energy.


title: Hard Sample Aware Noise Robust Learning for Histopathology Image Classification

abstract: Deep learning-based histopathology image classification is a key technique to help physicians in improving the accuracy and promptness of cancer diagnosis. However, the noisy labels are often inevitable in the complex manual annotation process, and thus mislead the training of the classification model. In this work, we introduce a novel hard sample aware noise robust learning method for histopathology image classification. To distinguish the informative hard samples from the harmful noisy ones, we build an easy/hard/noisy (EHN) detection model by using the sample training history. Then we integrate the EHN into a self-training architecture to lower the noise rate through gradually label correction. With the obtained almost clean dataset, we further propose a noise suppressing and hard enhancing (NSHE) scheme to train the noise robust model. Compared with the previous works, our method can save more clean samples and can be directly applied to the real-world noisy dataset scenario without using a clean subset. Experimental results demonstrate that the proposed scheme outperforms the current state-of-the-art methods in both the synthetic and real-world noisy datasets. The source code and data are available at https://github.com/bupt-ai-cz/HSA-NRL/.


title: Safe Distillation Box

abstract: Knowledge distillation (KD) has recently emerged as a powerful strategy to transfer knowledge from a pre-trained teacher model to a lightweight student, and has demonstrated its unprecedented success over a wide spectrum of applications. In spite of the encouraging results, the KD process per se poses a potential threat to network ownership protection, since the knowledge contained in network can be effortlessly distilled and hence exposed to a malicious user. In this paper, we propose a novel framework, termed as Safe Distillation Box (SDB), that allows us to wrap a pre-trained model in a virtual box for intellectual property protection. Specifically, SDB preserves the inference capability of the wrapped model to all users, but precludes KD from unauthorized users. For authorized users, on the other hand, SDB carries out a knowledge augmentation scheme to strengthen the KD performances and the results of the student model. In other words, all users may employ a model in SDB for inference, but only authorized users get access to KD from the model. The proposed SDB imposes no constraints over the model architecture, and may readily serve as a plug-and-play solution to protect the ownership of a pre-trained network. Experiments across various datasets and architectures demonstrate that, with SDB, the performance of an unauthorized KD drops significantly while that of an authorized gets enhanced, demonstrating the effectiveness of SDB.


title: Noise Distribution Adaptive Self-Supervised Image Denoising using Tweedie Distribution and Score Matching

abstract: Tweedie distributions are a special case of exponential dispersion models, which are often used in classical statistics as distributions for generalized linear models. Here, we reveal that Tweedie distributions also play key roles in modern deep learning era, leading to a distribution independent self-supervised image denoising formula without clean reference images. Specifically, by combining with the recent Noise2Score self-supervised image denoising approach and the saddle point approximation of Tweedie distribution, we can provide a general closed-form denoising formula that can be used for large classes of noise distributions without ever knowing the underlying noise distribution. Similar to the original Noise2Score, the new approach is composed of two successive steps: score matching using perturbed noisy images, followed by a closed form image denoising formula via distribution-independent Tweedie's formula. This also suggests a systematic algorithm to estimate the noise model and noise parameters for a given noisy image data set. Through extensive experiments, we demonstrate that the proposed method can accurately estimate noise models and parameters, and provide the state-of-the-art self-supervised image denoising performance in the benchmark dataset and real-world dataset.


title: Plasmon resonances of nanorods in transverse electromagnetic scattering

abstract: Plasmon resonance is the resonant oscillation of conduction electrons at the interface between negative and positive permittivity material stimulated by incident light, which forms the fundamental basis of many cutting-edge industrial applications. We are concerned with the quantitative theoretical understanding of this peculiar resonance phenomenon. It is known that the occurrence of plasmon resonance as well as its quantitative behaviours critically depend on the geometry of the material structure, the corresponding material parameters and the operating wave frequency, which are delicately coupled together. In this paper, we study the plasmon resonance for a 2D nanorod structure, which presents an anisotropic geometry and arises in the transverse electromagnetic scattering. We present delicate spectral and asymptotic analysis to establish the accurate resonant conditions as well as sharply characterize the quantitative behaviours of the resonant field.


title: Modeling and Predicting Blood Flow Characteristics through Double Stenosed Artery from CFD simulation using Deep Learning Models

abstract: Establishing patient-specific finite element analysis (FEA) models for computational fluid dynamics (CFD) of double stenosed artery models involves time and effort, restricting physicians' ability to respond quickly in time-critical medical applications. Such issues might be addressed by training deep learning (DL) models to learn and predict blood flow characteristics using a dataset generated by CFD simulations of simplified double stenosed artery models with different configurations. When blood flow patterns are compared through an actual double stenosed artery model, derived from IVUS imaging, it is revealed that the sinusoidal approximation of stenosed neck geometry, which has been widely used in previous research works, fails to effectively represent the effects of a real constriction. As a result, a novel geometric representation of the constricted neck is proposed which, in terms of a generalized simplified model, outperforms the former assumption. The sequential change in artery lumen diameter and flow parameters along the length of the vessel presented opportunities for the use of LSTM and GRU DL models. However, with the small dataset of short lengths of doubly constricted blood arteries, the basic neural network model outperforms the specialized RNNs for most flow properties. LSTM, on the other hand, performs better for predicting flow properties with large fluctuations, such as varying blood pressure over the length of the vessels. Despite having good overall accuracies in training and testing across all the properties for the vessels in the dataset, the GRU model underperforms for an individual vessel flow prediction in all cases. The results also point to the need of individually optimized hyperparameters for each property in any model rather than aiming to achieve overall good performance across all outputs with a single set of hyperparameters.


title: Universality of the halo mass function in modified gravity cosmologies

abstract: We study the halo mass function (HMF) in modified gravity (MG) models using a set of large $N$-body simulations -- the ELEPHANT suite. We consider two popular beyond-general relativity scenarios: the Hu-Sawicki chameleon $f(R)$ model and the normal branch of the Dvali-Gabadadze-Porrati braneworld (nDGP). We show that in MG, analytic formulation based on the Press-Schechter framework offers a grossly inaccurate description of the HMF. We find, however, that once the HMF is expressed in terms of the dimensionless multiplicity function, it approximately assumes a redshift-independent universal character for all the models. Exploiting this property, we propose universal fits for the MG HMF in terms of their fractional departures from the $\mathrm{\Lambda \text{CDM}}$ case. We find two enclosed formulas, one for $f(R)$ and another for nDGP, that provide a reliable description of the HMF over the mass range covered by the simulations. These are accurate to a few percent with respect to the $N$-body data. We test the extrapolation potential of our fits against separate simulations with a different cosmological background and mass resolution, and find very good accuracy, within $\sim 10\%$. A particularly interesting finding from our analysis is a Gaussian-like shape of the HMF deviation that seems to appear universally across the whole $f(R)$ family, peaking at a mass variance scale characteristic for each $f(R)$ variant. We attribute this behavior to the specific physics of the environmentally-dependent chameleon screening models.


title: A Comparison of Estimand and Estimation Strategies for Clinical Trials in Early Parkinson's Disease

abstract: Parkinson's disease (PD) is a chronic, degenerative neurological disorder. PD cannot be prevented, slowed or cured as of today but highly effective symptomatic treatments are available. We consider relevant estimands and treatment effect estimators for randomized trials of a novel treatment which aims to slow down disease progression versus placebo in early, untreated PD. A commonly used endpoint in PD trials is the MDS-Unified Parkinson's Disease Rating Scale (MDS-UPDRS), which is longitudinally assessed at scheduled visits. The most important intercurrent events (ICEs) which affect the interpretation of the MDS-UPDRS are study treatment discontinuations and initiations of symptomatic treatment. Different estimand strategies are discussed and hypothetical or treatment policy strategies, respectively, for different types of ICEs seem most appropriate in this context. Several estimators based on multiple imputation which target these estimands are proposed and compared in terms of bias, mean-squared error, and power in a simulation study. The investigated estimators include methods based on a missing-at-random (MAR) assumption, with and without the inclusion of time-varying ICE-indicators, as well as reference-based imputation methods. Simulation parameters are motivated by data analyses of a cohort study from the Parkinson's Progression Markers Initiative (PPMI).


title: Efficient joint noise removal and multi exposure fusion

abstract: Multi-exposure fusion (MEF) is a technique for combining different images of the same scene acquired with different exposure settings into a single image. All the proposed MEF algorithms combine the set of images, somehow choosing from each one the part with better exposure. We propose a novel multi-exposure image fusion chain taking into account noise removal. The novel method takes advantage of DCT processing and the multi-image nature of the MEF problem. We propose a joint fusion and denoising strategy taking advantage of spatio-temporal patch selection and collaborative 3D thresholding. The overall strategy permits to denoise and fuse the set of images without the need of recovering each denoised exposure image, leading to a very efficient procedure.


title: Observation of the temperature and barometric effects on the cosmic muon flux by the DANSS detector

abstract: The DANSS detector is located directly below a commercial reactor core at the Kalinin Nuclear Power Plant. Such a position provides an overburden about 50 m.w.e. in vertical direction. In terms of the cosmic rays it occupies an intermediate position between surface and underground detectors. The sensitive volume of the detector is a cubic meter of plastic scintillator with fine segmentation and combined PMT and SiPM readout, surrounded by multilayer passive and active shielding. The detector can reconstruct muon tracks passing through its sensitive volume. The main physics goal of the DANSS experiment implies the antineutrino spectra measurements at various distances from the source. This is achieved by means of a lifting platform so that the data is taken in three positions - 10.9, 11.9 and 12.9 meters from the reactor core. The muon data were collected for nearly four calendar years. The overburden parameters $\langle E_{thr}\cos\theta \rangle$ and $\langle E_{thr} \rangle$, as well as the temperature and barometric correlation coefficients are evaluated separately for the three detector positions and, in each position, in three ranges of the zenith angle - for nearly vertical muons with $\cos\theta>0.9$, for nearly horizontal muons with $\cos\theta<0.36$, and for the whole upper hemisphere.


title: Construction de variables a l'aide de classifieurs comme aide a la regression

abstract: This paper proposes a method for the automatic creation of variables (in the case of regression) that complement the information contained in the initial input vector. The method works as a pre-processing step in which the continuous values of the variable to be regressed are discretized into a set of intervals which are then used to define value thresholds. Then classifiers are trained to predict whether the value to be regressed is less than or equal to each of these thresholds. The different outputs of the classifiers are then concatenated in the form of an additional vector of variables that enriches the initial vector of the regression problem. The implemented system can thus be considered as a generic pre-processing tool. We tested the proposed enrichment method with 5 types of regressors and evaluated it in 33 regression datasets. Our experimental results confirm the interest of the approach.


title: Two-stage Deep Stacked Autoencoder with Shallow Learning for Network Intrusion Detection System

abstract: Sparse events, such as malign attacks in real-time network traffic, have caused big organisations an immense hike in revenue loss. This is due to the excessive growth of the network and its exposure to a plethora of people. The standard methods used to detect intrusions are not promising and have significant failure to identify new malware. Moreover, the challenges in handling high volume data with sparsity, high false positives, fewer detection rates in minor class, training time and feature engineering of the dimensionality of data has promoted deep learning to take over the task with less time and great results. The existing system needs improvement in solving real-time network traffic issues along with feature engineering. Our proposed work overcomes these challenges by giving promising results using deep-stacked autoencoders in two stages. The two-stage deep learning combines with shallow learning using the random forest for classification in the second stage. This made the model get well with the latest Canadian Institute for Cybersecurity - Intrusion Detection System 2017 (CICIDS-2017) dataset. Zero false positives with admirable detection accuracy were achieved.


title: Correlation Based Feature Subset Selection for Multivariate Time-Series Data

abstract: Correlations in streams of multivariate time series data means that typically, only a small subset of the features are required for a given data mining task. In this paper, we propose a technique which we call Merit Score for Time-Series data (MSTS) that does feature subset selection based on the correlation patterns of single feature classifier outputs. We assign a Merit Score to the feature subsets which is used as the basis for selecting 'good' feature subsets. The proposed technique is evaluated on datasets from the UEA multivariate time series archive and is compared against a Wrapper approach for feature subset selection. MSTS is shown to be effective for feature subset selection and is in particular effective as a data reduction technique. MSTS is shown here to be computationally more efficient than the Wrapper strategy in selecting a suitable feature subset, being more than 100 times faster for some larger datasets while also maintaining a good classification accuracy.


title: Analysis of TESS field eclipsing binary star V948 Her: a pulsating or non-pulsating star?

abstract: Pulsating stars occupy a significant place in the H-R diagram and it was thought that all stars inside the classical instability strip should pulsate. However, recent studies showed that there are many non-pulsating stars placed inside the classical instability strip. The existence of these non-pulsating stars is still a mystery. To deeply understand the properties of these non-pulsating and pulsating stars, one needs precise fundamental stellar parameters (e.g mass). For this purpose, the eclipsing binaries are unique systems. Hence, in this study, we present the TESS data analysis of one candidate pulsating eclipsing binary system V948\,Her. TESS data were used for the binary modelling with the literature radial velocity measurements and the precise fundamental parameters of the system were obtained. The system's age was derived as 1$\pm$0.24 Gyr. The positions of the binary components in the H-R diagram were examined and the primary component was found inside the $\delta$\,Scuti instability strip. However, in the frequency analysis of TESS data, we found no significant pulsation frequencies. Only the harmonics of the orbital periods were obtained in the analysis. Therefore, the system was classified as a non-pulsator. V948\,Her is an important object to understand the nature of non-pulsating stars inside the $\delta$\,Scuti instability strip.


title: Critical assessment of machine-learned repulsive potentials for the Density Functional based Tight-Binding method: a case study for pure silicon

abstract: We investigate the feasability of improving the semi-empirical density functional based tight-binding method (DFTB) through a general and transferable many-body repulsive potential for pure silicon using a common machine-learning framework. Atomic environments using atom centered symmetry functions fed into flexible high-dimensional neural-networks allow to overcome the limited pair potentials used until now, with the ability to train simultaneously on a large variety of systems. We achieve an improvement on bulk systems, with good performance on energetic, vibrational and structural properties. Contrarily, there are difficulties for clusters due to surface effects. To deepen the discussion, we also put these results into perspective with two fully machine-learned numerical potentials for silicon from the literature. This allows us to identify both the transferability of such approaches together with the impact of narrowing the role of machine-learning models to reproduce only a part of the total energy.


title: Realizing Repeated Quantum Error Correction in a Distance-Three Surface Code

abstract: Quantum computers hold the promise of solving computational problems which are intractable using conventional methods. For fault-tolerant operation quantum computers must correct errors occurring due to unavoidable decoherence and limited control accuracy. Here, we demonstrate quantum error correction using the surface code, which is known for its exceptionally high tolerance to errors. Using 17 physical qubits in a superconducting circuit we encode quantum information in a distance-three logical qubit building up on recent distance-two error detection experiments. In an error correction cycle taking only $1.1\,\mu$s, we demonstrate the preservation of four cardinal states of the logical qubit. Repeatedly executing the cycle, we measure and decode both bit- and phase-flip error syndromes using a minimum-weight perfect-matching algorithm in an error-model-free approach and apply corrections in postprocessing. We find a low error probability of $3\,\%$ per cycle when rejecting experimental runs in which leakage is detected. The measured characteristics of our device agree well with a numerical model. Our demonstration of repeated, fast and high-performance quantum error correction cycles, together with recent advances in ion traps, support our understanding that fault-tolerant quantum computation will be practically realizable.


title: A census of optically dark massive galaxies in the early Universe from magnification by lensing galaxy clusters

abstract: We present ALMA 870um and JCMT SCUBA2 850um dust continuum observations of a sample of optically dark and strongly lensed galaxies in the cluster fields. The ALMA and SCUBA2 observations reach a median rms of about 0.11 mJy and 0.44 mJy, respectively, with the latter close to the confusion limit of the data at 850um. This represents one of the most sensitive searches for dust emission in optically dark galaxies. We detect the dust emission in 12 out of 15 galaxies at >3.8 sigma, corresponding to a detection rate of 80 per cent. Thanks to the gravitational lensing, our observations reach a deeper limiting flux than previous surveys in blank fields by a factor of 3. We estimate delensed infrared luminosities in the range log(LIR)=11.5-12.7 Lsun, which correspond to dust-obscured star formation rates (SFRs) of 30 to 520 Msun per year. Stellar population fits to the optical-to-NIR photometric data yield a median redshift z=4.26 and de-lensed stellar mass log(Mstar)=10.78 Msun. They contribute a lensing-corrected star-formation rate density at least an order of magnitude higher than that of equivalently massive UV-selected galaxies at z>3. The results suggest that there is a missing population of massive star-forming galaxies in the early Universe, which may dominate the SFR density at the massive end. Five optically dark galaxies are located within r<50 arcsec in one cluster field, representing a potential overdensity structure that has a physical origin at a confidence level >99.974% from Poisson statistics. Follow-up spectroscopic observations with ALMA and JWST are crucial to confirm whether it is associated with a protocluster at similar redshifts.


title: CapsProm: A Capsule Network For Promoter Prediction

abstract: Locating the promoter region in DNA sequences is of paramount importance in the field of bioinformatics. This is a problem widely studied in the literature, however, not yet fully resolved. Some researchers have presented remarkable results using convolution networks, that allowed the automatic extraction of features from a DNA chain. However, a universal architecture that could generalize to several organisms has not yet been achieved, and thus, requiring researchers to seek new architectures and hyperparameters for each new organism evaluated. In this work, we propose a versatile architecture, based on capsule network, that can accurately identify promoter sequences in raw DNA data from seven different organisms, eukaryotic, and prokaryotic. Our model, the CapsProm, could assist in the transfer of learning between organisms and expand its applicability. Furthermore the CapsProm showed competitive results, overcoming the baseline method in five out of seven of the tested datasets (F1-score). The models and source code are made available at https://github.com/lauromoraes/CapsNet-promoter.


title: Bonding characteristics of the interfacial buffer layer in epitaxial graphene via density functional theory

abstract: Monolayer epitaxial graphene is an appropriate candidate for a wide variety of electronic and optical applications. One advantage of growing graphene on the Si face of SiC is that it develops as a single crystal, as does the layer underneath, commonly referred to as the interfacial buffer layer. The properties of this supporting layer include a band gap, making it of interest to groups seeking to build devices with on-off capabilities. In this work, using density functional theory, we have calculated the bonding characteristics of the buffer layer to the SiC substrate beneath. These calculations were used to determine a periodic length between the covalent bonds acting as anchor points in this interface. Additionally, it is evident that the formation of these anchor points depends on the lattice mismatch between the graphene layer and SiC.


title: Image Compressed Sensing Using Non-local Neural Network

abstract: Deep network-based image Compressed Sensing (CS) has attracted much attention in recent years. However, the existing deep network-based CS schemes either reconstruct the target image in a block-by-block manner that leads to serious block artifacts or train the deep network as a black box that brings about limited insights of image prior knowledge. In this paper, a novel image CS framework using non-local neural network (NL-CSNet) is proposed, which utilizes the non-local self-similarity priors with deep network to improve the reconstruction quality. In the proposed NL-CSNet, two non-local subnetworks are constructed for utilizing the non-local self-similarity priors in the measurement domain and the multi-scale feature domain respectively. Specifically, in the subnetwork of measurement domain, the long-distance dependencies between the measurements of different image blocks are established for better initial reconstruction. Analogically, in the subnetwork of multi-scale feature domain, the affinities between the dense feature representations are explored in the multi-scale space for deep reconstruction. Furthermore, a novel loss function is developed to enhance the coupling between the non-local representations, which also enables an end-to-end training of NL-CSNet. Extensive experiments manifest that NL-CSNet outperforms existing state-of-the-art CS methods, while maintaining fast computational speed.


title: Limits to the sensitivity of a rare-earth-enabled cryogenic vibration sensor

abstract: Cryogenics is a pivotal aspect in the development of quantum technologies. Closed-cycle devices have recently emerged as an environmentally friendly and low-maintenance alternative to liquid helium cryostats. Yet the larger level of vibrations in dry cryocoolers forbids their use in most sensitive applications. In a recent work, we have proposed an inertial, broadband, contactless sensor based on the piezospectroscopic effect, ie the natural sensitivity of optical lines to strain exhibited by impurities in solids. This sensor builds on the exceptional spectroscopic properties of rare earth ions and operates below 4K, where spectral hole burning considerably enhances the sensitivity. In this paper, we investigate the fundamental and technical limitations of this vibration sensor by comparing a rigid sample attachment to cold stage of a pulse-tube cryocooler and a custom-designed exchange gas chamber for acoustic isolation.

categories: physics.ins-det cond-mat.mtrl-sci physics.atom-ph quant-ph


title: Single crystal monolithic up-converter solar cell device tandems with integrated optics

abstract: Solar photons possessing energy less than the band-gap of a single-junction solar cell can be utilized via the up-conversion (UC) of two or more photons, resulting in the emission of a single above-bandgap photon. Due to the non-linear nature of UC, highly concentrated light is required, which is typically much greater than the practical concentration limits of a solar cell. It has been proposed that concentrating up-conversion solar cells (UC-SC) with optical elements integrated into the device could help realize the high solar irradiance required. To avoid scattering problems arising from common UC materials based on micro-crystalline powders, in this work concentrators are investigated with mono-crystalline up-converters in silicon-based tandem devices. An external quantum efficiency (EQE) of 6% with 1493 nm infrared illumination at $876 W/m^2$ was obtained in upconverter device with concave integrated optics. At an irradiance higher than $90 W/m^2$ (equivalent to 2.95x in the 1450-1600 nm range), the non-concentrating UC-SC exhibited 1.5x higher EQE than the UC-SC with CPC, while below $90 W/m^2$ the CPC UC-SC exhibited 1.95x higher EQE than the non-concentrating reference device. Due to the negligible scattering of the UC layer, the distribution of localized irradiance is revealed along with its effect on the performance of devices. It is found that irradiance is accumulated within the first 1 mm of the UC layer with peaks at variable depths according to the concentrating scheme. These results suggest ample space for improved up-conversion devices by using integrated optics.


title: Enhancing the SVD Compression

abstract: Orthonormality is the foundation of matrix decomposition. For example, Singular Value Decomposition (SVD) implements the compression by factoring a matrix with orthonormal parts and is pervasively utilized in various fields. Orthonormality, however, inherently includes constraints that would induce redundant degrees of freedom, preventing SVD from deeper compression and even making it frustrated as the data fidelity is strictly required. In this paper, we theoretically prove that these redundancies resulted by orthonormality can be completely eliminated in a lossless manner. An enhanced version of SVD, namely E-SVD, is accordingly established to losslessly and quickly release constraints and recover the orthonormal parts in SVD by avoiding multiple matrix multiplications. According to the theory, advantages of E-SVD over SVD become increasingly evident with the rising requirement of data fidelity. In particular, E-SVD will reduce 25% storage units as SVD reaches its limitation and fails to compress data. Empirical evidences from typical scenarios of remote sensing and Internet of things further justify our theory and consistently demonstrate the superiority of E-SVD in compression. The presented theory sheds insightful lights on the constraint solution in orthonormal matrices and E-SVD, guaranteed by which will profoundly enhance the SVD-based compression in the context of explosive growth in both data acquisition and fidelity levels.


title: Adaptive smoothing mini-batch stochastic accelerated gradient method for nonsmooth convex stochastic composite optimization

abstract: This paper considers a class of convex constrained nonsmooth convex stochastic composite optimization problems whose objective function is given by the summation of a differentiable convex component, together with a general nonsmooth but convex component. The nonsmooth component is not required to have easily obtainable proximal operator, or have the max structure that the smoothing technique in [Nesterov, 2005] can be used. In order to solve such type problems, we propose an adaptive smoothing mini-batch stochastic accelerated gradient (AdaSMSAG) method, which combines the stochastic approximation method, the Nesterov's accelerated gradient method, and the smoothing methods that allow general smoothing approximations. Convergence of the method is established. Moreover, the order of the worst-case iteration complexity is better than that of the state-of-the-art stochastic approximation methods. Numerical results are provided to illustrate the efficiency of the proposed AdaSMSAG method for a risk management in portfolio optimization and a family of Wasserstein distributionally robust support vector machine problems with real data.


title: Incompatibility as a resource for programmable quantum instruments

abstract: Quantum instruments represent the most general type of quantum measurement, as they incorporate processes with both classical and quantum outputs. In many scenarios, it may be desirable to have some "on-demand" device that is capable of implementing one of many possible instruments whenever the experimenter desires. We refer to such objects as programmable instrument devices (PIDs), and this paper studies PIDs from a resource-theoretic perspective. A physically important class of PIDs are those that do not require quantum memories to implement, and these are naturally "free" in this resource theory. Additionally, these free objects correspond precisely to the class of unsteerable channel assemblages in the study of channel steering. The traditional notion of measurement incompatibility emerges as a resource in this theory since any PID controlling an incompatible family of instruments requires a quantum memory to build. We identify an incompatibility preorder between PIDs based on whether one can be transformed into another using processes that do not require additional quantum memories. Necessary and sufficient conditions are derived for when such transformations are possible based on how well certain guessing games can be played using a given PID. Ultimately our results provide an operational characterization of incompatibility, and they offer semi-device-independent tests for incompatibility in the most general types of quantum instruments.


title: A Bayesian take on option pricing with Gaussian processes

abstract: Local volatility is a versatile option pricing model due to its state dependent diffusion coefficient. Calibration is, however, non-trivial as it involves both proposing a hypothesis model of the latent function and a method for fitting it to data. In this paper we present novel Bayesian inference with Gaussian process priors. We obtain a rich representation of the local volatility function with a probabilistic notion of uncertainty attached to the calibrate. We propose an inference algorithm and apply our approach to S&P 500 market data.


title: GKS: Graph-based Knowledge Selector for Task-oriented Dialog System

abstract: In previous research, knowledge-selection tasks mostly rely on language model-based methods or knowledge ranking. However, while approaches that rely on the language models take all knowledge as sequential input, knowledge does not contain sequential information in most circumstances. On the other hand, the knowledge-ranking methods leverage dialog history and each given knowledge snippet separately, but they do not consider information between knowledge snippets. In the Tenth Dialog System Technology Challenges (DSTC10), we participated in the second Knowledge-grounded Task-oriented Dialogue Modeling on Spoken Conversations. To deal with the problems mentioned above, we modified training methods based on state-of-the-art (SOTA) models for the first and third sub-tasks. As for the second sub-task of knowledge selection, we proposed Graph-Knowledge Selector (GKS), utilizing a graph-attention base model incorporated with the language model. GKS makes knowledge-selection decisions in the dialog by simultaneously considering each knowledge embedding generated from the language model without sequential features. Moreover, GKS leverages considerable knowledge in decision-making and takes relations across knowledge as part of the selection process. As a result, GKS outperforms several SOTA models proposed in the data-set on knowledge selection from the Ninth Dialog System Technology Challenges (DSTC9).


title: Central exclusive production of axial-vector $f_{1}$ mesons in proton-proton collisions within the tensor-pomeron approach

abstract: We discuss the central exclusive production of $f_{1}$ mesons in proton-proton collisions. The diffractive pomeron-pomeron fusion process within the tensor-pomeron approach is considered. Two ways to construct the pomeron-pomeron-$f_{1}$ coupling are discussed. The theoretical calculation of coupling constants is a challenging problem of nonperturbative QCD. We adjust the parameters of the model to the WA102 experimental data. The total cross section and differential distributions are presented. Predictions for LHC experiments are given. Detailed analysis of the distributions in $\phi_{pp}$ the azimuthal angle between the transverse momenta of the outgoing protons can help to check different models and to study real pattern of the absorption effects.


title: Constraining Primordial Black Hole Dark Matter with CHIME Fast Radio Bursts

abstract: Strong lensing of Fast Radio Bursts (FBRs) has been proposed as a relatively clean probe of primordial black hole (PBH) dark matter. Recently, the Canadian Hydrogen Intensity Mapping Experiment (CHIME) published a first catalog of 536 FRBs, 62 of which are from repeating sources. In light of this new data, we re-examine the prospects to constrain the abundance of PBHs via FRBs. Extending previous forecasts, we calculate a PBH dark matter bound using the intrinsic burst width and a calibrated flux-ratio threshold per FRB. In addition, we take into account the uncertainty in the relation between the FRB dispersion measure and source redshift. We outline an algorithm to detect lensed FRBs and a method to simulate its performance on real data and set a flux-ratio threshold for each event, which we use to infer realistic forecasts. We then attempt to extract a preliminary bound using the publicly available CHIME data. Unfortunately, both instrumental noise and the provided ~1 ms time-resolution of the public data hinder this effort. We identify one candidate event where a double burst could be explained via strong lensing by a 10 solar-mass PBH, which will require follow-up study at higher time resolution to either confirm or discard. We show that with a few times the size of the first catalog -- sampled at the full instrumental time-resolution so that candidates can be efficiently scrutinized -- CHIME will be able to find strong evidence for or robustly rule out PBHs with mass above 10 solar masses as the dark matter. Finally, we demonstrate that stacking repeating FRBs can improve the constraints, especially for lower masses.


title: Apercal -- The Apertif Calibration Pipeline

abstract: Apertif (APERture Tile In Focus) is one of the Square Kilometre Array (SKA) pathfinder facilities. The Apertif project is an upgrade to the 50-year-old Westerbork Synthesis Radio Telescope (WSRT) using phased-array feed technology. The new receivers create 40 individual beams on the sky, achieving an instantaneous sky coverage of 6.5 square degrees. The primary goal of the Apertif Imaging Survey is to perform a wide survey of 3500 square degrees (AWES) and a medium deep survey of 350 square degrees (AMES) of neutral atomic hydrogen (up to a redshift of 0.26), radio continuum emission and polarisation. Each survey pointing yields 4.6 TB of correlated data. The goal of Apercal is to process this data and fully automatically generate science ready data products for the astronomical community while keeping up with the survey observations. We make use of common astronomical software packages in combination with Python based routines and parallelisation. We use an object oriented module-based approach to ensure easy adaptation of the pipeline. A Jupyter notebook based framework allows user interaction and execution of individual modules as well as a full automatic processing of a complete survey observation. If nothing interrupts processing, we are able to reduce a single pointing survey observation on our five node cluster with 24 physical cores and 256 GB of memory each within 24h keeping up with the speed of the surveys. The quality of the generated images is sufficient for scientific usage for 44 % of the recorded data products with single images reaching dynamic ranges of several thousands. Future improvements will increase this percentage to over 80 %. Our design allowed development of the pipeline in parallel to the commissioning of the Apertif system.


title: Shrub Ensembles for Online Classification

abstract: Online learning algorithms have become a ubiquitous tool in the machine learning toolbox and are frequently used in small, resource-constraint environments. Among the most successful online learning methods are Decision Tree (DT) ensembles. DT ensembles provide excellent performance while adapting to changes in the data, but they are not resource efficient. Incremental tree learners keep adding new nodes to the tree but never remove old ones increasing the memory consumption over time. Gradient-based tree learning, on the other hand, requires the computation of gradients over the entire tree which is costly for even moderately sized trees. In this paper, we propose a novel memory-efficient online classification ensemble called shrub ensembles for resource-constraint systems. Our algorithm trains small to medium-sized decision trees on small windows and uses stochastic proximal gradient descent to learn the ensemble weights of these `shrubs'. We provide a theoretical analysis of our algorithm and include an extensive discussion on the behavior of our approach in the online setting. In a series of 2~959 experiments on 12 different datasets, we compare our method against 8 state-of-the-art methods. Our Shrub Ensembles retain an excellent performance even when only little memory is available. We show that SE offers a better accuracy-memory trade-off in 7 of 12 cases, while having a statistically significant better performance than most other methods. Our implementation is available under https://github.com/sbuschjaeger/se-online .


title: Enhanced Phase Mixing of Torsional Alfv\'en Waves in Stratified and Divergent Solar Coronal Structures, Paper II: Nonlinear Simulations

abstract: We use MHD simulations to detect the nonlinear effects of torsional Alfv\'en wave propagation in a potential magnetic field with exponentially divergent field lines, embedded in a stratified solar corona. In Paper I we considered solutions to the linearised governing equations torsional Alfv\'en wave propagation and showed, using a finite difference solver we developed named WiggleWave, that in certain scenarios wave damping is stronger than what would be predicted by our analytic solutions. In this paper we consider whether damping would be further enhanced by the presence of nonlinear effects. We begin by deriving the nonlinear governing equations for torsional Alfv\'en wave propagation and identifying the terms that cause coupling to magnetosonic perturbations. We then compare simulation outputs from an MHD solver called Lare3d, which solves the full set of nonlinear MHD equations, to the outputs from WiggleWave to detect nonlinear effects such as: the excitation of magnetosonic waves by the Alfv\'en wave, self-interaction of the Alfv\'en wave through coupling to the induced magnetosonic waves, and the formation of shock waves higher in the atmosphere caused by the steepening of these compressive perturbations. We suggest that the presence of these nonlinear effects in the solar corona would lead to Alfv\'en wave heating that exceeds the expectation from the phase mixing alone.


title: $q$-TASEP with position-dependent slowing

abstract: We introduce a new interacting particle system on $\mathbb{Z}$, \emph{slowed $t$-TASEP}. It may be viewed as a $q$-TASEP with additional position-dependent slowing of jump rates depending on a parameter $t$, which leads to discrete and nonuniversal asymptotics at large time. If on the other hand $t \to 1$ as $\text{time} \to \infty$, we prove (1) a law of large numbers for particle positions, (2) a central limit theorem, with convergence to the fixed-time Gaussian marginal of a stationary solution to SDEs derived from the particle jump rates, and (3) a bulk limit to a certain explicit stationary Gaussian process on $\mathbb{R}$, with scaling exponents characteristic of the Edwards-Wilkinson universality class in $(1+1)$ dimensions. The proofs relate slowed $t$-TASEP to a certain Hall-Littlewood process, and use contour integral formulas for observables of this process. Unlike most previously studied Macdonald processes, this one involves only local interactions, resulting in asymptotics characteristic of $(1+1)$-dimensional rather than $(2+1)$-dimensional systems.


title: On a density conjecture about unit fractions

abstract: We prove that any set $A\subset \mathbb{N}$ of positive upper density contains a finite $S\subset A$ such that $\sum_{n\in S}\frac{1}{n}=1$, answering a question of Erd\H{o}s and Graham.


title: RFGAN: RF-Based Human Synthesis

abstract: This paper demonstrates human synthesis based on the Radio Frequency (RF) signals, which leverages the fact that RF signals can record human movements with the signal reflections off the human body. Different from existing RF sensing works that can only perceive humans roughly, this paper aims to generate fine-grained optical human images by introducing a novel cross-modal RFGAN model. Specifically, we first build a radio system equipped with horizontal and vertical antenna arrays to transceive RF signals. Since the reflected RF signals are processed as obscure signal projection heatmaps on the horizontal and vertical planes, we design a RF-Extractor with RNN in RFGAN for RF heatmap encoding and combining to obtain the human activity information. Then we inject the information extracted by the RF-Extractor and RNN as the condition into GAN using the proposed RF-based adaptive normalizations. Finally, we train the whole model in an end-to-end manner. To evaluate our proposed model, we create two cross-modal datasets (RF-Walk & RF-Activity) that contain thousands of optical human activity frames and corresponding RF signals. Experimental results show that the RFGAN can generate target human activity frames using RF signals. To the best of our knowledge, this is the first work to generate optical images based on RF signals.


title: Flexible Networks for Learning Physical Dynamics of Deformable Objects

abstract: Learning the physical dynamics of deformable objects with particle-based representation has been the objective of many computational models in machine learning. While several state-of-the-art models have achieved this objective in simulated environments, most existing models impose a precondition, such that the input is a sequence of ordered point sets. That is, the order of the points in each point set must be the same across the entire input sequence. This precondition restrains the model from generalizing to real-world data, which is considered to be a sequence of unordered point sets. In this paper, we propose a model named time-wise PointNet (TP-Net) that solves this problem by directly consuming a sequence of unordered point sets to infer the future state of a deformable object with particle-based representation. Our model consists of a shared feature extractor that extracts global features from each input point set in parallel and a prediction network that aggregates and reasons on these features for future prediction. The key concept of our approach is that we use global features rather than local features to achieve invariance to input permutations and ensure the stability and scalability of our model. Experiments demonstrate that our model achieves state-of-the-art performance with real-time prediction speed in both synthetic dataset and real-world dataset. In addition, we provide quantitative and qualitative analysis on why our approach is more effective and efficient than existing approaches.


title: Iterations of Minkowski Valuations

abstract: It is shown that for any sufficiently regular even Minkowski valuation $\Phi$ which is homogeneous and intertwines rigid motions, and for any convex body $K$ in a smooth neighborhood of the unit ball, there exists a sequence of positive numbers $(\gamma_m)_{m=1}^\infty$ such that $(\gamma_m\Phi^m K)_{m=1}^\infty$ converges to the unit ball with respect to the Hausdorff metric.


title: Soft-clamped silicon nitride string resonators at millikelvin temperatures

abstract: We demonstrate that soft-clamped silicon nitride strings with large aspect ratio can be operated at \si{\milli\kelvin} temperatures. The quality factors ($Q$) of two measured devices show consistent dependency on the cryostat temperature, with soft-clamped mechanical modes reaching $Q > 10^9$ at $46~\mathrm{mK}$. For low optical readout power, $Q$ is found to saturate, indicating good thermalization between the sample and the stage it is mounted on. Our best device exhibits a force sensitivity of $9.6~\mathrm{zN}/\sqrt{\mathrm{Hz}}$ and a thermal decoherence time of $0.38~\mathrm{s}$ which bode well for future applications such as nanomechanical force sensing and beyond.


title: SalFBNet: Learning Pseudo-Saliency Distribution via Feedback Convolutional Networks

abstract: Feed-forward only convolutional neural networks (CNNs) may ignore intrinsic relationships and potential benefits of feedback connections in vision tasks such as saliency detection, despite their significant representation capabilities. In this work, we propose a feedback-recursive convolutional framework (SalFBNet) for saliency detection. The proposed feedback model can learn abundant contextual representations by bridging a recursive pathway from higher-level feature blocks to low-level layer. Moreover, we create a large-scale Pseudo-Saliency dataset to alleviate the problem of data deficiency in saliency detection. We first use the proposed feedback model to learn saliency distribution from pseudo-ground-truth. Afterwards, we fine-tune the feedback model on existing eye-fixation datasets. Furthermore, we present a novel Selective Fixation and Non-Fixation Error (sFNE) loss to make proposed feedback model better learn distinguishable eye-fixation-based features. Extensive experimental results show that our SalFBNet with fewer parameters achieves competitive results on the public saliency detection benchmarks, which demonstrate the effectiveness of proposed feedback model and Pseudo-Saliency data. Source codes and Pseudo-Saliency dataset can be found at https://github.com/gqding/SalFBNet


title: A coarse space acceleration of deep-DDM

abstract: The use of deep learning methods for solving PDEs is a field in full expansion. In particular, Physical Informed Neural Networks, that implement a sampling of the physical domain and use a loss function that penalizes the violation of the partial differential equation, have shown their great potential. Yet, to address large scale problems encountered in real applications and compete with existing numerical methods for PDEs, it is important to design parallel algorithms with good scalability properties. In the vein of traditional domain decomposition methods (DDM), we consider the recently proposed deep-ddm approach. We present an extension of this method that relies on the use of a coarse space correction, similarly to what is done in traditional DDM solvers. Our investigations shows that the coarse correction is able to alleviate the deterioration of the convergence of the solver when the number of subdomains is increased thanks to an instantaneous information exchange between subdomains at each iteration. Experimental results demonstrate that our approach induces a remarkable acceleration of the original deep-ddm method, at a reduced additional computational cost.


title: Barcodes for Hamiltonian homeomorphisms of surfaces

abstract: In this article, the main goal is to give a dynamical point of view of Floer homology barcodes for Hamiltonian homeomorphisms of surfaces. More specifically, we describe a way to construct barcodes for Hamiltonian homeomorphisms of surfaces from graphs. We will define graphes associated to maximal isotopies of a Hamiltonian homeomorphism using Le Calvez's positively transverse foliation theory and to those graphs we will associate barcodes. In particular, we will prove that for the simplest cases, our constructions coincide with the Floer Homology barcodes.


title: Towards Modeling and Resolving Singular Parameter Spaces using Stratifolds

abstract: When analyzing parametric statistical models, a useful approach consists in modeling geometrically the parameter space. However, even for very simple and commonly used hierarchical models like statistical mixtures or stochastic deep neural networks, the smoothness assumption of manifolds is violated at singular points which exhibit non-smooth neighborhoods in the parameter space. These singular models have been analyzed in the context of learning dynamics, where singularities can act as attractors on the learning trajectory and, therefore, negatively influence the convergence speed of models. We propose a general approach to circumvent the problem arising from singularities by using stratifolds, a concept from algebraic topology, to formally model singular parameter spaces. We use the property that specific stratifolds are equipped with a resolution method to construct a smooth manifold approximation of the singular space. We empirically show that using (natural) gradient descent on the smooth manifold approximation instead of the singular space allows us to avoid the attractor behavior and therefore improve the convergence speed in learning.


title: Adaptive Mimic: Deep Reinforcement Learning of Parameterized Bipedal Walking from Infeasible References

abstract: Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that of the references. In this paper, we propose to design an adaptive reward function for imitation learning from the references. The agent is encouraged to mimic the references when its performance is low, while to pursue high performance when it reaches the limit of references. We further demonstrate that developed references can be replaced by low-quality references that are generated without laborious tuning and infeasible to deploy by themselves, as long as they can provide a priori knowledge to expedite the learning process.


title: Gaussian map predictions for 3D surface feature localisation and counting

abstract: In this paper, we propose to employ a Gaussian map representation to estimate precise location and count of 3D surface features, addressing the limitations of state-of-the-art methods based on density estimation which struggle in presence of local disturbances. Gaussian maps indicate probable object location and can be generated directly from keypoint annotations avoiding laborious and costly per-pixel annotations. We apply this method to the 3D spheroidal class of objects which can be projected into 2D shape representation enabling efficient processing by a neural network GNet, an improved UNet architecture, which generates the likely locations of surface features and their precise count. We demonstrate a practical use of this technique for counting strawberry achenes which is used as a fruit quality measure in phenotyping applications. The results of training the proposed system on several hundreds of 3D scans of strawberries from a publicly available dataset demonstrate the accuracy and precision of the system which outperforms the state-of-the-art density-based methods for this application.


title: UCD-CS at TREC 2021 Incident Streams Track

abstract: In recent years, the task of mining important information from social media posts during crises has become a focus of research for the purposes of assisting emergency response (ES). The TREC Incident Streams (IS) track is a research challenge organised for this purpose. The track asks participating systems to both classify a stream of crisis-related tweets into humanitarian aid related information types and estimate their importance regarding criticality. The former refers to a multi-label information type classification task and the latter refers to a priority estimation task. In this paper, we report on the participation of the University College Dublin School of Computer Science (UCD-CS) in TREC-IS 2021. We explored a variety of approaches, including simple machine learning algorithms, multi-task learning techniques, text augmentation, and ensemble approaches. The official evaluation results indicate that our runs achieve the highest scores in many metrics. To aid reproducibility, our code is publicly available at https://github.com/wangcongcong123/crisis-mtl.


title: A more efficient algorithm to compute the Rand Index for change-point problems

abstract: In this paper we provide a more efficient algorithm to compute the Rand Index when the data cluster comes from change-point detection problems. Given $N$ data points and two clusters of size $r$ and $s$, the algorithm runs on $O(r+s)$ time complexity and $O(1)$ memory complexity. The traditional algorithm, in contrast, runs on $O(rs+N)$ time complexity and $O(rs)$ memory complexity.


title: New constraints on the future evaporation of the young exoplanets in the V1298 Tau system

abstract: Transiting planets at young ages are key targets for improving our understanding of the evolution of exo-atmospheres. We present results of a new X-ray observation of V1298 Tau with XMM-Newton, aimed to determine more accurately the high-energy irradiation of the four planets orbiting this pre-main-sequence star, and the possible variability due to magnetic activity on short and long time scales. Following the first measurements of planetary masses in the V1298 Tau system, we revise early guesses of the current escape rates from the planetary atmospheres, employing our updated atmospheric evaporation models to predict the future evolution of the system. Contrary to previous expectations, we find that the two outer Jupiter-size planets will not be affected by any evaporation on Gyr time scales, and the same occurs for the two smaller inner planets, unless their true masses are lower than $\sim 40$ M$_\oplus$. These results confirm that relatively massive planets can reach their final position in the mass-radius diagram very early in their evolutionary history.


title: Dilated convolution with learnable spacings

abstract: Recent works indicate that convolutional neural networks (CNN) need large receptive fields (RF) to compete with visual transformers and their attention mechanism. In CNNs, RFs can simply be enlarged by increasing the convolution kernel sizes. Yet the number of trainable parameters, which scales quadratically with the kernel's size in the 2D case, rapidly becomes prohibitive, and the training is notoriously difficult. This paper presents a new method to increase the RF size without increasing the number of parameters. The dilated convolution (DC) has already been proposed for the same purpose. DC can be seen as a convolution with a kernel that contains only a few non-zero elements placed on a regular grid. Here we present a new version of the DC in which the spacings between the non-zero elements, or equivalently their positions, are no longer fixed but learnable via backpropagation thanks to an interpolation technique. We call this method "Dilated Convolution with Learnable Spacings" (DCLS) and generalize it to the n-dimensional convolution case. However, our main focus here will be on the 2D case. We first tried our approach on ResNet50: we drop-in replaced the standard convolutions with DCLS ones, which increased the accuracy of ImageNet1k classification at iso-parameters, but at the expense of the throughput. Next, we used the recent ConvNeXt state-of-the-art convolutional architecture and drop-in replaced the depthwise convolutions with DCLS ones. This not only increased the accuracy of ImageNet1k classification but also of typical downstream and robustness tasks, again at iso-parameters but this time with negligible cost on throughput, as ConvNeXt uses separable convolutions. Conversely, classic DC led to poor performance with both ResNet50 and ConvNeXt. The code of the method is available at: https://github.com/K-H-Ismail/Dilated-Convolution-with-Learnable-Spacings-PyTorch.


title: Rational torsion of generalised modular Jacobians of odd level

abstract: We consider the generalised Jacobian $J_{0}(N)_{\mathbf{m}}$ of the modular curve $X_{0}(N)$ of level $N$, with respect to the modulus $\mathbf{m}$ consisting of all cusps on the modular curve. When $N$ is odd, we determine the group structure of the rational torsion $J_{0}(N)_{\mathbf{m}}(\mathbb{Q})_{tor}$ up to $2$-primary and $l$-primary parts for any prime $l$ dividing $N$. Our results extend those of Wei--Yamazaki for squarefree levels and Yamazaki--Yang for prime-power levels.


title: Broad toplike vector quarks at LHC and HL-LHC

abstract: Top like vector quarks arising from underlying strong sectors are expected to have large decay widths pushing them beyond the narrow width approximation. In this paper we consider a broad colored vector quark that strongly couples to an exotic pseudoscalar. We use the full 1PI resummed propagator for the exotic quark to recast the present LHC constraints ruling out masses below $\sim1.2~(1.1)$ TeV for width to mass ratio of $0.1~(0.6)$. We utilize machine learning techniques that are demonstratively more efficient than traditional cut based searches to present the reach of HL-LHC on the parameter space of this broad resonance. We find that at $3~ab^{-1}$ the HL-LHC has a discovery potential up to $1.6$ TeV dominated by the pair production channel. We study the feasibility of using machine learning techniques to analyze the broad resonance peaks expected from these exotic quarks at collider experiments like the LHC.


title: The Complex Airy Operator as Explicitly Solvable PT-symmetrical Model

abstract: We study the Sturm--Liouville operator $$ T(\varepsilon)y=-\frac{1}{\varepsilon}y''+ p(x)y, $$ with concrete $\mathcal{PT}$-- symmetric potential $p(x) = ix$ and Dirichlet boundary conditions on the segment $[-1,1]$. Here $\varepsilon \in (0, \infty)$ is a physical parameter. We explicitly describe a beautiful phenomenon of the eigenvalue behavior when $\varepsilon$ changes from $0$ to $\infty$. All the critical values of $\varepsilon$ which determine the eigenvalue dynamics, are found in terms of the special Airy functions.


title: Spatial Search on Johnson Graphs by Discrete-Time Quantum Walk

abstract: The spatial search problem aims to find a marked vertex of a finite graph using a dynamic with two constraints: (1) The walker has no compass and (2) the walker can check whether a vertex is marked only after reaching it. This problem is a generalization of unsorted database search and has many applications to algorithms. Classical algorithms that solve the spatial search problem are based on random walks and the computational complexity is determined by the hitting time. On the other hand, quantum algorithms are based on quantum walks and the computational complexity is determined not only by the number of steps to reach a marked vertex, but also by the success probability, since we need to perform a measurement at the end of the algorithm to determine the walker's position. In this work, we address the spatial search problem on Johnson graphs using the coined quantum walk model. Since Johnson graphs are vertex- and distance-transitive, we have found an invariant subspace of the Hilbert space, which aids in the calculation of the computational complexity. We have shown that, for every fixed diameter, the asymptotic success probability is $1/2$ after taking $\pi\sqrt N/(2\sqrt 2)$ steps, where $N$ is the number of vertices of the Johnson graph.


title: On the Kurtosis of Modulation Formats for Characterizing the Nonlinear Fiber Propagation

abstract: Knowing only two high-order statistical moments of modulation symbols, often represented by the fourth moment called "kurtosis", the overestimation of nonlinear interference (NLI) in a Gaussian noise (GN) model due to Gaussian signaling assumption can be corrected through an enhanced GN (EGN) model. However, in some modern optical communication systems where the transmitted modulation symbols are statistically correlated, such as in systems that use probabilistic constellation shaping (PCS) with finite-length sphere shaping, the kurtosis-based EGN model produces significant inaccuracies in analytical prediction of NLI. In this paper, we show that for correlated modulation symbols, the NLI can be more accurately estimated by substituting a statistical measure called windowed kurtosis into the EGN model, instead of the conventional kurtosis. Remarkably, the optimal window length for windowed kurtosis is found to be consistent with the self-phase modulation (SPM) and cross-phase modulation (XPM) characteristic times in various system configurations. The findings can be used in practice to analytically evaluate and design NLI-tolerant modulation formats.


title: State complexity of one-way quantum finite automata together with classical states

abstract: One-way quantum finite automata together with classical states (1QFAC) proposed in [Journal of Computer and System Sciences 81(2) (2015) 359--375] is a new one-way quantum finite automata (1QFA) model that integrates quantum finite automata (QFA) and deterministic finite automata (DFA). This model uses classical states to control the evolution and measurement of quantum states. As a quantum-classical hybrid model, 1QFAC recognize all regular languages. It was shown that the state complexity of 1QFAC for some languages is essentially superior to that of DFA and other 1QFA. In this paper, our goal is to clarify state complexity problems for 1QFAC. We obtain the following results: (1) We optimize the bound given by Qiu et al. that characterizes the relationship between quantum basis state number and classical state number of 1QFAC as well as the state number of its corresponding minimal DFA for recognizing any given regular language. (2) We give an upper bound showing that how many classical states are needed if the quantum basis states of 1QFAC are reduced without changing its recognition ability. (3) We give a lower bound of the classical state number of 1QFAC for recognizing any given regular language, and the lower bound is exact if the given language is finite. (4) We show that 1QFAC are exponentially more succinct than DFA and probabilistic finite automata (PFA) for recognizing some regular languages that can not be recognized by measure-once 1QFA (MO-1QFA), measure-many 1QFA (MM-1QFA) or multi-letter 1QFA. (5) We reveal essential relationships between 1QFAC, MO-1QFA and multi-letter 1QFA, and induce a result regarding a quantitative relationship between the state number of multi-letter 1QFA and DFA.


title: Chirality sensing employing PT-symmetric and other resonant gain-loss optical systems

abstract: Molecular chirality detection and enantiomer discrimination are very important issues for many areas of science and technology, prompting intensive investigations via optical methods. However, these methods are hindered by the intrinsically weak nature of chiro-optical signals. Here, we investigate and demonstrate the potential of gain materials and of combined gain-loss media to enhance these signals. Specifically, we show that the proper combination of a thin chiral layer with a gain-loss bilayer can lead to large enhancements of both the circular dichroism (CD) response and the dissymmetry factor, g, compared to the chiral layer alone. The most pronounced enhancements are obtained in the case of a Parity-Time (PT) symmetric gain-loss bilayer, while deviations from the exact PT symmetry lead to only moderate deterioration of the CD and g response, demonstrating also the possibility of tuning the system response by tuning the gain layer properties. In the case of PT-symmetric gain-loss bilayers we found that the largest CD enhancement is obtained at the system lasing threshold, while the g-enhancements at the anisotropic transmission resonances of the systems. Our results clearly demonstrate the potential of gain materials in chirality detection. Moreover, our gain-involving approach can be applied in conjunction with most of the nanophotonics/nanostructures-based approaches that have been already proposed for chirality sensing, further enhancing the performance/output of both approaches.


title: Curvilinear manipulation of polarized spin wave

abstract: Polarization, the precession direction with respect to the background magnetization, is an intrinsic degree of freedom of spin wave. Introducing symmetry breaking mechanisms lies in the heart of lifting the degeneracy between polarized spin wave modes, and is essential in constructing polarization-based magnonic devices. Here we show that polarized spin waves can be naturally harnessed in a curved antiferromagnetic wire via tuning its curvature and torsion. Specifically, we investigate evolution of polarized spin wave in a spin wave rotator and a spin wave interferometer based on magnetic circular helices, and correlate these curvilinear effects to the Berry phase accumulated along wires.


title: Interpolating between BSDEs and PINNs: deep learning for elliptic and parabolic boundary value problems

abstract: Solving high-dimensional partial differential equations is a recurrent challenge in economics, science and engineering. In recent years, a great number of computational approaches have been developed, most of them relying on a combination of Monte Carlo sampling and deep learning based approximation. For elliptic and parabolic problems, existing methods can broadly be classified into those resting on reformulations in terms of $\textit{backward stochastic differential equations}$ (BSDEs) and those aiming to minimize a regression-type $L^2$-error ($\textit{physics-informed neural networks}$, PINNs). In this paper, we review the literature and suggest a methodology based on the novel $\textit{diffusion loss}$ that interpolates between BSDEs and PINNs. Our contribution opens the door towards a unified understanding of numerical approaches for high-dimensional PDEs, as well as for implementations that combine the strengths of BSDEs and PINNs. The diffusion loss furthermore bears close similarities to $\textit{(least squares) temporal difference}$ objectives found in reinforcement learning. We also discuss eigenvalue problems and perform extensive numerical studies, including calculations of the ground state for nonlinear Schr\"odinger operators and committor functions relevant in molecular dynamics.


title: Wild ToFu: Improving Range and Quality of Indirect Time-of-Flight Depth with RGB Fusion in Challenging Environments

abstract: Indirect Time-of-Flight (I-ToF) imaging is a widespread way of depth estimation for mobile devices due to its small size and affordable price. Previous works have mainly focused on quality improvement for I-ToF imaging especially curing the effect of Multi Path Interference (MPI). These investigations are typically done in specifically constrained scenarios at close distance, indoors and under little ambient light. Surprisingly little work has investigated I-ToF quality improvement in real-life scenarios where strong ambient light and far distances pose difficulties due to an extreme amount of induced shot noise and signal sparsity, caused by the attenuation with limited sensor power and light scattering. In this work, we propose a new learning based end-to-end depth prediction network which takes noisy raw I-ToF signals as well as an RGB image and fuses their latent representation based on a multi step approach involving both implicit and explicit alignment to predict a high quality long range depth map aligned to the RGB viewpoint. We test our approach on challenging real-world scenes and show more than 40% RMSE improvement on the final depth map compared to the baseline approach.


title: On the Stability of Positive Semigroups

abstract: The stability and contraction properties of positive integral semigroups on Polish spaces are investigated. Our novel analysis is based on the extension of V-norm contraction methods, associated to functionally weighted Banach spaces for Markov semigroups, to positive semigroups. This methodology is applied to a general class of positive and possibly time-inhomogeneous bounded integral semigroups and their normalised versions. The spectral theorems that we develop are an extension of Perron-Frobenius and Krein-Rutman theorems for positive operators to a class of time-varying positive semigroups. In the context of time-homogeneous models, the regularity conditions discussed in the present article appear to be necessary and sufficient condition for the existence of leading eigenvalues. We review and illustrate the impact of these results in the context of positive semigroups arising in transport theory, physics, mathematical biology and signal processing.


title: Danna-Sep: Unite to separate them all

abstract: Deep learning-based music source separation has gained a lot of interest in the last decades. Most of the existing methods operate with either spectrograms or waveforms. Spectrogram based models learn suitable masks for separating magnitude spectrogram into different sources, and waveform-based models directly generate waveforms of individual sources. The two types of models have complementary strengths; the former is superior given harmonic sources such as vocals, while the latter demonstrates better results for percussion and bass instruments. In this work, we improved upon the state-of-the-art (SoTA) models and successfully combined the best of both worlds. The backbones of the proposed framework, dubbed Danna-Sep, are two spectrogram-based models including a modified X-UMX and U-Net, and an enhanced Demucs as the waveform-based model. Given an input of mixture, we linearly combined respective outputs from the three models to obtain the final result. We showed in the experiments that, despite its simplicity, Danna-Sep surpassed the SoTA models by a large margin in terms of Source-to-Distortion Ratio.


title: Tell me why! Explanations support learning relational and causal structure

abstract: Inferring the abstract relational and causal structure of the world is a major challenge for reinforcement-learning (RL) agents. For humans, language--particularly in the form of explanations--plays a considerable role in overcoming this challenge. Here, we show that language can play a similar role for deep RL agents in complex environments. While agents typically struggle to acquire relational and causal knowledge, augmenting their experience by training them to predict language descriptions and explanations can overcome these limitations. We show that language can help agents learn challenging relational tasks, and examine which aspects of language contribute to its benefits. We then show that explanations can help agents to infer not only relational but also causal structure. Language can shape the way that agents to generalize out-of-distribution from ambiguous, causally-confounded training, and explanations even allow agents to learn to perform experimental interventions to identify causal relationships. Our results suggest that language description and explanation may be powerful tools for improving agent learning and generalization.


title: A Continuous-time Stochastic Gradient Descent Method for Continuous Data

abstract: Optimization problems with continuous data appear in, e.g., robust machine learning, functional data analysis, and variational inference. Here, the target function is given as an integral over a family of (continuously) indexed target functions - integrated with respect to a probability measure. Such problems can often be solved by stochastic optimization methods: performing optimization steps with respect to the indexed target function with randomly switched indices. In this work, we study a continuous-time variant of the stochastic gradient descent algorithm for optimization problems with continuous data. This so-called stochastic gradient process consists in a gradient flow minimizing an indexed target function that is coupled with a continuous-time index process determining the index. Index processes are, e.g., reflected diffusions, pure jump processes, or other L\'evy processes on compact spaces. Thus, we study multiple sampling patterns for the continuous data space and allow for data simulated or streamed at runtime of the algorithm. We analyze the approximation properties of the stochastic gradient process and study its longtime behavior and ergodicity under constant and decreasing learning rates. We end with illustrating the applicability of the stochastic gradient process in a polynomial regression problem with noisy functional data, as well as in a physics-informed neural network.