title: Hybrid physics-based and data-driven modeling with calibrated uncertainty for lithium-ion battery degradation diagnosis and prognosis

abstract: Advancing lithium-ion batteries (LIBs) in both design and usage is key to promoting electrification in the coming decades to mitigate human-caused climate change. Inadequate understanding of LIB degradation is an important bottleneck that limits battery durability and safety. Here, we propose hybrid physics-based and data-driven modeling for online diagnosis and prognosis of battery degradation. Compared to existing battery modeling efforts, we aim to build a model with physics as its backbone and statistical learning techniques as enhancements. Such a hybrid model has better generalizability and interpretability together with a well-calibrated uncertainty associated with its prediction, rendering it more valuable and relevant to safety-critical applications under realistic usage scenarios.


title: Nonlocal approximations to anisotropic Sobolev norms

abstract: We obtain some nonlocal characterizations for a class of variable exponent Sobolev spaces arising in nonlinear elasticity, in the theory of electrorheological fluids as well as in image processing for the regions where the variable exponent $p(x)$ reaches the value $1$.


title: Quantifying biomolecular diffusion with a "spherical cow" model

abstract: The dynamics of biological polymers, including proteins, RNA, and DNA, occur in very high-dimensional spaces. Many naturally-occurring polymers can navigate a vast phase space and rapidly find their lowest free energy (folded) state. Thus, although the search process is stochastic, it is not completely random. Instead, it is best described in terms of diffusion along a downhill free energy landscape. In this context, there have been many efforts to use simplified representations of the energetics, for which the potential energy is chosen to be a relatively smooth function with a global minima that corresponds to the folded state. That is, instead of including every type of physical interaction, the broad characteristics of the landscape are encoded in approximate energy functions. We describe a particular class of models, called structure-based models, that can be used to explore the diffusive properties of biomolecular folding and conformational rearrangements. These energy functions may be regarded as the "spherical cow" for modeling molecular biophysics. We discuss the physical principles underlying these models and provide an entry-level tutorial, which may be adapted for use in curricula for physics and non-physics majors.


title: Iterative Rule Extension for Logic Analysis of Data: an MILP-based heuristic to derive interpretable binary classification from large datasets

abstract: Data-driven decision making is rapidly gaining popularity, fueled by the ever-increasing amounts of available data and encouraged by the development of models that can identify beyond linear input-output relationships. Simultaneously the need for interpretable prediction- and classification methods is increasing, as this improves both our trust in these models and the amount of information we can abstract from data. An important aspect of this interpretability is to obtain insight in the sensitivity-specificity trade-off constituted by multiple plausible input-output relationships. These are often shown in a receiver operating characteristic (ROC) curve. These developments combined lead to the need for a method that can abstract complex yet interpretable input-output relationships from large data, i.e. data containing large numbers of samples and sample features. Boolean phrases in disjunctive normal form (DNF) are highly suitable for explaining non-linear input-output relationships in a comprehensible way. Mixed integer linear programming (MILP) can be used to abstract these Boolean phrases from binary data, though its computational complexity prohibits the analysis of large datasets. This work presents IRELAND, an algorithm that allows for abstracting Boolean phrases in DNF from data with up to 10,000 samples and sample characteristics. The results show that for large datasets IRELAND outperforms the current state-of-the-art and can find solutions for datasets where current models run out of memory or need excessive runtimes. Additionally, by construction IRELAND allows for an efficient computation of the sensitivity-specificity trade-off curve, allowing for further understanding of the underlying input-output relationship.


title: Bootstrapping Concept Formation in Small Neural Networks

abstract: The question how neural systems (of humans) can perform reasoning is still far from being solved. We posit that the process of forming Concepts is a fundamental step required for this. We argue that, first, Concepts are formed as closed representations, which are then consolidated by relating them to each other. Here we present a model system (agent) with a small neural network that uses realistic learning rules and receives only feedback from the environment in which the agent performs virtual actions. First, the actions of the agent are reflexive. In the process of learning, statistical regularities in the input lead to the formation of neuronal pools representing relations between the entities observed by the agent from its artificial world. This information then influences the behavior of the agent via feedback connections replacing the initial reflex by an action driven by these relational representations. We hypothesize that the neuronal pools representing relational information can be considered as primordial Concepts, which may in a similar way be present in some pre-linguistic animals, too. This system provides formal grounds for further discussions on what could be understood as a Concept and shows that associative learning is enough to develop concept-like structures.


title: MEKF Ignoring Initial Conditions for Attitude Estimation Using Vector Observations

abstract: In this paper, the well-known multiplicative extended Kalman filter (MEKF) is re-investigated for attitude estimation using vector observations. From the Lie group theory, it is shown that the attitude estimation model is group affine and its error state model should be trajectory-independent. Moreover, with such trajectory-independent error state model, the linear Kalman filter is still effective for large initialization errors. However, the measurement model of the traditional MEKF is dependent on the attitude prediction, which is therefore trajectory-dependent. This is also the main reason why the performance of traditional MEKF is degraded for large initialization errors. Through substitution of the attitude prediction related term with the vector observation in body frame, a trajectory-independent measurement model is derived for MEKF. Meanwhile, the MEKFs with reference attitude error definition and with global state formulating on special Euclidean group have also been studied, with main focus on derivation of the trajectory-independent measurement models. Extensive Monte Carlo simulations and field test of attitude estimation implementations demonstrate that the performance of MEKFs can be much improved with trajectory-independent measurement models.


title: NSOP$_1$-like independence in AECats

abstract: The classes stable, simple and NSOP$_1$ in the stability hierarchy for first-order theories can be characterised by the existence of a certain independence relation. For each of them there is a canonicity theorem: there can be at most one nice independence relation. Independence in stable and simple first-order theories must come from forking and dividing (which then coincide), and for NSOP$_1$ theories it must come from Kim-dividing. We generalise this work to the framework of AECats (Abstract Elementary Categories) with the amalgamation property. These are a certain kind of accessible category generalising the category of (subsets of) models of some theory. We prove canonicity theorems for stable, simple and NSOP$_1$-like independence relations. The stable and simple cases have been done before in slightly different setups, but we provide them here as well so that we can recover part of the original stability hierarchy. We also provide abstract definitions for each of these independence relations as what we call isi-dividing, isi-forking and long Kim-dividing.


title: Photon interactions with superconducting topological defects

abstract: Using a toy model for the interactions between a defect-forming field and the photon field where the photon becomes massive in the defect core (motivated by recent work on defects in the 2HDM), we study the impact on photon propagation in the background of the defect. We find that, when the photon frequency (in natural units) is much lower than the symmetry breaking scale, domain walls reflect most of an incoming photon signal leading to potential interesting astrophysical signals. We also adapt the calculations for vortices and monopoles. We find that the case of strings is very similar to the standard case for massive scalar particles, but in the case of monopoles the cross-section is proportional to the geometrical area of the monopole.


title: A Non-linear Differentiable Model for Stormwater-based Irrigation of a Green Roof in Toronto

abstract: Green infrastructure has potential to alleviate the environmental impact of rapidly growing cities. This potential has inspired laws in Toronto that require the inclusion of rooftops with large vegetation beds, called green roofs, into sufficiently sized construction projects. We study the problem of reusing stormwater to irrigate a green roof in Toronto, where potable water is the current irrigation source. The vision is that widespread reuse of stormwater runoff for irrigation of green roofs and other purposes can reduce sewer overflow volumes without over-building (with the added benefit of conserving potable water). Towards this vision, our goal is to develop and evaluate two pump controllers for transporting stormwater to the green roof of interest in simulation. A key contribution is our development of a site-specific non-linear model for stormwater flow using smoothing techniques that permits linearization and a standard model predictive controller (MPC). We compare the efficacy of the MPC, which anticipates the weather, and an on/off controller, which is reactive rather than anticipative, for the site in simulation. With further study, we are hopeful that this research will advance control systems technology to improve the performance of green and stormwater infrastructure in growing urban areas.


title: W-Net: A Two-Stage Convolutional Network for Nucleus Detection in Histopathology Image

abstract: Pathological diagnosis is the gold standard for cancer diagnosis, but it is labor-intensive, in which tasks such as cell detection, classification, and counting are particularly prominent. A common solution for automating these tasks is using nucleus segmentation technology. However, it is hard to train a robust nucleus segmentation model, due to several challenging problems, the nucleus adhesion, stacking, and excessive fusion with the background. Recently, some researchers proposed a series of automatic nucleus segmentation methods based on point annotation, which can significant improve the model performance. Nevertheless, the point annotation needs to be marked by experienced pathologists. In order to take advantage of segmentation methods based on point annotation, further alleviate the manual workload, and make cancer diagnosis more efficient and accurate, it is necessary to develop an automatic nucleus detection algorithm, which can automatically and efficiently locate the position of the nucleus in the pathological image and extract valuable information for pathologists. In this paper, we propose a W-shaped network for automatic nucleus detection. Different from the traditional U-Net based method, mapping the original pathology image to the target mask directly, our proposed method split the detection task into two sub-tasks. The first sub-task maps the original pathology image to the binary mask, then the binary mask is mapped to the density mask in the second sub-task. After the task is split, the task's difficulty is significantly reduced, and the network's overall performance is improved.


title: Which picker fits my data? A quantitative evaluation of deep learning based seismic pickers

abstract: Seismic event detection and phase picking are the base of many seismological workflows. In recent years, several publications demonstrated that deep learning approaches significantly outperform classical approaches and even achieve human-like performance under certain circumstances. However, as most studies differ in the datasets and exact evaluation tasks studied, it is yet unclear how the different approaches compare to each other. Furthermore, there are no systematic studies how the models perform in a cross-domain scenario, i.e., when applied to data with different characteristics. Here, we address these questions by conducting a large-scale benchmark study. We compare six previously published deep learning models on eight datasets covering local to teleseismic distances and on three tasks: event detection, phase identification and onset time picking. Furthermore, we compare the results to a classical Baer-Kradolfer picker. Overall, we observe the best performance for EQTransformer, GPD and PhaseNet, with EQTransformer having a small advantage for teleseismic data. Furthermore, we conduct a cross-domain study, in which we analyze model performance on datasets they were not trained on. We show that trained models can be transferred between regions with only mild performance degradation, but not from regional to teleseismic data or vice versa. As deep learning for detection and picking is a rapidly evolving field, we ensured extensibility of our benchmark by building our code on standardized frameworks and making it openly accessible. This allows model developers to easily compare new models or evaluate performance on new datasets, beyond those presented here. Furthermore, we make all trained models available through the SeisBench framework, giving end-users an easy way to apply these models in seismological analysis.


title: Globally hyperbolic spacetimes: slicings, boundaries and counterexamples

abstract: The Cauchy slicings for globally hyperbolic spacetimes and their relation with the causal boundary are surveyed and revisited, starting at the seminal conformal boundary constructions by R. Penrose. Our study covers: (1) adaptive possibilities and techniques for their Cauchy slicings, (2) global hyperbolicity of sliced spacetimes, (3) critical review on the conformal and causal boundaries for a globally hyperbolic spacetime, and (4) procedures to compute the causal boundary of a Cauchy temporal splitting by using isocausal comparison with a static product. New simple counterexamples on $\mathbb{R}^2$ illustrate a variety of possibilities related to these splittings, such as the logical independence (for normalized sliced spacetimes) between the completeness of the slices and global hyperbolicity, the necessity of uniform bounds on the slicings in order to ensure global hyperbolicity, or the insufficience of these bounds for the computation of the causal boundary. A refinement of one of these examples shows that the space of all the (normalized, conformal classes of) globally hyperbolic metrics on a smooth product manifold $\mathbb{R}\times S$ is not convex, even though it is path connected by means of piecewise convex combinations.


title: Search for Higgs bosons decaying into new spin-0 or spin-1 particles in four-lepton final states with the ATLAS detector with 139 fb$^{-1}$ of $pp$ collision data at $\sqrt{s}=13$ TeV

abstract: Searches are conducted for new spin-0 or spin-1 bosons using events where a Higgs boson with mass $125$ GeV decays into four leptons ($\ell =$ $e$,$\mu$). This decay is presumed to occur via an intermediate state which contains two on-shell, promptly decaying bosons: $H \rightarrow XX/ZX \rightarrow 4\ell$, where the new boson $X$ has a mass between 1 and 60 GeV. The search uses $pp$ collision data collected with the ATLAS detector at the LHC with an integrated luminosity of 139 fb$^{-1}$ at a centre-of-mass energy $\sqrt{s}=13$ TeV. The data are found to be consistent with Standard Model expectations. Limits are set on fiducial cross sections and on the branching ratio of the Higgs boson to decay into $XX/ZX$, improving those from previous publications by a factor between two and four. Limits are also set on mixing parameters relevant in extensions of the Standard Model containing a dark sector where $X$ is interpreted to be a dark boson.


title: C$^2$SP-Net: Joint Compression and Classification Network for Epilepsy Seizure Prediction

abstract: Recent development in brain-machine interface technology has made seizure prediction possible. However, the communication of large volume of electrophysiological signals between sensors and processing apparatus and related computation become two major bottlenecks for seizure prediction systems due to the constrained bandwidth and limited computation resource, especially for wearable and implantable medical devices. Although compressive sensing (CS) can be adopted to compress the signals to reduce communication bandwidth requirement, it needs a complex reconstruction procedure before the signal can be used for seizure prediction. In this paper, we propose C$^2$SP-Net, to jointly solve compression, prediction, and reconstruction with a single neural network. A plug-and-play in-sensor compression matrix is constructed to reduce transmission bandwidth requirement. The compressed signal can be used for seizure prediction without additional reconstruction steps. Reconstruction of the original signal can also be carried out in high fidelity. Prediction accuracy, sensitivity, false prediction rate, and reconstruction quality of the proposed framework are evaluated under various compression ratios. The experimental results illustrate that our model outperforms the competitive state-of-the-art baselines by a large margin in prediction accuracy. In particular, our proposed method produces an average loss of 0.35 % in prediction accuracy with a compression ratio ranging from 1/2 to 1/16.


title: Alpha-IoU: A Family of Power Intersection over Union Losses for Bounding Box Regression

abstract: Bounding box (bbox) regression is a fundamental task in computer vision. So far, the most commonly used loss functions for bbox regression are the Intersection over Union (IoU) loss and its variants. In this paper, we generalize existing IoU-based losses to a new family of power IoU losses that have a power IoU term and an additional power regularization term with a single power parameter $\alpha$. We call this new family of losses the $\alpha$-IoU losses and analyze properties such as order preservingness and loss/gradient reweighting. Experiments on multiple object detection benchmarks and models demonstrate that $\alpha$-IoU losses, 1) can surpass existing IoU-based losses by a noticeable performance margin; 2) offer detectors more flexibility in achieving different levels of bbox regression accuracy by modulating $\alpha$; and 3) are more robust to small datasets and noisy bboxes.


title: The Impact of the New $^{65\!}$As(p,$\gamma$)$^{66\!}$Se Reaction Rate on the Two-Proton Sequential Capture of $^{64}\!$Ge, Weak GeAs Cycles, and Type-I X-Ray Bursts such as the Clocked Burster GS 1826$-$24

abstract: We re-assess $^{65}$As(p,$\gamma$)$^{66}$Se reaction rates based on a set of proton thresholds of $^{66}$Se, $S_\mathrm{p}$($^{66}$Se), estimated from the experimental mirror nuclear masses, theoretical mirror displacement energies, and full $pf$-model space shell-model calculation. The self-consistent relativistic Hartree-Bogoliubov theory is employed to obtain the mirror displacement energies with much reduced uncertainty, and thus reducing the proton-threshold uncertainty up to 161 keV compared to the AME2020 evaluation. Using the simulation instantiated by the one-dimensional multi-zone hydrodynamic code, KEPLER, that closely reproduces the observed GS 1826$-$24 clocked bursts, the present forward and reverse $^{65}$As(p,$\gamma$)$^{66}$Se reaction rates based on a selected $S_\mathrm{p}$($^{66}$Se) = 2.469$\pm$0.054 MeV, and the latest $^{22}$Mg($\alpha$,p)$^{25}$Al, $^{56}$Ni(p,$\gamma$)$^{57}$Cu(p,$\gamma$)$^{58}$Zn, $^{55}$Ni(p,$\gamma$)$^{56}$Cu, and $^{64}$Ge(p,$\gamma$)$^{65}$As reaction rates, we find that though the GeAs cycles is weakly established in the rapid-proton capture process path, the $^{65}$As(p,$\gamma$)$^{66}$Se reaction still strongly characterizes the burst tail end due to the two-proton sequential capture on $^{64}$Ge, not found by Cyburt et al. (2016) sensitivity study. The $^{65}$As(p,$\gamma$)$^{66}$Se reaction influences the abundances of nuclei $A$ = 64, 68, 72, 76, and 80 up to a factor of 1.4. The new $S_\mathrm{p}$($^{66}$Se) and the inclusion of the updated $^{22}$Mg($\alpha$,p)$^{25}$Al reaction rate increases the production of $^{12}$C up to a factor of $4.5$ that is not observable and could be the main fuel for superburst. The waiting point status of and two-proton sequential capture on $^{64}$Ge, weak-cycle feature of GeAs at region heavier than $^{64}$Ge, and impact of other possible $S_\mathrm{p}$($^{66}$Se) are also discussed.


title: A Personalized Diagnostic Generation Framework Based on Multi-source Heterogeneous Data

abstract: Personalized diagnoses have not been possible due to sear amount of data pathologists have to bear during the day-to-day routine. This lead to the current generalized standards that are being continuously updated as new findings are reported. It is noticeable that these effective standards are developed based on a multi-source heterogeneous data, including whole-slide images and pathology and clinical reports. In this study, we propose a framework that combines pathological images and medical reports to generate a personalized diagnosis result for individual patient. We use nuclei-level image feature similarity and content-based deep learning method to search for a personalized group of population with similar pathological characteristics, extract structured prognostic information from descriptive pathology reports of the similar patient population, and assign importance of different prognostic factors to generate a personalized pathological diagnosis result. We use multi-source heterogeneous data from TCGA (The Cancer Genome Atlas) database. The result demonstrate that our framework matches the performance of pathologists in the diagnosis of renal cell carcinoma. This framework is designed to be generic, thus could be applied for other types of cancer. The weights could provide insights to the known prognostic factors and further guide more precise clinical treatment protocols.


title: Large Platonic Markets with Delays

abstract: The objective is to develop a general stochastic approach to delays on financial markets. We suggest such a concept in the context of large platonic markets, which allow infinitely many assets and incorporate a restricted information setting. The discussion is divided into information delays and order execution delays. The former enables modelling of markets where the observed information is delayed, while the latter provides the opportunity to defer the indexed time of a received asset price. Both delays may be designed randomly and inhomogeneously over time. We show that delayed markets are equipped with a fundamental theorem of asset pricing and our main result is inheritance of the no asymptotic Lp-free lunch condition under both delay types. Eventually, we suggest an approach to verify absence of Lp-free lunch on markets with multiple brokers endowed with deviating trading speeds.


title: Giant quadratic magneto-optical response of thin YIG films for sensitive magnetometric experiments

abstract: We report on observation of a magneto-optical effect quadratic in magnetization (Cotton-Mouton effect) in 50 nm thick layer of Yttrium-Iron Garnet (YIG). By a combined theoretical and experimental approach, we managed to quantify both linear and quadratic magneto-optical effects. We show that the quadratic magneto-optical signal in the thin YIG film can exceed the linear magneto-optical response, reaching values of 450 urad that are comparable with Heusler alloys or ferromagnetic semiconductors. Furthermore, we demonstrate that a proper choice of experimental conditions, particularly with respect to the wavelength, is crucial for optimization of the quadratic magneto-optical effect for magnetometry measurement.


title: Uncertainty quantification in a mechanical submodel driven by a Wasserstein-GAN

abstract: The analysis of parametric and non-parametric uncertainties of very large dynamical systems requires the construction of a stochastic model of said system. Linear approaches relying on random matrix theory and principal componant analysis can be used when systems undergo low-frequency vibrations. In the case of fast dynamics and wave propagation, we investigate a random generator of boundary conditions for fast submodels by using machine learning. We show that the use of non-linear techniques in machine learning and data-driven methods is highly relevant. Physics-informed neural networks is a possible choice for a data-driven method to replace linear modal analysis. An architecture that support a random component is necessary for the construction of the stochastic model of the physical system for non-parametric uncertainties, since the goal is to learn the underlying probabilistic distribution of uncertainty in the data. Generative Adversarial Networks (GANs) are suited for such applications, where the Wasserstein-GAN with gradient penalty variant offers improved convergence results for our problem. The objective of our approach is to train a GAN on data from a finite element method code (Fenics) so as to extract stochastic boundary conditions for faster finite element predictions on a submodel. The submodel and the training data have both the same geometrical support. It is a zone of interest for uncertainty quantification and relevant to engineering purposes. In the exploitation phase, the framework can be viewed as a randomized and parametrized simulation generator on the submodel, which can be used as a Monte Carlo estimator.


title: Malicious Mode Attack on EV Coordinated Charging Load and MIADRC Defense Strategy

abstract: The Internet of Things (IoT) provides a salient communication environment to facilitate the coordinated charging of electric vehicle (EV) load. However, as IoT is connected with the public network, the coordinated charging system is in a low-level cyber security and greatly vulnerable to malicious attacks. This paper investigates the malicious mode attack (MMA), which is a new cyberattack pattern that simultaneously attacks massive EV charging piles to generate continuous sinusoidal power disturbance with the same frequency as the poorly-damped wide-area electromechanical mode. Thereby, high amplitude forced oscillations could be stimulated by MMA, which seriously threats the power system stability. First, the potential threat of MMA is clarified by investigating the vulnerability of the IoT-based coordinated charging load control system, and an MMA process like Mirai is pointed out as an example. And then, based on the attack process, an MMA model is established for impact analysis where expressions of the mean and stochastic responses of the MMA forced oscillation are derived to discover main impact factors. Further, to mitigate the impact of MMA, a defense strategy based on multi-index information active disturbance rejection control is proposed to improve the stability and anti-disturbance ability of the power system, which considers the impact factors of both mode damping and disturbance compensation. Simulations are conducted to verify the existence and characteristics of MMA threats, and the efficiency of the proposed defense strategy is also validated.


title: Novel Corrections to the Momentum Sum Rule for Nuclear Structure Functions

abstract: We address novel features of deep inelastic lepton scattering on nuclei at small Bjorken variable $x_{Bj}$. In this regime the lepton-nuclear cross section involves the interference between the standard lepton-quark scattering amplitude for the deep inelastic scattering (DIS) process on a single nucleon and a two-step process where diffractive scattering on a first nucleon combines with the amplitude for DIS on a second nucleon. The phases associated with the $t$-channel exchanges to the diffractive amplitude can produce either a destructive or constructive quantum-mechanical interference of the one-step and two-step amplitudes. This provides a mechanism regulating the respective amounts of shadowing suppression and anti-shadowing enhancement at low $x_{Bj}$. Furthermore, the standard leading-twist operator product and handbag diagram analyses of the forward virtual Compton amplitude on the nucleus are inapplicable, barring a conventional probabilistic interpretation. A main observable consequence is the impossibility of extracting momentum and spin sum rules from nuclear structure functions. We present numerical predictions supporting this picture and test them against DIS neutrino-nucleus and charged-lepton-nucleus scattering data.


title: BioIE: Biomedical Information Extraction with Multi-head Attention Enhanced Graph Convolutional Network

abstract: Constructing large-scaled medical knowledge graphs can significantly boost healthcare applications for medical surveillance, bring much attention from recent research. An essential step in constructing large-scale MKG is extracting information from medical reports. Recently, information extraction techniques have been proposed and show promising performance in biomedical information extraction. However, these methods only consider limited types of entity and relation due to the noisy biomedical text data with complex entity correlations. Thus, they fail to provide enough information for constructing MKGs and restrict the downstream applications. To address this issue, we propose Biomedical Information Extraction, a hybrid neural network to extract relations from biomedical text and unstructured medical reports. Our model utilizes a multi-head attention enhanced graph convolutional network to capture the complex relations and context information while resisting the noise from the data. We evaluate our model on two major biomedical relationship extraction tasks, chemical-disease relation and chemical-protein interaction, and a cross-hospital pan-cancer pathology report corpus. The results show that our method achieves superior performance than baselines. Furthermore, we evaluate the applicability of our method under a transfer learning setting and show that BioIE achieves promising performance in processing medical text from different formats and writing styles.


title: On the existence of graphs which can colour every regular graph

abstract: Let $H$ and $G$ be graphs. An $H$-colouring of $G$ is a proper edge-colouring $f:E(G)\rightarrow E(H)$ such that for any vertex $u\in V(G)$ there exists a vertex $v\in V(H)$ with $f\left (\partial_Gu\right )=\partial_Hv$, where $\partial_Gu$ and $\partial_Hv$ respectively denote the sets of edges in $G$ and $H$ incident to the vertices $u$ and $v$. If $G$ admits an $H$-colouring we say that $H$ colours $G$. The question whether there exists a graph $H$ that colours every bridgeless cubic graph is addressed directly by the Petersen Colouring Conjecture, which states that the Petersen graph colours every bridgeless cubic graph. In 2012, Mkrtchyan showed that if this conjecture is true, the Petersen graph is the unique connected bridgeless cubic graph $H$ which can colour all bridgeless cubic graphs. In this paper we extend this and show that if we were to remove all degree conditions on $H$, every bridgeless cubic graph $G$ can be coloured substantially only by a unique other graph: the subcubic multigraph $S_{4}$ on four vertices. A few similar results are provided also under weaker assumptions on the graph $G$. In the second part of the paper, we also consider $H$-colourings of regular graphs having degree strictly greater than $3$ and show that: (i) for any $r>3$, there does not exist a connected graph $H$ (possibly containing parallel edges) that colours every $r$-regular multigraph, and (ii) for every $r>1$, there does not exist a connected graph $H$ (possibly containing parallel edges) that colours every $2r$-regular simple graph.


title: The magnetic anisotropy of individually addressed spin states

abstract: Controlling magnetic anisotropy is a key requirement for the fundamental understanding of molecular magnetism and is a prerequisite for numerous applications in magnetic storage, spintronics, and all-spin logic devices. In order to address the question of molecular magnetic anisotropy experimentally, we have synthesized single-crystals of a molecular spin system containing four antiferromagnetically coupled s = 5/2 manganese(II) ions. Using low-temperature cantilever magnetometry, we demonstrate the selective population of the S = 0, 1, . . . , 10 spin states upon application of magnetic fields up to 33 T and map the magnetic anisotropy of each of these states. We observe a strong dependence of the shape and size of the magnetic anisotropy on the populated spin states, and, in particular, reveal an anisotropy reversal upon going from the lowest to the highest spin-state.


title: Dynamical Systems on Graph Limits and Their Symmetries

abstract: The collective dynamics of interacting dynamical units on a network crucially depends on the properties of the network structure. Rather than considering large but finite graphs to capture the network, one often resorts to graph limits and the dynamics thereon. We elucidate the symmetry properties of dynamical systems on graph limits -- including graphons and graphops -- and analyze how the symmetry shape the dynamics, for example through invariant subspaces. In addition to traditional symmetries, dynamics on graph limits can support generalized noninvertible symmetries. Moreover, as asymmetric networks can have symmetric limits, we note that one can expect to see ghosts of symmetries in the dynamics of large asymmetric networks.


title: Quartic del Pezzo surfaces with a Brauer group of order 4

abstract: We study arithmetic properties of del Pezzo surfaces of degree 4 for which the Brauer group has the largest possible order using different fibrations into curves. We show that if such a surface admits a conic fibration, then it always has a rational point. We also answer a question of V\'arilly-Alvarado and Viray by showing that the Brauer groups these surfaces cannot be vertical with respect to any projection away from a plane. We conclude that the available techniques for proving existence of rational points or even Zariski density do not directly apply if there is no Brauer-Manin obstruction to the Hasse principle. In passing we pick up the first examples of quartic del Pezzo surfaces with a Brauer group of order 4 for which the failure of the Hasse principle is explained by a Brauer-Manin obstruction.


title: A Closer Look at Reference Learning for Fourier Phase Retrieval

abstract: Reconstructing images from their Fourier magnitude measurements is a problem that often arises in different research areas. This process is also referred to as phase retrieval. In this work, we consider a modified version of the phase retrieval problem, which allows for a reference image to be added onto the image before the Fourier magnitudes are measured. We analyze an unrolled Gerchberg-Saxton (GS) algorithm that can be used to learn a good reference image from a dataset. Furthermore, we take a closer look at the learned reference images and propose a simple and efficient heuristic to construct reference images that, in some cases, yields reconstructions of comparable quality as approaches that learn references. Our code is available at https://github.com/tuelwer/reference-learning.


title: Phase I Analysis of High-Dimensional Processes in the Presence of Outliers

abstract: One of the significant challenges in monitoring the quality of products today is the high dimensionality of quality characteristics. In this paper, we address Phase I analysis of high-dimensional processes with individual observations when the available number of samples collected over time is limited. Using a new charting statistic, we propose a robust procedure for parameter estimation in Phase I. This robust procedure is efficient in parameter estimation in the presence of outliers or contamination in the data. A consistent estimator is proposed for parameter estimation and a finite sample correction coefficient is derived and evaluated through simulation. We assess the statistical performance of the proposed method in Phase I in terms of the probability of signal criterion. This assessment is carried out in the absence and presence of outliers. We show that, in both phases, the proposed control chart scheme effectively detects various kinds of shifts in the process mean. Besides, we present two real-world examples to illustrate the applicability of our proposed method.


title: Frequency and frequency modulation share the same predictive encoding mechanisms in human auditory cortex

abstract: Expectations can substantially influence perception. Predictive coding is a theory of sensory processing that aims to explain the neural mechanisms underlying the effect of expectations in sensory processing. Its main assumption is that sensory neurons encode prediction error with respect to expected sensory input. Neural populations encoding prediction error have been previously reported in the human auditory cortex (AC); however, most studies focused on the encoding of pure tones and induced expectations by stimulus repetition, potentially confounding prediction error with effects of neural habituation. Here, we systematically studied prediction error to pure tones and fast frequency modulated (FM) sweeps across different auditory cortical fields in humans. We conducted two fMRI experiments, each using one type of stimulus. We measured BOLD responses across the bilateral auditory cortical fields Te1.0, Te1.1, Te1.2, and Te3 while participants listened to sequences of sounds. We induced subjective expectations on the incoming sounds independently of stimulus repetition using abstract rules. Our results indicate that pure tones and FM-sweeps are encoded as prediction error with respect to the participants' expectations across auditory cortical fields. The topographical distribution of neural populations encoding prediction error to pure tones and FM-sweeps was highly correlated in left Te1.1 and Te1.2, and in bilateral Te3, suggesting that predictive coding is the general encoding mechanism in AC.


title: An Explicit-Joint and Supervised-Contrastive Learning Framework for Few-Shot Intent Classification and Slot Filling

abstract: Intent classification (IC) and slot filling (SF) are critical building blocks in task-oriented dialogue systems. These two tasks are closely-related and can flourish each other. Since only a few utterances can be utilized for identifying fast-emerging new intents and slots, data scarcity issue often occurs when implementing IC and SF. However, few IC/SF models perform well when the number of training samples per class is quite small. In this paper, we propose a novel explicit-joint and supervised-contrastive learning framework for few-shot intent classification and slot filling. Its highlights are as follows. (i) The model extracts intent and slot representations via bidirectional interactions, and extends prototypical network to achieve explicit-joint learning, which guarantees that IC and SF tasks can mutually reinforce each other. (ii) The model integrates with supervised contrastive learning, which ensures that samples from same class are pulled together and samples from different classes are pushed apart. In addition, the model follows a not common but practical way to construct the episode, which gets rid of the traditional setting with fixed way and shot, and allows for unbalanced datasets. Extensive experiments on three public datasets show that our model can achieve promising performance.


title: Annotating Implicit Reasoning in Arguments with Causal Links

abstract: Most of the existing work that focus on the identification of implicit knowledge in arguments generally represent implicit knowledge in the form of commonsense or factual knowledge. However, such knowledge is not sufficient to understand the implicit reasoning link between individual argumentative components (i.e., claim and premise). In this work, we focus on identifying the implicit knowledge in the form of argumentation knowledge which can help in understanding the reasoning link in arguments. Being inspired by the Argument from Consequences scheme, we propose a semi-structured template to represent such argumentation knowledge that explicates the implicit reasoning in arguments via causality. We create a novel two-phase annotation process with simplified guidelines and show how to collect and filter high-quality implicit reasonings via crowdsourcing. We find substantial inter-annotator agreement for quality evaluation between experts, but find evidence that casts a few questions on the feasibility of collecting high-quality semi-structured implicit reasoning through our crowdsourcing process. We release our materials(i.e., crowdsourcing guidelines and collected implicit reasonings) to facilitate further research towards the structured representation of argumentation knowledge.


title: A proposed method using GPU based SDO to optimize retail warehouses

abstract: Research in warehouse optimization has gotten increased attention in the last few years due to e-commerce. The warehouse contains a waste range of different products. Due to the nature of the individual order, it is challenging to plan the picking list to optimize the material flow in the process. There are also challenges in minimizing costs and increasing production capacity, and this complexity can be defined as a multidisciplinary optimization problem with an IDF nature. In recent years the use of parallel computing using GPGPUs has become increasingly popular due to the introduction of CUDA C and accompanying applications in, e.g., Python. In the case study at the company in the field of retail, a case study including a system design optimization (SDO) resulted in an increase in throughput with well over 20% just by clustering different categories and suggesting in which sequence the orders should be picked during a given time frame. The options provided by implementing a distributed high-performance computing network based on GPUs for subsystem optimization have shown to be fruitful in developing a functioning SDO for warehouse optimization. The toolchain can be used for designing new warehouses or evaluating and tuning existing ones.


title: A fast horizon detector and a new annotated dataset for maritime video processing

abstract: Accurate and fast sea horizon detection is vital for tasks in autonomous navigation and maritime security, such as video stabilization, target region reduction, precise tracking, and obstacle avoidance. This paper introduces a novel sea horizon detector from RGB videos, focusing on rapid and effective sea noise suppression while preserving weak horizon edges. Line fitting methods are subsequently employed on filtered edges for horizon detection. We address the filtering problem by extracting line segments with a very low edge threshold, ensuring the detection of line segments even in low-contrast horizon conditions. We show that horizon line segments have simple and relevant properties in RGB images, which we exploit to suppress noisy segments. Then we use the surviving segments to construct a filtered edge map and infer the horizon from the filtered edges. We propose a careful incorporation of temporal information for horizon inference and experimentally show its effectiveness. We address the computational constraint by providing a vectorized implementation for efficient CPU execution, and leveraging image downsizing with minimal loss of accuracy on the original size. Moreover, we contribute a public horizon line dataset to enrich existing data resources. Our algorithm's performance is rigorously evaluated against state-of-the-art methods, and its components are validated through ablation experiments. Source code and dataset files are available at:


title: Light meson decays at BESIII

abstract: The world's largest sample of $J/\psi$ events accumulated at the BESIII dector offers a unique opportunity to investigate $\eta$ and $\eta^\prime$ physics via two body $J/\psi$ radiative or hadronic decays. In recent years the BESIII experiment has made significant progresses in $\eta/\eta^\prime$ decays. A selection of recent highlights in light meson spectroscopy at BESIII are reviewed in this report, including the observation of $\eta^\prime\rightarrow\pi^+\pi^-\mu^+\mu^-$, the study of $\eta^\prime\rightarrow\pi^+\pi^-e^+e^-$, and search for $CP$-violation in this decay, search for the rare decays of $\eta^\prime\rightarrow4\pi^0$ and $\eta^\prime\rightarrow\gamma\gamma\eta$, as well as the precision measurement of the branching fraction of $\eta^\prime$ decays.


title: On Monitoring High-Dimensional Processes with Individual Observations

abstract: Modern data collecting methods and computation tools have made it possible to monitor high-dimensional processes. In this article, Phase II monitoring of high-dimensional processes is investigated when the available number of samples collected in Phase I is limitted in comparison to the number of variables. A new charting statistic for high-dimensional multivariate processes based on the diagonal elements of the underlying covariance matrix is introduced and a unified procedure for Phase I and II by employing a self-starting control chart is proposed. To remedy the effect of outliers, we adopt a robust procedure for parameter estimation in Phase I and introduce the appropriate consistent estimators. The statistical performance of the proposed method is evaluated in Phase II through average run length (ARL) criterion in the absence and presence of outliers and reveals that the proposed control chart scheme effectively detects various kinds of shifts in the process mean. Finally, we illustrate the applicability of our proposed method via a real-world example.


title: Spinorial Snyder and Yang Models From Superalgebras And Noncommutative Quantum Superspaces

abstract: The relativistic Lorentz-covariant quantum space-times obtained by Snyder can be described by the coset generators of (anti) de-Sitter algebras. Similarly, the Lorentz-covariant quantum phase spaces introduced by Yang, which contain additionally quantum curved fourmomenta and quantum-deformed relativistic Heisenberg algebra, can be defined by suitably chosen coset generators of conformal algebras. We extend such algebraic construction to the respective superalgebras, which provide quantum Lorentz-covariant superspaces (SUSY Snyder model) and indicate also how to obtain the quantum relativistic phase superspaces (SUSY Yang model). In last Section we recall briefly other ways of deriving quantum phase (super)spaces and we compare the spinorial Snyder type models defining bosonic or fermionic quantum-deformed spinors.


title: Norms of maximal functions between generalized and classical Lorentz spaces

abstract: In this paper we calculate the norm of the generalized maximal operator $M_{\phi,\Lambda^{\alpha}(b)}$, defined with $0 < \alpha < \infty$ and functions $b,\,\phi: (0,\infty) \rightarrow (0,\infty)$ for all measurable functions $f$ on ${\mathbb R}^n$ by \begin{equation*} M_{\phi,\Lambda^{\alpha}(b)}f(x) : = \sup_{Q \ni x} \frac{\|f \chi_Q\|_{\Lambda^{\alpha}(b)}}{\phi (|Q|)}, \qquad x \in {\mathbb R}^n, \end{equation*} from ${\operatorname{G\Gamma}}(p,m,v)$ into $\Lambda^q(w)$. Here $\Lambda^{\alpha}(b)$ and ${\operatorname{G\Gamma}}(p,m,w)$ are the classical and generalized Lorentz spaces, defined as a set of all measurable functions $f$ defined on ${\mathbb R}^n$ for which $$ \|f\|_{\Lambda^{\alpha}(b)} = \bigg( \int_0^{\infty} [f^*(s)]^{\alpha} b(s)\,ds \bigg)^{\frac{1}{\alpha}} < \infty \quad \mbox{and} \quad \|f\|_{{\operatorname{G\Gamma}}(p,m,w)} = \bigg( \int_0^{\infty} \bigg( \int_0^x [f^* (\tau)]^p\,d\tau \bigg)^{\frac{m}{p}} v(x)\,dx \bigg)^{\frac{1}{m}} < \infty, $$ respectively. We reduce the problem to the solution of the inequality \begin{equation*} \bigg( \int_0^{\infty} \big[ T_{u,b}f^* (x)\big]^q \, w(x)\,dx\bigg)^{\frac{1}{q}} \le C \, \bigg( \int_0^{\infty} \bigg( \int_0^x [f^* (\tau)]^p\,d\tau \bigg)^{\frac{m}{p}} v(x)\,dx \bigg)^{\frac{1}{m}} \end{equation*} where $w$ and $v$ are weight functions on $(0,\infty)$. Here $f^*$ is the non-increasing rearrangement of $f$ defined on ${\mathbb R}^n$ and $T_{u,b}$ is the iterated Hardy-type operator involving suprema, which is defined for a measurable non-negative function $f$ on $(0,\infty)$ by $$ (T_{u,b} g)(t) : = \sup_{\tau \in [t,\infty)} \frac{u(\tau)}{B(\tau)} \int_0^{\tau} g(s)b(s)\,ds,\qquad t \in (0,\infty), $$ where $u$ and $b$ are appropriate weight functions on $(0,\infty)$ and the function $B(t) : = \int_0^t b(s)\,ds$ satisfies $0 < B(t) < \infty$ for every $t \in (0,\infty)$..


title: Addressing out-of-distribution label noise in webly-labelled data

abstract: A recurring focus of the deep learning community is towards reducing the labeling effort. Data gathering and annotation using a search engine is a simple alternative to generating a fully human-annotated and human-gathered dataset. Although web crawling is very time efficient, some of the retrieved images are unavoidably noisy, i.e. incorrectly labeled. Designing robust algorithms for training on noisy data gathered from the web is an important research perspective that would render the building of datasets easier. In this paper we conduct a study to understand the type of label noise to expect when building a dataset using a search engine. We review the current limitations of state-of-the-art methods for dealing with noisy labels for image classification tasks in the case of web noise distribution. We propose a simple solution to bridge the gap with a fully clean dataset using Dynamic Softening of Out-of-distribution Samples (DSOS), which we design on corrupted versions of the CIFAR-100 dataset, and compare against state-of-the-art algorithms on the web noise perturbated MiniImageNet and Stanford datasets and on real label noise datasets: WebVision 1.0 and Clothing1M. Our work is fully reproducible https://git.io/JKGcj


title: Stirred Kardar-Parisi-Zhang equation with quenched random noise: Emergence of induced nonlinearity

abstract: We study the stochastic Kardar-Parisi-Zhang equation for kinetic roughening where the time-independent (columnar or spatially quenched) Gaussian random noise $f(t,{\bf x})$ is specified by the pair correlation function $\langle f(t,{\bf x})f(t',{\bf x'}) \rangle \propto \delta^{(d)} ({\bf x-x'})$, $d$ being the dimension of space. The field-theoretic renormalization group analysis shows that the effect of turbulent motion of the environment (modelled by the coupling with the velocity field described by the Kazantsev-Kraichnan statistical ensemble for an incompressible fluid) gives rise to a new nonlinear term, quadratic in the velocity field. It turns out that this "induced" nonlinearity strongly affects the scaling behaviour in several universality classes (types of long-time, large-scale asymptotic regimes) even when the turbulent advection appears irrelevant in itself. Practical calculation of the critical exponents (that determine the universality classes) is performed to the first order of the double expansion in $\varepsilon=4-d$ and the velocity exponent $\xi$ (one-loop approximation). As is the case with most "descendants" of the Kardar-Parisi-Zhang model, some relevant fixed points of the renormalization group equations lie in "forbidden zones," i.e. in those corresponding to negative kinetic coefficients or complex couplings. This persistent phenomenon in stochastic non-equilibrium models requires careful and inventive physical interpretation.


title: Heterogenous criticality in high frequency finance: a phase transition in flash crashes

abstract: Flash crashes in financial markets have become increasingly important attracting attention from financial regulators, market makers as well as from the media and the broader audience. Systemic risk and propagation of shocks in financial markets is also a topic of great relevance that attracted increasing attention in recent years. In the present work we bridge the gap between these two topics with an in-depth investigation of the systemic risk structure of co-crashes in high frequency trading. We find that large co-crashes are systemic in their nature and differ from small crashes. We demonstrate that there is a phase transition between co-crashes of small and large sizes, where the former involves mostly illiquid stocks while large and liquid stocks are the most represented and central in the latter. This suggests that systemic effects and shock propagation might be triggered by simultaneous withdrawals or movement of liquidity by HFTs, arbitrageurs and market makers with cross-asset exposures.


title: Detection of ethanol in water by electrical impedance spectroscopy and resonant perturbation method

abstract: Development of highly sensitive, portable and low-cost sensors for the evaluation of ethanol content in liquid is particularly important in several process monitoring, from food to pharmaceutical industry. In this respect, here we report on the design, fabrication and performances of two simple electrical devices, namely interdigitated (ID) electrodes and complementary double split ring resonator (CDSRR), for the detection of ethanol in water though impedance and perturbation resonance methods, respectively. Both sensors resulted to be efficient for detection of low amount of ethanol in water, in particular EIS gives possibility to perform broadband evaluation of ethanol concentration in solution, and the employment of resonant cavities allows to achieve very low limit of detection of 0.2v/v%.


title: Weakly Quasisymmetric Near-Axis Solutions to all Orders

abstract: We show that the equations satisfied by weakly quasisymmetric magnetic fields can be solved to arbitrarily high order in powers of the distance from the magnetic axis. This demonstration does not consider force balance. The existence of solutions requires an appropriate choice of parameters, most notably the toroidal current or rotational transform profiles. We do not prove that the expansion converges (it is likely divergent but asymptotic), and thus the demonstration here should not be taken as definitive proof of the existence of global solutions. Instead, we provide a systematic construction of solutions to arbitrarily high order.


title: Encoding of Predicate Subtyping with Proof Irrelevance in the $\lambda$$\Pi$-Calculus Modulo Theory

abstract: The $\lambda$$\Pi$-calculus modulo theory is a logical framework in which various logics and type systems can be encoded, thus helping the cross-verification and interoperability of proof systems based on those logics and type systems. In this paper, we show how to encode predicate subtyping and proof irrelevance, two important features of the PVS proof assistant. We prove that this encoding is correct and that encoded proofs can be mechanically checked by Dedukti, a type checker for the $\lambda$$\Pi$-calculus modulo theory using rewriting.


title: Causal Effect Estimation using Variational Information Bottleneck

abstract: Causal inference is to estimate the causal effect in a causal relationship when intervention is applied. Precisely, in a causal model with binary interventions, i.e., control and treatment, the causal effect is simply the difference between the factual and counterfactual. The difficulty is that the counterfactual may never been obtained which has to be estimated and so the causal effect could only be an estimate. The key challenge for estimating the counterfactual is to identify confounders which effect both outcomes and treatments. A typical approach is to formulate causal inference as a supervised learning problem and so counterfactual could be predicted. Including linear regression and deep learning models, recent machine learning methods have been adapted to causal inference. In this paper, we propose a method to estimate Causal Effect by using Variational Information Bottleneck (CEVIB). The promising point is that VIB is able to naturally distill confounding variables from the data, which enables estimating causal effect by using observational data. We have compared CEVIB to other methods by applying them to three data sets showing that our approach achieved the best performance. We also experimentally showed the robustness of our method.


title: A Radar Signal Deinterleaving Method Based on Semantic Segmentation with Neural Network

abstract: Radar signal deinterleaving is an important part of electronic reconnaissance. This study proposes a new radar signal deinterleaving method based on semantic segmentation, which we call "semantic segmentation deinterleaving" (SSD). We select representative sequence modeling neural network (NN) architectures and input the difference of time of arrival of the pulse stream into them. According to semantics contained in different radar signal types, each pulse in the pulse stream is marked according to the category of semantics contained, and radar signals are deinterleaved. Compared to the traditional deinterleaving method, the SSD method can adapt to complex pulse repetition interval (PRI) modulation environments without searching the PRI or PRI period. Multiple rounds of search and merging operation are not required for radar signals with multiple pulses in a period. Compared to other deinterleaving methods based on NNs, the SSD method does not need to digitize the data and train a network for each target type. The SSD method also does not need to iterate input and output data. The proposed method has high robustness to pulse loss and noise pulses. This research also shows that recurrent NNs still have more advantages than convolutional NNs in this sequence modeling task.


title: Quantum cryptographic resource distillation and entanglement

abstract: We look into multipartite quantum states on which quantum cryptographic protocols including quantum key distribution and quantum secret sharing can be perfectly performed, and define the quantum cryptographic resource distillable rate as the asymptotic rate at which such multipartite state can be distilled from a given multipartite state. Investigating several relations between entanglement and the rate, we show that there exists a multipartite bound entangled state whose quantum cryptographic resource distillable rate is strictly positive, that is, there exists a multipartite entangled state which is not distillable, but can be useful for quantum cryptography such as quantum key distribution and quantum secret sharing.


title: TNTC: two-stream network with transformer-based complementarity for gait-based emotion recognition

abstract: Recognizing the human emotion automatically from visual characteristics plays a vital role in many intelligent applications. Recently, gait-based emotion recognition, especially gait skeletons-based characteristic, has attracted much attention, while many available methods have been proposed gradually. The popular pipeline is to first extract affective features from joint skeletons, and then aggregate the skeleton joint and affective features as the feature vector for classifying the emotion. However, the aggregation procedure of these emerged methods might be rigid, resulting in insufficiently exploiting the complementary relationship between skeleton joint and affective features. Meanwhile, the long range dependencies in both spatial and temporal domains of the gait sequence are scarcely considered. To address these issues, we propose a novel two-stream network with transformer-based complementarity, termed as TNTC. Skeleton joint and affective features are encoded into two individual images as the inputs of two streams, respectively. A new transformer-based complementarity module (TCM) is proposed to bridge the complementarity between two streams hierarchically via capturing long range dependencies. Experimental results demonstrate TNTC outperforms state-of-the-art methods on the latest dataset in terms of accuracy.


title: Topological phase transitions in strongly correlated systems: application to Co$_3$Sn$_2$S$_2$

abstract: The topological transition in the strongly correlated half-metallic ferromagnetic compound Co$_3$Sn$_2$S$_2$ from Weyl semimetal (including chiral massless fermions) to a non-magnetic state is treated. This transition goes with a change in topological invariant, and is accompanied by a non-topological transition from saturated ferromagnetic to paramagnetic state, the minority Fermi surface being transformed from ghost (hidden) to real. A corresponding description is given in terms of slave fermion representation for the effective narrow-band Hubbard model. The system Co$_3$Sn$_2$S$_2$ provides a bright example of coexistence of non-trivial topology and strong low-dimensional ferromagnetism. A comparison is performed with other compounds where frustrations result in formation of a correlated paramagnetic state.


title: DASentimental: Detecting depression, anxiety and stress in texts via emotional recall, cognitive networks and machine learning

abstract: Most current affect scales and sentiment analysis on written text focus on quantifying valence (sentiment) -- the most primary dimension of emotion. However, emotions are broader and more complex than valence. Distinguishing negative emotions of similar valence could be important in contexts such as mental health. This project proposes a semi-supervised machine learning model (DASentimental) to extract depression, anxiety and stress from written text. First, we trained the model to spot how sequences of recalled emotion words by $N=200$ individuals correlated with their responses to the Depression Anxiety Stress Scale (DASS-21). Within the framework of cognitive network science, we model every list of recalled emotions as a walk over a networked mental representation of semantic memory, with emotions connected according to free associations in people's memory. Among several tested machine learning approaches, we find that a multilayer perceptron neural network trained on word sequences and semantic network distances can achieve state-of-art, cross-validated predictions for depression ($R = 0.7$), anxiety ($R = 0.44$) and stress ($R = 0.52$). Though limited by sample size, this first-of-its-kind approach enables quantitative explorations of key semantic dimensions behind DAS levels. We find that semantic distances between recalled emotions and the dyad "sad-happy" are crucial features for estimating depression levels but are less important for anxiety and stress. We also find that semantic distance of recalls from "fear" can boost the prediction of anxiety but it becomes redundant when the "sad-happy" dyad is considered. Adopting DASentimental as a semi-supervised learning tool to estimate DAS in text, we apply it to a dataset of 142 suicide notes. We conclude by discussing key directions for future research enabled by artificial intelligence detecting stress, anxiety and depression.


title: Hierarchical Transformers Are More Efficient Language Models

abstract: Transformer models yield impressive results on many NLP and sequence modeling tasks. Remarkably, Transformers can handle long sequences which allows them to produce long coherent outputs: full paragraphs produced by GPT-3 or well-structured images produced by DALL-E. These large language models are impressive but also very inefficient and costly, which limits their applications and accessibility. We postulate that having an explicit hierarchical architecture is the key to Transformers that efficiently handle long sequences. To verify this claim, we first study different ways to downsample and upsample activations in Transformers so as to make them hierarchical. We use the best performing upsampling and downsampling layers to create Hourglass - a hierarchical Transformer language model. Hourglass improves upon the Transformer baseline given the same amount of computation and can yield the same results as Transformers more efficiently. In particular, Hourglass sets new state-of-the-art for Transformer models on the ImageNet32 generation task and improves language modeling efficiency on the widely studied enwik8 benchmark.


title: Galactic cosmic ray propagation through M dwarf planetary systems

abstract: Quantifying the flux of cosmic rays reaching exoplanets around M dwarfs is essential to understand their possible effects on exoplanet habitability. Here, we investigate the propagation of Galactic cosmic rays as they travel through the stellar winds (astrospheres) of five nearby M dwarfs, namely: GJ 15A, GJ 273, GJ 338B, GJ 411 and GJ 887. Our selected stars each have 1 or 2 detected exoplanets and they all have wind mass-loss rates constrained by Lyman-alpha observations. Our simulations use a combined 1D magnetohydrodynamic (MHD) Alfv\'en-wave-driven stellar wind model and 1D cosmic ray transport model. We find that GJ 411 and GJ 887 have Galactic cosmic rays fluxes comparable with Earth's at their habitable zones. On the other hand, GJ 15A, GJ 273 and GJ 338B receive a lower Galactic cosmic ray flux in their habitable zones. All exoplanets in our sample, with exception of GJ 15A c and GJ 411 c, have a significantly lower flux of Galactic cosmic rays than values observed at the Earth because they orbit closer-in. The fluxes found here can be further used for chemical modelling of planetary atmospheres. Finally, we calculate the radiation dose at the surface of the habitable-zone planet GJ 273 b, assuming it has an Earth-like atmosphere. This planet receives up to 209 times less 15 MeV energy cosmic ray fluxes than values observed at Earth. However, for high-energy cosmic rays (~ GeV), the difference in flux is only 2.3 times smaller, which contributes to GJ 273 b receiving a significant surface radiation dose of 0.13 mSv/yr (40% of the annual dose on Earth's surface).


title: YOLO-ReT: Towards High Accuracy Real-time Object Detection on Edge GPUs

abstract: Performance of object detection models has been growing rapidly on two major fronts, model accuracy and efficiency. However, in order to map deep neural network (DNN) based object detection models to edge devices, one typically needs to compress such models significantly, thus compromising the model accuracy. In this paper, we propose a novel edge GPU friendly module for multi-scale feature interaction by exploiting missing combinatorial connections between various feature scales in existing state-of-the-art methods. Additionally, we propose a novel transfer learning backbone adoption inspired by the changing translational information flow across various tasks, designed to complement our feature interaction module and together improve both accuracy as well as execution speed on various edge GPU devices available in the market. For instance, YOLO-ReT with MobileNetV2x0.75 backbone runs real-time on Jetson Nano, and achieves 68.75 mAP on Pascal VOC and 34.91 mAP on COCO, beating its peers by 3.05 mAP and 0.91 mAP respectively, while executing faster by 3.05 FPS. Furthermore, introducing our multi-scale feature interaction module in YOLOv4-tiny and YOLOv4-tiny (3l) improves their performance to 41.5 and 48.1 mAP respectively on COCO, outperforming the original versions by 1.3 and 0.9 mAP.


title: Towards the theory of types III and IV non-Hermitian Weyl fermions

abstract: We develop the non-Hermitian Hamiltonian formalism to describe Weyl fermions of type III and IV. The spectrum of Hamiltonian has an unusual type of anisotropy. Namely, the hermiticity of Hamiltonian strongly depends on the direction in momentum space: for some directions the spectrum is real, in contrast for other directions it becomes complex. This fact leads to non-trivial adiabatic evolution and fractional Chern number. Additionally, we demonstrate that the non-Hermitian Hamiltonian can be regarded as a one-particle problem in context of topological band theory.


title: ConE: Cone Embeddings for Multi-Hop Reasoning over Knowledge Graphs

abstract: Query embedding (QE) -- which aims to embed entities and first-order logical (FOL) queries in low-dimensional spaces -- has shown great power in multi-hop reasoning over knowledge graphs. Recently, embedding entities and queries with geometric shapes becomes a promising direction, as geometric shapes can naturally represent answer sets of queries and logical relationships among them. However, existing geometry-based models have difficulty in modeling queries with negation, which significantly limits their applicability. To address this challenge, we propose a novel query embedding model, namely Cone Embeddings (ConE), which is the first geometry-based QE model that can handle all the FOL operations, including conjunction, disjunction, and negation. Specifically, ConE represents entities and queries as Cartesian products of two-dimensional cones, where the intersection and union of cones naturally model the conjunction and disjunction operations. By further noticing that the closure of complement of cones remains cones, we design geometric complement operators in the embedding space for the negation operations. Experiments demonstrate that ConE significantly outperforms existing state-of-the-art methods on benchmark datasets.


title: HIST: A Graph-based Framework for Stock Trend Forecasting via Mining Concept-Oriented Shared Information

abstract: Stock trend forecasting, which forecasts stock prices' future trends, plays an essential role in investment. The stocks in a market can share information so that their stock prices are highly correlated. Several methods were recently proposed to mine the shared information through stock concepts (e.g., technology, Internet Retail) extracted from the Web to improve the forecasting results. However, previous work assumes the connections between stocks and concepts are stationary, and neglects the dynamic relevance between stocks and concepts, limiting the forecasting results. Moreover, existing methods overlook the invaluable shared information carried by hidden concepts, which measure stocks' commonness beyond the manually defined stock concepts. To overcome the shortcomings of previous work, we proposed a novel stock trend forecasting framework that can adequately mine the concept-oriented shared information from predefined concepts and hidden concepts. The proposed framework simultaneously utilize the stock's shared information and individual information to improve the stock trend forecasting performance. Experimental results on the real-world tasks demonstrate the efficiency of our framework on stock trend forecasting. The investment simulation shows that our framework can achieve a higher investment return than the baselines.


title: Existence and stability of stationary solutions to the compressible quantum model

abstract: In this paper, the compressible quantum model with the given mass source and the external force of general form in three-dimensional whole space is considered. Based on the weighted $L^2$ method and $L^\infty$ estimates, the existence and uniqueness of stationary solutions can be obtained by the contraction mapping principle. By using a general energy method, the nonlinear stability of stationary solutions is studied, and the time decay rates of the solutions are established when the initial perturbation belongs to $\dot{H}^{-s}$ with $0 \leq s < \frac{3}{2}$.


title: Self-organised criticality in high frequency finance: the case of flash crashes

abstract: With the rise of computing and artificial intelligence, advanced modeling and forecasting has been applied to High Frequency markets. A crucial element of solid production modeling though relies on the investigation of data distributions and how they relate to modeling assumptions. In this work we investigate volume distributions during anomalous price events and show how their tail exponents < 2 indicate a diverging second moment of the distribution, i.e. variance. We then tie the dynamics of flash crashes to self-organised criticality. The findings are of great relevance for regulators and market makers as they advocate for rigorous heavy-tailed modeling of risk and changes in regulation to avoid simultaneous liquidity withdrawals and hard risk constraints which lead to synchronisation and critical events.


title: Semi-supervised dry herbage mass estimation using automatic data and synthetic images

abstract: Monitoring species-specific dry herbage biomass is an important aspect of pasture-based milk production systems. Being aware of the herbage biomass in the field enables farmers to manage surpluses and deficits in herbage supply, as well as using targeted nitrogen fertilization when necessary. Deep learning for computer vision is a powerful tool in this context as it can accurately estimate the dry biomass of a herbage parcel using images of the grass canopy taken using a portable device. However, the performance of deep learning comes at the cost of an extensive, and in this case destructive, data gathering process. Since accurate species-specific biomass estimation is labor intensive and destructive for the herbage parcel, we propose in this paper to study low supervision approaches to dry biomass estimation using computer vision. Our contributions include: a synthetic data generation algorithm to generate data for a herbage height aware semantic segmentation task, an automatic process to label data using semantic segmentation maps, and a robust regression network trained to predict dry biomass using approximate biomass labels and a small trusted dataset with gold standard labels. We design our approach on a herbage mass estimation dataset collected in Ireland and also report state-of-the-art results on the publicly released Grass-Clover biomass estimation dataset from Denmark. Our code is available at https://git.io/J0L2a


title: Deep DIC: Deep Learning-Based Digital Image Correlation for End-to-End Displacement and Strain Measurement

abstract: Digital image correlation (DIC) has become an industry standard to retrieve accurate displacement and strain measurement in tensile testing and other material characterization. Though traditional DIC offers a high precision estimation of deformation for general tensile testing cases, the prediction becomes unstable at large deformation or when the speckle patterns start to tear. In addition, traditional DIC requires a long computation time and often produces a low spatial resolution output affected by filtering and speckle pattern quality. To address these challenges, we propose a new deep learning-based DIC approach--Deep DIC, in which two convolutional neural networks, DisplacementNet and StrainNet, are designed to work together for end-to-end prediction of displacements and strains. DisplacementNet predicts the displacement field and adaptively tracks a region of interest. StrainNet predicts the strain field directly from the image input without relying on the displacement prediction, which significantly improves the strain prediction accuracy. A new dataset generation method is developed to synthesize a realistic and comprehensive dataset, including the generation of speckle patterns and the deformation of the speckle image with synthetic displacement fields. Though trained on synthetic datasets only, Deep DIC gives highly consistent and comparable predictions of displacement and strain with those obtained from commercial DIC software for real experiments, while it outperforms commercial software with very robust strain prediction even at large and localized deformation and varied pattern qualities. In addition, Deep DIC is capable of real-time prediction of deformation with a calculation time down to milliseconds.


title: Geometric Transformer for End-to-End Molecule Properties Prediction

abstract: Transformers have become methods of choice in many applications thanks to their ability to represent complex interactions between elements. However, extending the Transformer architecture to non-sequential data such as molecules and enabling its training on small datasets remains a challenge. In this work, we introduce a Transformer-based architecture for molecule property prediction, which is able to capture the geometry of the molecule. We modify the classical positional encoder by an initial encoding of the molecule geometry, as well as a learned gated self-attention mechanism. We further suggest an augmentation scheme for molecular data capable of avoiding the overfitting induced by the overparameterized architecture. The proposed framework outperforms the state-of-the-art methods while being based on pure machine learning solely, i.e. the method does not incorporate domain knowledge from quantum chemistry and does not use extended geometric inputs besides the pairwise atomic distances.


title: Porosity phenomena of non-expansive, Banach space mappings

abstract: For any non-trivial convex and bounded subset $C$ of a Banach space, we show that outside of a $\sigma$-porous subset of the space of non-expansive mappings $C\to C$, all mappings have the maximal Lipschitz constant one witnessed locally at typical points of $C$. This extends a result of Bargetz and the author from separable Banach spaces to all Banach spaces and the proof given is completely independent. We further establish a fine relationship between the classes of exceptional sets involved in this statement, captured by the hierarchy of notions of $\phi$-porosity.


title: Shadows in conformally related gravity theories

abstract: Null geodesics are invariant under a conformal transformation, and thus it might seem natural to assume that the observables corresponding to the shadow of a space-time are also conformally invariant. Here, we argue instead, that since the Arnowitt-Deser-Misner mass and the active gravitational mass of an asymptotically flat space-time are not, in general, invariant under such conformal transformations, the shadow radius for photon motion in a space-time would be quantitatively different, when viewed from two different conformally related frames, although the expression for the shadow radius is similar. We then use this fact to propose a novel method to constrain the relevant parameters in a gravity theory conformally related to general relativity. As examples of our method, we constrain the parameter space in Brans-Dicke theory, and a class of brane-world gravity models, by using the recent observational data of M$87^{*}$ by the Event Horizon Telescope.


title: Quantum state engineering using weak measurement

abstract: State preparation via postselected weak measurement in three wave mixing process is studied. Assuming the signal input mode prepared in a vacuum state, coherent state or squeezed vacuum state, separately, while the idler input prepared in weak coherent state and passing the medium characterized by the second-order nonlinear susceptibility. It is shown that when the single photon is detected at one of the output channels of idler beam's path, the signal output channel is prepared in single-photon Fock state, single-photon-added coherent state or single-photon-added squeezed vacuum state with very high fidelity, depending upon the input signal states and related controllable parameters. The properties including squeezing, signal amplification, second order correlation and Wigner functions of the weak measurement based output states are also investigated. Our scheme promising to provide alternate new effective method for producing useful nonclassical states in quantum information processing.


title: Inference in Regression Discontinuity Designs with High-Dimensional Covariates

abstract: We study regression discontinuity designs in which many predetermined covariates, possibly much more than the number of observations, can be used to increase the precision of treatment effect estimates. We consider a two-step estimator which first selects a small number of "important" covariates through a localized Lasso-type procedure, and then, in a second step, estimates the treatment effect by including the selected covariates linearly into the usual local linear estimator. We provide an in-depth analysis of the algorithm's theoretical properties, showing that, under an approximate sparsity condition, the resulting estimator is asymptotically normal, with asymptotic bias and variance that are conceptually similar to those obtained in low-dimensional settings. Bandwidth selection and inference can be carried out using standard methods. We also provide simulations and an empirical application.


title: Globally balancing spanning trees

abstract: We show that for every graph $G$ that contains two edge-disjoint spanning trees, we can choose two edge-disjoint spanning trees $T_1,T_2$ of $G$ such that $|d_{T_1}(v)-d_{T_2}(v)|\leq 5$ for all $v \in V(G)$. We also prove the more general statement that for every positive integer $k$, there is a constant $c_k \in O(\log k)$ such that for every graph $G$ that contains $k$ edge-disjoint spanning trees, we can choose $k$ edge-disjoint spanning trees $T_1,\ldots,T_k$ of $G$ satisfying $|d_{T_i}(v)-d_{T_j}(v)|\leq c_k$ for all $v \in V(G)$ and $i,j \in \{1,\ldots,k\}$. This resolves a conjecture of Kriesell.


title: Novel Lithium-Sulfur Polymer Battery Operating at Moderate Temperature

abstract: A safe lithium-sulfur (Li-S) battery employs a composite polymer electrolyte based on a poly(ethylene glycol) dimethyl ether (PEGDME) solid at room temperature. The electrolyte membrane enables a stable and reversible Li-S electrochemical process already at 50{\deg}C, with low resistance at the electrode/electrolyte interphase and fast Li+ transport. The relatively low molecular weight of the PEGDME and the optimal membrane composition in terms of salts and ceramic allow a liquid-like Li-S conversion reaction by heating at moderately high temperature, still holding the solid-like polymer state of the cell. Therefore, the electrochemical reaction of the polymer Li-S cell is characterized by the typical dissolution of lithium polysulfides into the electrolyte medium during discharge and the subsequent deposition of sulfur at the electrode/electrolyte interphase during charge. On the other hand, the remarkable thermal stability of the composite polymer electrolyte (up to 300{\deg}C) suggests a lithium-metal battery with safety content significantly higher than that using the common, flammable liquid solutions. Hence, the Li-S polymer battery delivers at 50{\deg}C and 2 V a stable capacity approaching 700 mAhgS-1, with a steady-state coulombic efficiency of 98%. These results suggest a novel, alternative approach to achieve safe, high energy batteries with solid polymer configuration.


title: Linearization and Computation for Large-Strain Viscoelasticity

abstract: Time-discrete numerical minimization schemes for simple viscoelastic materials in the large strain Kelvin-Voigt rheology are not well-posed due to non-quasiconvexity of the dissipation functional. A possible solution is to resort into non-simple material models with higher-order gradients of deformations. This makes, however, numerical computations much more involved. Here we propose another approach relying on local minimizers of the simple-material model. Computational tests are provided showing a very good agreement between our model and the original one.


title: Improving Robustness of Deep Neural Networks for Aerial Navigation by Incorporating Input Uncertainty

abstract: Uncertainty quantification methods are required in autonomous systems that include deep learning (DL) components to assess the confidence of their estimations. However, to successfully deploy DL components in safety-critical autonomous systems, they should also handle uncertainty at the input rather than only at the output of the DL components. Considering a probability distribution in the input enables the propagation of uncertainty through different components to provide a representative measure of the overall system uncertainty. In this position paper, we propose a method to account for uncertainty at the input of Bayesian Deep Learning control policies for Aerial Navigation. Our early experiments show that the proposed method improves the robustness of the navigation policy in Out-of-Distribution (OoD) scenarios.


title: Symmetries in generalized Kaprekar routine

abstract: Algebraic relations are established that determine the invariance of the transformed number after several transformations. The restrictions that determine the group structure of these relationships are analyzed, as is the case of the Klein group. Parametric Kr functions associated with the existence of cycles are presented, as well as the role of the number of their links in the grouping of numbers in higher order equivalence classes. For this we have developed a methodology based on binary equivalence relations and the complete parameterization of the Kaprekar routine using Ki functions of parametric transformation.


title: Kinematic Fitting for ParticleFlow Detectors at Future Higgs Factories

abstract: In many analyses in Higgs, top and electroweak physics, the kinematic reconstruction of the final state is improved by constrained fits. This is a particularly powerful tool at $e^{+}e^{-}$ colliders, where the initial state four-momentum is known and can be employed to constrain the final state. A crucial ingredient to kinematic fitting is an accurate estimate of the measurement uncertainties, in particular for composed objects like jets. This contribution will show how the particle flow concept, which is a design-driver for most detectors proposed for future Higgs factories, can -- in addition to an excellent jet energy measurement -- provide detailed estimates of the covariance matrices for each individual particle-flow object (PFO) and each individual jet. Combined with information about leptons and secondary vertices in the jets, the kinematic fit enables to correct $b$- and $c$-jets for missing momentum from neutrinos from semi-leptonic heavy quark decays. The impact on the reconstruction of invariant di-jet masses and the resulting improvement in $ZH$ vs $ZZ$ separation will be presented, using the full simulation of the ILD detector, as an example of highly-granular ParticleFlow optimized detector concept.


title: Improving the efficacy of Deep Learning models for Heart Beat detection on heterogeneous datasets

abstract: Deep Learning (DL) have greatly contributed to bioelectric signals processing, in particular to extract physiological markers. However, the efficacy and applicability of the results proposed in the literature is often constrained to the population represented by the data used to train the models. In this study, we investigate the issues related to applying a DL model on heterogeneous datasets. In particular, by focusing on heart beat detection from Electrocardiogram signals (ECG), we show that the performance of a model trained on data from healthy subjects decreases when applied to patients with cardiac conditions and to signals collected with different devices. We then evaluate the use of Transfer Learning (TL) to adapt the model to the different datasets. In particular, we show that the classification performance is improved, even with datasets with a small sample size. These results suggest that a greater effort should be made towards generalizability of DL models applied on bioelectric signals, in particular by retrieving more representative datasets.


title: Radio Galaxy Classification: #Tags, not Boxes

abstract: After six decades of studying radio galaxies, we are now being delightfully overwhelmed by their exponentially expanding numbers, and the complexity of their structures. Similarly, the ways we classify radio galaxies have exploded, often leading to conflicting terminology, ambiguous classifications, and historical schemes that may or may not match with our current physical understanding. After discussions with more than 100 radio astronomers over the last several years, listening to their ideas and aspirations, I propose that we reconceptualize the classification of radio galaxies. Instead of trying to put them into "boxes", we should assign them #tags, a system that is easy to understand and apply, flexible and evolving, and can accommodate conflicting ideas about what is relevant and important. Here, I outline the basis of such a #tag system; the rest is up to the community.


title: In situ surface-enhanced Raman spectroscopy to investigate polyyne formation during pulsed laser ablation in liquid

abstract: The synthesis of polyynes during their formation by pulsed laser ablation in liquid (i.e. acetonitrile) has been analyzed by in-situ surface-enhanced Raman spectroscopy (SERS). A polyethylene pellet, functionalized with silver nanoparticles and placed into the ablation medium, served as SERS active surface. This innovative approach granted the possibility to investigate the dynamics of formation and degradation of polyynes with a time-resolution of a few seconds, starting from the early stages of ablation when the concentration is low. The processes occurring during the synthesis have been studied comparing the in-situ SERS signal of polyynes and byproducts in the solution. The different kinetics of short and long polyynes have been investigated by their in-situ SERS signal, exploring the final distribution of chain lengths. Ex situ UV-Vis and high-performance liquid chromatography confirmed the observations gained from in-situ SERS data and validated this innovative in-situ and in-operando analysis.


title: On Deterministic Numerical Methods for the Quantum Boltzmann-Nordheim Equation. I. Spectrally Accurate Approximations, Bose-Einstein Condensation, Fermi-Dirac Saturation

abstract: Spectral methods, thanks to their high accuracy and the possibility to use fast algorithms, represent an effective way to approximate the collisional kinetic equations of Boltzmann type, such as the Boltzmann-Nordheim equation. This equation, modeled on the seminal Boltzmann equation, describes using a statistical physics formalism the time evolution of a gas composed of bosons or fermions. Using the spectral-Galerkin algorithm introduced in [F. Filbet, J. Hu, and S. Jin, ESAIM: Math. Model. Numer. Anal., 2011], together with some novel parallelization techniques, we investigate some of the conjectured properties of the large time behavior of the solutions to this equation. In particular, we are able to observe numerically both Bose-Einstein condensation and Fermi-Dirac relaxation.


title: The space density of ultra-luminous QSOs at the end of reionization epoch by the QUBRICS Survey and the AGN contribution to the hydrogen ionizing background

abstract: Motivated by evidences favoring a rapid and late hydrogen reionization process completing at z~5.2-5.5 and mainly driven by rare and luminous sources, we have reassessed the estimate of the space density of ultra-luminous QSOs at z~5 in the framework of the QUBRICS survey. A ~90% complete sample of 14 spectroscopically confirmed QSOs at M1450<-28.3 and 4.5<z<5.0 has been derived in an area of 12,400 sq. deg., thanks to multi-wavelength selection and GAIA astrometry. The space density of z~5 QSOs within -29.3<M1450<-28.3 is three times higher than previous determinations. Our results suggest a steep bright-end slope for the QSO luminosity function at z~5 and a mild redshift evolution of the space density of ultra-bright QSOs (M1450~-28.5) at 3<z<5.5, in agreement with the redshift evolution of the much fainter AGN population at M1450~-23. These findings are consistent with a pure density evolution for the AGN population at z>3. Adopting our z~4 QSO luminosity function and applying a mild density evolution in redshift, a photo-ionization rate of GammaHI=0.46+0.17-0.09x10^-12 s^-1 has been obtained at z=4.75, assuming an escape fraction of ~70% and a steep faint-end slope of the AGN luminosity function. The derived photo-ionization rate is ~50-100% of the ionizing background measured at the end of the reionization epoch, suggesting that AGNs could play an important role in the cosmological reionization process.


title: Spin-phonon coupling in Sr and Ti incorporated 9R-BaMnO3

abstract: Materials having strong coupling between different degrees of freedom such as spin, lattice, orbital, and charge are of immense interest due to their potential device applications. Here, we have stabilized the 9R phase of BaMnO3, by Sr (Ti) doping in the Ba (Mn) site using solid-state route at ambient pressure, which otherwise requires high-pressure conditions to syntheize. Crsyatl structure, phonon spectra, and their evolution with temperature are investigated using x-ray diffraction and Raman spectroscopic techniques. Temperature-dependent magnetization data reveal an antiferromagnetic transition at around (TN =) 262 K and 200 K for Ba0.9Sr0.1MnO3 and BaMn0.9Ti0.1O3, respectively. No structural phase transition or lattice instabilities are observed in the measured temperature range (80 - 400 K) for both the compounds. We have observed anomalous behaviour of four different phonon modes involving Mn or O-vibrations at low temperatures which have been attributed to spin-phonon coupling.


title: Note on the approximation of the conditional intensity of non-stationary cluster point processes

abstract: In this note we consider non-stationary cluster point processes and we derive their conditional intensity, i.e. the intensity of the process given the locations of one or more events of the process. We then provide some approximations of the conditional intensity.


title: Arnold's variational principle and its application to the stability of planar vortices

abstract: We consider variational principles related to V. I. Arnold's stability criteria for steady-state solutions of the two-dimensional incompressible Euler equation. Our goal is to investigate under which conditions the quadratic forms defined by the second variation of the associated functionals can be used in the stability analysis, both for the Euler evolution and for the the Navier-Stokes equation at low viscosity. In particular, we revisit the classical example of Oseen's vortex, providing a new stability proof with stronger geometric flavor. Our analysis involves a fairly detailed functional-analytic study of the inviscid case, which may be of independent interest, and a careful investigation of the influence of the viscous term in the particular example of the Gaussian vortex.


title: DP-SSL: Towards Robust Semi-supervised Learning with A Few Labeled Samples

abstract: The scarcity of labeled data is a critical obstacle to deep learning. Semi-supervised learning (SSL) provides a promising way to leverage unlabeled data by pseudo labels. However, when the size of labeled data is very small (say a few labeled samples per class), SSL performs poorly and unstably, possibly due to the low quality of learned pseudo labels. In this paper, we propose a new SSL method called DP-SSL that adopts an innovative data programming (DP) scheme to generate probabilistic labels for unlabeled data. Different from existing DP methods that rely on human experts to provide initial labeling functions (LFs), we develop a multiple-choice learning~(MCL) based approach to automatically generate LFs from scratch in SSL style. With the noisy labels produced by the LFs, we design a label model to resolve the conflict and overlap among the noisy labels, and finally infer probabilistic labels for unlabeled samples. Extensive experiments on four standard SSL benchmarks show that DP-SSL can provide reliable labels for unlabeled data and achieve better classification performance on test sets than existing SSL methods, especially when only a small number of labeled samples are available. Concretely, for CIFAR-10 with only 40 labeled samples, DP-SSL achieves 93.82% annotation accuracy on unlabeled data and 93.46% classification accuracy on test data, which are higher than the SOTA results.


title: Disrupting Deep Uncertainty Estimation Without Harming Accuracy

abstract: Deep neural networks (DNNs) have proven to be powerful predictors and are widely used for various tasks. Credible uncertainty estimation of their predictions, however, is crucial for their deployment in many risk-sensitive applications. In this paper we present a novel and simple attack, which unlike adversarial attacks, does not cause incorrect predictions but instead cripples the network's capacity for uncertainty estimation. The result is that after the attack, the DNN is more confident of its incorrect predictions than about its correct ones without having its accuracy reduced. We present two versions of the attack. The first scenario focuses on a black-box regime (where the attacker has no knowledge of the target network) and the second scenario attacks a white-box setting. The proposed attack is only required to be of minuscule magnitude for its perturbations to cause severe uncertainty estimation damage, with larger magnitudes resulting in completely unusable uncertainty estimations. We demonstrate successful attacks on three of the most popular uncertainty estimation methods: the vanilla softmax score, Deep Ensembles and MC-Dropout. Additionally, we show an attack on SelectiveNet, the selective classification architecture. We test the proposed attack on several contemporary architectures such as MobileNetV2 and EfficientNetB0, all trained to classify ImageNet.


title: Deep Learning Exotic Hadrons

abstract: We perform the first model independent analysis of experimental data using Deep Neural Networks to determine the nature of an exotic hadron. Specifically, we study the line shape of the $P_c(4312)$ signal reported by the LHCb collaboration and we find that its most likely interpretation is that of a virtual state. This method can be applied to other near-threshold resonance candidates.