title: Beyond Transfer Learning: Co-finetuning for Action Localisation

abstract: Transfer learning is the predominant paradigm for training deep networks on small target datasets. Models are typically pretrained on large ``upstream'' datasets for classification, as such labels are easy to collect, and then finetuned on ``downstream'' tasks such as action localisation, which are smaller due to their finer-grained annotations. In this paper, we question this approach, and propose co-finetuning -- simultaneously training a single model on multiple ``upstream'' and ``downstream'' tasks. We demonstrate that co-finetuning outperforms traditional transfer learning when using the same total amount of data, and also show how we can easily extend our approach to multiple ``upstream'' datasets to further improve performance. In particular, co-finetuning significantly improves the performance on rare classes in our downstream task, as it has a regularising effect, and enables the network to learn feature representations that transfer between different datasets. Finally, we observe how co-finetuning with public, video classification datasets, we are able to achieve state-of-the-art results for spatio-temporal action localisation on the challenging AVA and AVA-Kinetics datasets, outperforming recent works which develop intricate models.


title: Approaching Heisenberg-scalable thermometry with built-in robustness against noise

abstract: It is a major goal in quantum thermometry to reach a $1/N$ scaling of thermometric precision known as Heisenberg scaling but is still in its infancy to date. The main obstacle is that the resources typically required are highly entangled states, which are very difficult to produce and extremely vulnerable to noises. Here, we propose an entanglement-free scheme of thermometry to approach Heisenberg scaling for a wide range of $N$, which has built-in robustness irrespective of the type of noise in question. Our scheme is amenable to a variety of experimental setups. Moreover, it can be used as a basic building block for promoting previous proposals of thermometry to reach Heisenberg scaling, and its applications are not limited to thermometry but can be straightforwardly extended to other metrological tasks.


title: UDRN: Unified Dimensional Reduction Neural Network for Feature Selection and Feature Projection

abstract: Dimensional reduction~(DR) maps high-dimensional data into a lower dimensions latent space with minimized defined optimization objectives. The DR method usually falls into feature selection~(FS) and feature projection~(FP). FS focuses on selecting a critical subset of dimensions but risks destroying the data distribution (structure). On the other hand, FP combines all the input features into lower dimensions space, aiming to maintain the data structure; but lacks interpretability and sparsity. FS and FP are traditionally incompatible categories; thus, they have not been unified into an amicable framework. We propose that the ideal DR approach combines both FS and FP into a unified end-to-end manifold learning framework, simultaneously performing fundamental feature discovery while maintaining the intrinsic relationships between data samples in the latent space. In this work, we develop a unified framework, Unified Dimensional Reduction Neural-network~(UDRN), that integrates FS and FP in a compatible, end-to-end way. We improve the neural network structure by implementing FS and FP tasks separately using two stacked sub-networks. In addition, we designed data augmentation of the DR process to improve the generalization ability of the method when dealing with extensive feature datasets and designed loss functions that can cooperate with the data augmentation. Extensive experimental results on four image and four biological datasets, including very high-dimensional data, demonstrate the advantages of DRN over existing methods~(FS, FP, and FS\&FP pipeline), especially in downstream tasks such as classification and visualization.


title: Probing the response of metals to low-frequency s-polarized evanescent fields

abstract: Experimental test for the response function of metals to the low-frequency s-polarized evanescent waves is proposed by measuring the lateral component of magnetic field of an oscillating magnetic dipole spaced above a thick metallic plate. This suggestion is motivated by the fact that the Lifshitz theory using the Drude response function is in contradiction with high-precision measurements of the Casimir force performed at separations exceeding 150~nm. Analytic expressions for the lateral components of the magnetic field, which are fully determined by the s-polarized evanescent waves, are reported in terms of the reflection coefficients of the plate metal. Numerical computations are performed for the reasonable values of the experimental parameters for different models of the dielectric response. The resulting fields differ by the orders of magnitude depending on whether the Drude or plasma response function is used in computations. Thus, the measurement of the magnetic field will allow to discriminate between these two options. Possible applications of the obtained results are discussed.


title: Multi-frequency optical lattice for dynamic lattice-geometry control

abstract: Ultracold atoms in optical lattices are pristine model systems with a tunability and flexibility that goes beyond solid-state analogies, e.g., dynamical lattice-geometry changes allow tuning a graphene lattice into a boron-nitride lattice. However, a fast modulation of the lattice geometry remains intrinsically difficult. Here we introduce a multi-frequency lattice for fast and flexible lattice-geometry control and demonstrate it for a three-beam lattice, realizing the full dynamical tunability between honeycomb lattice, boron-nitride lattice and triangular lattice. At the same time, the scheme ensures intrinsically high stability of the lattice geometry. We introduce the concept of a geometry phase as the parameter that fully controls the geometry and observe its signature as a staggered flux in a momentum space lattice. Tuning the geometry phase allows to dynamically control the sublattice offset in the boron-nitride lattice. We use a fast sweep of the offset to transfer atoms into higher Bloch bands, and perform a new type of Bloch band spectroscopy by modulating the sublattice offset. Finally, we generalize the geometry phase concept and the multi-frequency lattice to three-dimensional optical lattices and quasi-periodic potentials. This scheme will allow further applications such as novel Floquet and quench protocols to create and probe, e.g., topological properties.


title: Sharp zero-phonon lines of single organic molecules on a hexagonal boron-nitride surface

abstract: Single fluorescent molecules embedded in the bulk of host crystals have proven to be excellent probes of the dynamics in their nano environment, thanks to their narrow (about 0.1 {\mu}eV) optical linewidth of the 0-0 zero-phonon line (0-0 ZPL) at cryogenic temperatures. However, the optical linewidths of the 0-0 ZPL have been found to increase dramatically as the single molecules are located closer to a surface or interface, while no 0-0 ZPL has been detected for organic molecules on any surface. Here, we study single fluorescent terrylene molecules adsorbed on the surface of hexagonal boron-nitride (hBN) substrates. Our low-temperature results show for the first time the observation of the 0-0 ZPL of fluorescent molecules on a surface. With resonant excitation, we find 0-0 ZPL linewidths down to values that are about 10 times larger than the Fourier limit of 45 +/- 3 MHz, dictated by the fluorescence lifetime. We compare our results for molecules deposited on the surfaces of annealed and non-annealed hBN flakes and we see a marked improvement in the spectral stability of the emitters after annealing. Our high-resolution spectra obtained on terrylene suggest the possibility of employing hBN in combination with a wide variety of single molecule emitters for investigation of physical phenomena at surfaces or for use in nanophotonic devices.


title: BlaST -- A Machine-Learning Estimator for the Synchrotron Peak of Blazars

abstract: Active Galaxies with a jet pointing towards us, so-called blazars, play an important role in the field of high-energy astrophysics. One of the most important features in the classification scheme of blazars is the peak frequency of the synchrotron emission ($\nu_{\rm peak}^S$) in the spectral energy distribution (SED). In contrast to standard blazar catalogs that usually calculate the $\nu_{\rm peak}^S$ manually, we have developed a machine-learning algorithm - BlaST - that not only simplifies the estimation, but also provides a reliable uncertainty evaluation. Furthermore, it naturally accounts for additional SED components from the host galaxy and the disk emission, which may be a major source of confusion. Using our tool, we re-estimate the synchrotron peaks in the Fermi 4LAC-DR2 catalog. We find that BlaST, improves the $\nu_{\rm peak}^S$ estimation especially in those cases where the contribution of components not related to the jet is important.

categories: astro-ph.HE astro-ph.GA astro-ph.IM hep-ex


title: X-shaped radio galaxy 3C 223.1: A 'double boomerang' with an anomalous spectral gradient

abstract: A comparison of the recent LOFAR 144 MHz map of the radio source 3C 223.1 (J094124.028+394441.95) with the VLA maps at 4.9 GHz and 8.3 GHz that we built based on archival data, establishes this X-shaped radio galaxy (XRG) as a singularly robust case where the 'wings' exhibit a distinctly flatter radio spectrum than the primary lobes. The details of its anomalous spectral gradient are unravelled here with unprecedented precision. We also highlight the 'double boomerang' type radio morphology of this XRG. It appears plausible that the peculiar spectral gradient in this XRG is owed to particle acceleration associated with the rebounding of the collimated backflows of synchrotron plasma streaming through its two primary lobes, as they impinge upon and encounter the magnetic tension in the prominent dusty disk of the elliptical galaxy hosting this XRG. We also draw attention to an intriguing new morphological peculiarity among XRGs, namely, a lateral offset observed between the (parallel) axes of the two primary radio lobes.


title: ErgoTac-Belt: Anticipatory Vibrotactile Feedback to Lead Centre of Pressure during Walking

abstract: Balance and gait disorders are the second leading cause of falls, which, along with consequent injuries, are reported as major public health problems all over the world. For patients who do not require mechanical support, vibrotactile feedback interfaces have proven to be a successful approach in restoring balance. Most of the existing strategies assess trunk or head tilt and velocity or plantar forces, and are limited to the analysis of stance. On the other hand, central to balance control is the need to maintain the body's centre of pressure (CoP) within feasible limits of the support polygon (SP), as in standing, or on track to a new SP, as in walking. Hence, this paper proposes an exploratory study to investigate whether vibrotactile feedback can be employed to lead human CoP during walking. The ErgoTac-Belt vibrotactile device is introduced to instruct the users about the direction to take, both in the antero-posterior and medio-lateral axes. An anticipatory strategy is adopted here, to give the users enough time to react to the stimuli. Experiments on ten healthy subjects demonstrated the promising capability of the proposed device to guide the users' CoP along a predefined reference path, with similar performance as the one achieved with visual feedback. Future developments will investigate our strategy and device in guiding the CoP of elderly or individuals with vestibular impairments, who may not be aware of or, able to figure out, a safe and ergonomic CoP path.


title: The welfare effects of nonlinear health dynamics

abstract: We generate a continuous measure of health to estimate a non-parametric model of health dynamics, showing that adverse health shocks are highly persistent when suffered by people in poor health. Canonical models cannot account for this pattern. We incorporate this health dynamic into a life-cycle model of consumption, savings, and labor force participation. After estimating the model parameters, we simulate the effects of health shocks on economic outcomes. We find that bad health shocks have long-term adverse economic effects that are more extreme for those in poor health. Furthermore, bad health shocks also increase the disparity of asset accumulation among this group of people. A canonical model of health dynamics would not reveal these effects.


title: Ultrawide dark solitons and droplet-soliton coexistence in a dipolar Bose gas with strong contact interactions

abstract: We look into dark solitons in a quasi-1D dipolar Bose gas and in a quantum droplet. We derive the analytical solitonic solution of a Gross-Pitaevskii-like equation accounting for beyond mean-field effects. The results show there is a certain critical value of the dipolar interactions, for which the width of a motionless soliton diverges. Moreover, there is a peculiar solution of the motionless soliton with a non-zero density minimum. We also present the energy spectrum of these solitons with an additional excitation subbranch appearing. Finally, we perform a series of numerical experiments revealing the coexistence of a dark soliton inside a quantum droplet.


title: Small-time bilinear control of Schr\"odinger equations with application to rotating linear molecules

abstract: In [14] Duca and Nersesyan proved a small-time controllability property of nonlinear Schr\"odinger equations on a d-dimensional torus $\mathbb{T}^d$. In this paper we study a similar property, in the linear setting, starting from a closed Riemannian manifold. We then focus on the 2-dimensional sphere $S^2$, which models the bilinear control of a rotating linear top: as a corollary, we obtain the approximate controllability in arbitrarily small times among particular eigenfunctions of the Laplacian of $S^2$.

categories: math.OC math-ph math.AP math.MP quant-ph


title: Moderate-Resolution $K$-Band Spectroscopy of the Substellar Companion VHS 1256 b

abstract: We present moderate-resolution ($R\sim4000$) $K$ band spectra of the planetary-mass companion VHS 1256 b. The data were taken with the OSIRIS integral field spectrograph at the W.M. Keck Observatory. The spectra reveal resolved molecular lines from H$_{2}$O and CO. The spectra are compared to custom $PHOENIX$ atmosphere model grids appropriate for young, substellar objects. We fit the data using a Markov Chain Monte Carlo forward modeling method. Using a combination of our moderate-resolution spectrum and low-resolution, broadband data from the literature, we derive an effective temperature of 1240 K, with a range of 1200--1300 K, a surface gravity of $\log{g}=$ 3.25, with a range of 3.25--3.75 and a cloud parameter of $\log P_{cloud}=$ 6, with a range of 6.0--6.6. These values are consistent with previous studies, regardless of the new, larger system distance from GAIA EDR3 (22.2$^{+1.1}_{-1.2}$ pc). We derive a C/O ratio of 0.590$_{-0.354}^{+0.280}$ for VHS 1256b. Both our OSIRIS data and spectra from the literature are best modeled when using a larger 3 $\mu$m grain size for the clouds than used for hotter objects, consistent with other sources in the L/T transition region. VHS 1256 b offers an opportunity to look for systematics in the modeling process that may lead to the incorrect derivation of properties like C/O ratio in the high contrast regime.


title: Deep Learning for Anomaly Detection in Log Data: A Survey

abstract: Automatic log file analysis enables early detection of relevant incidents such as system failures. In particular, self-learning anomaly detection techniques capture patterns in log data and subsequently report unexpected log event occurrences to system operators without the need to provide or manually model anomalous scenarios in advance. Recently, an increasing number of approaches leveraging deep learning neural networks for this purpose have been presented. These approaches have demonstrated superior detection performance in comparison to conventional machine learning techniques and simultaneously resolve issues with unstable data formats. However, there exist many different architectures for deep learning and it is non-trivial to encode raw and unstructured log data to be analyzed by neural networks. We therefore carry out a systematic literature review that provides an overview of deployed models, data pre-processing mechanisms, anomaly detection techniques, and evaluations. The survey does not quantitatively compare existing approaches but instead aims to help readers understand relevant aspects of different model architectures and emphasizes open issues for future work.


title: A class of optimal positive maps in $M_n$

abstract: It is proven that a certain class of positive maps in the matrix algebra $M_n$ consists of optimal maps, i.e. maps from which one cannot subtract any completely positive map without loosing positivity. This class provides a generalization of a seminal Choi positive map in $M_3$.


title: A Conjecture of Coleman on the Eisenstein Family

abstract: We prove for primes $p\ge 5$ a conjecture of Coleman on the analytic continuation of the family of modular functions $\frac{E^\ast_\kappa}{V(E^\ast_\kappa)}$ derived from the family of Eisenstein series $E^\ast_\kappa$. The precise, quantitative formulation of the conjecture involved a certain on $p$ depending constant. We show by an example that the conjecture with the constant that Coleman conjectured cannot hold in general for all primes. On the other hand, the constant that we give is also shown not to be optimal in all cases. The conjecture is motivated by its connection to certain central statements in works by Buzzard and Kilford, and by Roe, concerning the "halo" conjecture for the primes $2$ and $3$, respectively. We show how our results generalize those statements and comment on possible future developments.


title: Zero-Shot Cost Models for Distributed Stream Processing

abstract: This paper proposes a learned cost estimation model for Distributed Stream Processing Systems (DSPS) with an aim to provide accurate cost predictions of executing queries. A major premise of this work is that the proposed learned model can generalize to the dynamics of streaming workloads out-of-the-box. This means a model once trained can accurately predict performance metrics such as latency and throughput even if the characteristics of the data and workload or the deployment of operators to hardware changes at runtime. That way, the model can be used to solve tasks such as optimizing the placement of operators to minimize the end-to-end latency of a streaming query or maximize its throughput even under varying conditions. Our evaluation on a well-known DSPS, Apache Storm, shows that the model can predict accurately for unseen workloads and queries while generalizing across real-world benchmarks.


title: Boosting Zero-shot Learning via Contrastive Optimization of Attribute Representations

abstract: Zero-shot learning (ZSL) aims to recognize classes that do not have samples in the training set. One representative solution is to directly learn an embedding function associating visual features with corresponding class semantics for recognizing new classes. Many methods extend upon this solution, and recent ones are especially keen on extracting rich features from images, e.g. attribute features. These attribute features are normally extracted within each individual image; however, the common traits for features across images yet belonging to the same attribute are not emphasized. In this paper, we propose a new framework to boost ZSL by explicitly learning attribute prototypes beyond images and contrastively optimizing them with attribute-level features within images. Besides the novel architecture, two elements are highlighted for attribute representations: a new prototype generation module is designed to generate attribute prototypes from attribute semantics; a hard example-based contrastive optimization scheme is introduced to reinforce attribute-level features in the embedding space. We explore two alternative backbones, CNN-based and transformer-based, to build our framework and conduct experiments on three standard benchmarks, CUB, SUN, AwA2. Results on these benchmarks demonstrate that our method improves the state of the art by a considerable margin. Our codes will be available at https://github.com/dyabel/CoAR-ZSL.git


title: Quantum chaos and thermalization in the two-mode Dicke model

abstract: We discuss the onset of quantum chaos and thermalization in the two-mode Dicke model, which describes the dipolar interaction between an ensemble of spins and two bosonic modes. The two-mode Dicke model exhibits normal to superradiant quantum phase transition with spontaneous breaking either of a discrete or continuous symmetry. We study the behaviour of the fidelity out-of-time-order correlator derived from the Loschmidt echo signal in the quantum phases of the model and show that its exponential growth cannot be related to a classical unstable point in the general case. Moreover, we find that the collective spin observable in the two-mode Dicke model quickly saturates to its long-time average value, and shows very good agreement between its diagonal ensemble average and microcanonical average even for a small number of spins. We show that the temporal fluctuations of the expectation value of the collective spin observable around its average are small and decrease with the effective system size, which leads to thermalization of the spin system.


title: Habitat connectivity in agricultural landscapes improving multi-functionality of constructed wetlands as nature-based solutions

abstract: The prevention of biodiversity loss in agricultural landscapes to protect ecosystem stability and functions is of major importance in itself and for the maintenance of associated ecosystem services. Intense agriculture leads to a loss in species richness and homogenization of species pools as well as the fragmentation of natural habitats and groundwater pollution. Constructed wetlands stand as nature-based solutions (NBS) to buffer the degradation of water quality by intercepting the transfer of particles, nutrients and pesticides between crops and surface waters. In karstic watersheds where sinkholes short-cut surface water directly to groundwater increasing water resource vulnerability, constructed wetlands are recommended to mitigate agricultural pollutants. Constructed wetlands also have the potential to improve landscape connectivity by providing refuge and breeding sites for wildlife, especially for amphibians. We propose here a methodology to identify optimal locations for water pollution mitigation using constructed wetlands from the perspective of habitat connectivity. We use ecological niche modelling at the regional scale to model the potential of habitat suitability for nine amphibian species, and to infer how the landscape impedes species movements. We combine those results to graph theory to identify connectivity priorities at the operational scale of an agricultural catchment area. Our framework allowed us to identify optimal areas from the point of view of the species, to analyze the effect of multifunctional constructed wetlands aiming to both reduce water pollution and to improve amphibian species habitat overall connectivity. More generally, we show the potential of habitat connectivity assessment to improve multifunctionality of NBS for pollution mitigation.


title: One Pixel, One Interaction, One Game: An Experiment in Minimalist Game Design

abstract: Minimalist game design was introduced a decade ago as a general design principle with a list of key properties for minimalist games: basic controls, simple but aesthetically pleasing visuals, interesting player choices with vast possibility spaces, and sounds that resonate with the design. In this paper, we present an experiment we did to explore minimalism in games using a bottom-up approach. We invited a small group of professional game designers and a larger group of game design students to participate in a seminal experiment on minimalism in game design. We started from the most basic game elements: one pixel and one key which provide the least amount of information we can display and reasonably the most elementary action players can perform. We designed a game that starts with a black pixel and asks players to press a key when the pixel turns white. This minimal game, almost a Skinner box, captures the essential elements of the mechanics of games like "The Impossible Game," which asks players to do nothing more than press a key at the right moment. We presented this game concept to the professional game designers and challenged them to create other games with the least amount of player interaction and displayed information. We did not specify any constraints (as usually done in other contexts) and left them free to express their view of minimalistic game design. We repeated the experiment with 100+ students attending a master-level course on video game design and development at our institution. We then analyzed the creations of the two groups, discussing the idea of minimalistic design that emerges from the submitted game concepts.


title: Machine Learning for the Prediction of Converged Energies from Ab Initio Nuclear Structure Calculations

abstract: The prediction of nuclear observables beyond the finite model spaces that are accessible through modern ab initio methods, such as the no-core shell model, pose a challenging task in nuclear structure theory. It requires reliable tools for the extrapolation of observables to infinite many-body Hilbert spaces along with reliable uncertainty estimates. In this work we present a universal machine learning tool capable of capturing observable-specific convergence patterns independent of nucleus and interaction. We show that, once trained on few-body systems, artificial neural networks can produce accurate predictions for a broad range of light nuclei. In particular, we discuss neural-network predictions of ground-state energies from no-core shell model calculations for 6Li, 12C and 16O based on training data for 2H, 3H and 4He and compare them to classical extrapolations.


title: Measuring the magnon-photon coupling in shaped ferromagnets: tuning of the resonance frequency

abstract: Cavity photons and ferromagnetic spins excitations can exchange information coherently in hybrid architectures, at speeds set by their mutual coupling strength. Speed enhancement is usually achieved by optimizing the geometry of the electromagnetic cavity. Here we show that the geometry of the ferromagnet plays also an important role, by setting the fundamental frequency of the magnonic resonator. Using focused ion beam patterning, we vary the aspect ratio of different Permalloy samples reaching operation frequencies above 10 GHz while working at low external magnetic fields. Additionally, we perform broad band ferromagnetic resonance measurements and cavity experiments that demonstrate that the magnon-photon coupling strength can be estimated using either open transmission lines or resonant cavities, yielding very good agreement. Finally, we describe a simple theoretical framework based on electromagnetic and micromagnetic simulations that successfully accounts for the experimental results. This approach can be used to design hybrid quantum systems exploiting whatsoever magnetostatic mode excited in ferromagnets of arbitrary size and shape and to tune their operation conditions.


title: Safe reinforcement learning for multi-energy management systems with known constraint functions

abstract: Reinforcement learning (RL) is a promising optimal control technique for multi-energy management systems. It does not require a model a priori - reducing the upfront and ongoing project-specific engineering effort and is capable of learning better representations of the underlying system dynamics. However, vanilla RL does not provide constraint satisfaction guarantees - resulting in various potentially unsafe interactions within its safety-critical environment. In this paper, we present two novel safe RL methods, namely SafeFallback and GiveSafe, where the safety constraint formulation is decoupled from the RL formulation. These provide hard-constraint, rather than soft- and chance-constraint, satisfaction guarantees both during training a (near) optimal policy (which involves exploratory and exploitative, i.e. greedy, steps) as well as during deployment of any policy (e.g. random agents or offline trained RL agents). This without the need of solving a mathematical program, resulting in less computational power requirements and a more flexible constraint function formulation (no derivative information is required). In a simulated multi-energy systems case study we have shown that both methods start with a significantly higher utility (i.e. useful policy) compared to a vanilla RL benchmark and Optlayer benchmark (94,6% and 82,8% compared to 35,5% and 77,8%) and that the proposed SafeFallback method even can outperform the vanilla RL benchmark (102,9% to 100%). We conclude that both methods are viably safety constraint handling techniques applicable beyond RL, as demonstrated with random policies while still providing hard-constraint guarantees.


title: QFT approach to dressed particle processes in preheating and non-perturbative mechanism in kinematically-forbidden regime

abstract: We provide a quantum-field theoretic formulation of dressed particle dynamics that systematically include particle production and scattering/decay processes in the preheating era. Our approach is based on the so-called perturbation theory in the Furry picture, in which coherent background fields (i.e., inflaton and the expanding Universe) are treated non-perturbatively whereas interactions between dressed particles are taken into account perturbatively. As application, we consider the instant preheating mechanism and compute the number of produced particles explicitly, assuming that the coherent fields are adiabatic. We find a novel non-perturbative particle-production mechanism, which is kinematically forbidden within the conventional perturbative calculation and produces particles exponentially efficiently than the perturbative one does.


title: Characterizing terminal Fano threefolds with the smallest anti-canonical volume, II

abstract: It was proved by J.~A.~Chen and M.~Chen that a terminal Fano $3$-fold $X$ satisfies $(-K_X)^3\geq \frac{1}{330}$. We show that a $\mathbb{Q}$-factorial terminal Fano $3$-fold $X$ with $\rho(X)=1$ and $(-K_X)^3=\frac{1}{330}$ is a weighted hypersurface of degree $66$ in $\mathbb{P}(1,5,6,22,33)$. By the same method, we also give characterizations for other $11$ examples of weighted hypersurfaces of the form $X_{6d}\subset \mathbb{P}(1,a,b,2d,3d)$ in Iano-Fletcher's list. Namely, we show that if a $\mathbb{Q}$-factorial terminal Fano $3$-fold $X$ with $\rho(X)=1$ has the same numerical data as $X_{6d}$, then $X$ itself is a weighted hypersurface of the same type.


title: XR Hackathon Going Online: Lessons Learned from a Case Study with Goethe-Institut

abstract: In this article we report a case study of a Language and Culture-oriented transdisciplinary XR hackathon organized with Goethe-Institut. The hackathon was hosted as an online event in November 2020 by our University Lab in collaboration with Goethe-Institut as a follow-up to our previous co-organized event within our research group Living Lab. We have improved the formula of the event based on lessons learned from its previous edition. First, in one of the two hackathon tracks we provided the participants with a custom VR framework, to serve as a starting point for their designs to skip the repetitive early development stage. In cooperation with our partner, Goethe-Institut, we have also outlined best modern research-backed language-learning practices and methods and gathered them into actionable evaluation criteria.


title: An Efficiency Study for SPLADE Models

abstract: Latency and efficiency issues are often overlooked when evaluating IR models based on Pretrained Language Models (PLMs) in reason of multiple hardware and software testing scenarios. Nevertheless, efficiency is an important part of such systems and should not be overlooked. In this paper, we focus on improving the efficiency of the SPLADE model since it has achieved state-of-the-art zero-shot performance and competitive results on TREC collections. SPLADE efficiency can be controlled via a regularization factor, but solely controlling this regularization has been shown to not be efficient enough. In order to reduce the latency gap between SPLADE and traditional retrieval systems, we propose several techniques including L1 regularization for queries, a separation of document/query encoders, a FLOPS-regularized middle-training, and the use of faster query encoders. Our benchmark demonstrates that we can drastically improve the efficiency of these models while increasing the performance metrics on in-domain data. To our knowledge, {we propose the first neural models that, under the same computing constraints, \textit{achieve similar latency (less than 4ms difference) as traditional BM25}, while having \textit{similar performance (less than 10\% MRR@10 reduction)} as the state-of-the-art single-stage neural rankers on in-domain data}.


title: Weather Forecast of the Milky Way: Shear and Stellar feedback determine the lives of Galactic-scale filaments

abstract: The interstellar medium (ISM) is an inseparable part of the Milky Way ecosystem whose evolutionary history remains a challenging question. We trace the evolution of the molecular ISM using a sample of Young Stellar Objects (YSO) association --molecular cloud complex (YSO-MC complex). We derive their three-dimensional (3D) velocities by combining the Gaia astrometric measurements of the YSO associations and the CO observations of the associated molecular clouds. Based on the 3D velocities, we simulate the motions of the YSO-MC complexes in the Galactic potential and forecast the ISM evolution by tracing the motions of the individual complexes, and reveal the roles of shear and stellar feedback in determining ISM evolution: Galactic shear stretches Galactic-scale molecular cloud complexes, such as the G120 Complex, into Galactic-scale filaments, and it also contributes to the destruction of the filaments; while stellar feedback creates interconnected superbubbles whose expansion injects peculiar velocities into the ISM. The Galactic-scale molecular gas clumps are often precursors of the filaments and the Galactic-scale filaments are transient structures under a constant stretch by shear. This evolutionary sequence sets a foundation to interpret other gas structures. Animations are available at https://gxli.github.io/ISM-6D/movie.html.


title: Shrinking rates of horizontal gaps for generic translation surfaces

abstract: A translation surface is given by polygons in the plane, with sides identified by translations to create a closed Riemann surface with a flat structure away from finitely many singular points. Understanding geodesic flow on a surface involves understanding saddle connections. Saddle connections are the geodesics starting and ending at these singular points and are associated to a discrete subset of the plane. To measure the behavior of saddle connections of length at most $R$, we obtain precise decay rates as $R\to \infty$ for the difference in angle between two almost horizontal saddle connections.


title: The Positive Effects of Stochastic Rounding in Numerical Algorithms

abstract: Recently, stochastic rounding (SR) has been implemented in specialized hardware but most current computing nodes do not yet support this rounding mode. Several works empirically illustrate the benefit of stochastic rounding in various fields such as neural networks and ordinary differential equations. For some algorithms, such as summation, inner product or matrixvector multiplication, it has been proved that SR provides probabilistic error bounds better than the traditional deterministic bounds. In this paper, we extend this theoretical ground for a wider adoption of SR in computer architecture. First, we analyze the biases of the two SR modes: SR-nearness and SR-up-or-down. We demonstrate on a case-study of Euler's forward method that IEEE-754 default rounding modes and SR-up-or-down accumulate rounding errors across iterations and that SR-nearness, being unbiased, does not. Second, we prove a O($\sqrt$ n) probabilistic bound on the forward error of Horner's polynomial evaluation method with SR, improving on the known deterministic O(n) bound.


title: A $C^0$ finite element method for the biharmonic problem with Dirichlet boundary conditions in a polygonal domain

abstract: In this paper, we study the biharmonic equation with Dirichlet boundary conditions in a polygonal domain. In particular, we propose a method that effectively decouples the fourth-order problem into a system of two Poison equations and one Stokes equation, or a system of one Stokes equation and one Poisson equation. It is shown that the solution of each system is equivalent to that of the original fourth-order problem on both convex and non-convex polygonal domains. Two finite element algorithms are in turn proposed to solve the decoupled systems. In addition, we show the regularity of the solutions in each decoupled system in both the Sobolev space and the weighted Sobolev space, and we derive the optimal error estimates for the numerical solutions on both quasi-uniform meshes and graded meshes. Numerical test results are presented to justify the theoretical findings.


title: Tridendriform structures

abstract: We first study tensor products of tridendriform algebras in order to introduce the notion of tridendriform bialgebra. We shall need for this a notion of augmented tridendriform algebras. Inspired by the work of J-L. Loday and M. Ronco, we build free tridendriform algebras over reduced trees and show that they have a coproduct satisfying some compatibilities with the tridendriform products. Such an object will be called a (3, 1)--dendriform algebra. Studying the free (3, 1)--dendriform bialgebra over one generator, we describe its products and coproduct in a combinatorial way. The products are described by branches shuffle and the coproduct by admissible cuts. We compare it with quasi-shuffle algebras over words. Its graded dual is the bialgebra TSym introduced by N. Bergeron and al which is described by the lightening splitting of a tree. As a consequence, this shows that TSym has a (1, 3)--dendriform bialgebra structure. This means that its coproduct can be split in three parts with convenient compatibilities. This can be extended to (3, 1)-bialgebras over an arbitrary number of generators. Finally, we introduce the notion of (3, 2)--dendriform bialgebra. This is a Hopf algebra, where we can split the product in three pieces and the coproduct in two with Hopf compatibilities. We give an example of such an algebra built on the free (3, 1)-dendriform bialgebra with one generator. We describe and generate its codendriform primitives and count its coassociative primitives thanks to L. Foissy's work. We end this paper by showing that a quotient of this (3, 2)-dendriform bialgebra is the Loday-Ronco bialgebra.


title: Search for long-lived heavy neutral leptons and Higgs portal scalars decaying in the MicroBooNE detector

abstract: We present a search for long-lived Higgs portal scalars (HPS) and heavy neutral leptons (HNL) decaying in the MicroBooNE liquid-argon time projection chamber. The measurement is performed using data collected synchronously with the NuMI neutrino beam from Fermilab's Main Injector with a total exposure corresponding to $7.01 \times 10^{20}$ protons on target. We set upper limits at the $90\%$ confidence level on the mixing parameter $\lvert U_{\mu 4}\rvert^2$ ranging from $\lvert U_{\mu 4}\rvert^2<12.9\times 10^{-8}$ for Majorana HNLs with a mass of $m_{\rm HNL}=246$ MeV to $\lvert U_{\mu 4}\rvert^2<0.92 \times 10^{-8}$ for $m_{\rm HNL}=385$ MeV, assuming $\lvert U_{e 4}\rvert^2 = \lvert U_{\tau 4}\rvert^2 = 0$ and HNL decays into $\mu^\pm\pi^\mp$ pairs. These limits on $\lvert U_{\mu 4}\rvert^2$ represent an order of magnitude improvement in sensitivity compared to the previous MicroBooNE result. We also constrain the scalar-Higgs mixing angle $\theta$ by searching for HPS decays into $\mu^+\mu^-$ final states, excluding a contour in the parameter space with lower bounds of $\theta^2<31.3 \times 10^{-9}$ for $m_{\rm HPS}=212$ GeV and $\theta^2<1.09 \times 10^{-9}$ for $m_{\rm HPS}=275$ GeV. These are the first constraints on the scalar-Higgs mixing angle $\theta$ from a dedicated experimental search in this mass range.


title: Critical solutions of nonminimally coupled scalar field theory and first-order thermodynamics of gravity

abstract: Analytical solutions of nonminimally coupled scalar field cosmology corresponding to critical scalar field values constitute a potential challenge to the recent first-order thermodynamics of scalar-tensor gravity (a formalism picturing general relativity as the zero-temperature equilibrium state for modified gravity). The critical solutions are unstable with respect to homogeneous perturbations, hence unphysical.


title: Bayesian multi-objective optimization for stochastic simulators: an extension of the Pareto Active Learning method

abstract: This article focuses on the multi-objective optimization of stochastic simulators with high output variance, where the input space is finite and the objective functions are expensive to evaluate. We rely on Bayesian optimization algorithms, which use probabilistic models to make predictions about the functions to be optimized. The proposed approach is an extension of the Pareto Active Learning (PAL) algorithm for the estimation of Pareto-optimal solutions that makes it suitable for the stochastic setting. We named it Pareto Active Learning for Stochastic Simulators (PALS). The performance of PALS is assessed through numerical experiments over a set of bi-dimensional, bi-objective test problems. PALS exhibits superior performance when compared to other scalarization-based and random-search approaches.


title: Continuous Methods : Hamiltonian Domain Translation

abstract: This paper proposes a novel approach to domain translation. Leveraging established parallels between generative models and dynamical systems, we propose a reformulation of the Cycle-GAN architecture. By embedding our model with a Hamiltonian structure, we obtain a continuous, expressive and most importantly invertible generative model for domain translation.


title: On data-driven chance constraint learning for mixed-integer optimization problems

abstract: When dealing with real-world optimization problems, decision-makers usually face high levels of uncertainty associated with partial information, unknown parameters, or complex relationships between these and the problem decision variables. In this work, we develop a novel Chance Constraint Learning (CCL) methodology with a focus on mixed-integer linear optimization problems which combines ideas from the chance constraint and constraint learning literature. Chance constraints set a probabilistic confidence level for a single or a set of constraints to be fulfilled, whereas the constraint learning methodology aims to model the functional relationship between the problem variables through predictive models. One of the main issues when establishing a learned constraint arises when we need to set further bounds for its response variable: the fulfillment of these is directly related to the accuracy of the predictive model and its probabilistic behaviour. In this sense, CCL makes use of linearizable machine learning models to estimate conditional quantiles of the learned variables, providing a data-driven solution for chance constraints. An open-access software has been developed to be used by practitioners. Furthermore, benefits from CCL have been tested in two real-world case studies, proving how robustness is added to optimal solutions when probabilistic bounds are set for learned constraints.


title: Two-loop improved predictions for $M_W$ and $\sin^2\theta_{eff}$ in Two-Higgs-Doublet Models

abstract: We present the currently most precise predictions for the $W$-boson mass and the leptonic effective mixing angle $\sin^2\theta_{\text{eff}}$ in the aligned Two-Higgs-Doublet Model. The evaluation includes the full one-loop result, all known higher-order corrections of the Standard Model, and the non-standard two-loop contributions that increase with mass splittings between charged and neutral THDM Higgs bosons. They depend on $\tan\beta$ and the soft $Z_2$-symmetry breakingparameter $m_{12}^2$ of the scalar potential, in addition to the non-standard boson masses. Whenever the one-loop corrections become large, the two-loop contributions yield substantial modifications of the predictions, which is of particular importance for the $W$ mass where large mass shifts are required to reach the recently published final resultof the CDF collaboration. Numerical results are shown for the dependence on the various non-standard parameters and in comparison with experimental data.


title: Phase space topology of four-wave mixing reconstructed by a neural network

abstract: The dynamics of ideal four-wave mixing in optical fiber is reconstructed by taking advantage of the combination of experimental measurements with supervised machine learning strategies. The training data consist of power-dependent spectral phase and amplitude recorded at the output of a short segment of fiber. The neural network is able to accurately predict the nonlinear dynamics over tens of kilometers, and to retrieve the main features of the phase space topology including multiple Fermi-Pasta-Ulam recurrence cycles and the system separatrix boundary.


title: A Gaussian correlation inequality for plurisubharmonic functions

abstract: A positive correlation inequality is established for circular-invariant plurisubharmonic functions, with respect to complex Gaussian measures. The main ingredients of the proofs are the Ornstein-Uhlenbeck semigroup, and another natural semigroup associated to the Gaussian $\partial$-Laplacian.


title: Fermionic Entanglement and Correlation

abstract: Entanglement plays a central role in numerous fields of quantum science. However, as one departs from the typical "Alice versus Bob" setting into the world of indistinguishable fermions, it is not immediately clear how the concept of entanglement is defined among these identical particles. Our endeavor to recover the notion of subsystems, or mathematically speaking, the tensor product structure of the Hilbert space, lead to two natural pictures of defining fermionic entanglement: the particle picture and the mode picture. In the particle picture, entanglement characterizes the deviation of a fermionic quantum state from the non-interacting ones, e.g., single Slater determinants. In the mode picture, we recover the notion of subsystems, by referring to the partitioning of the orbital/mode that the fermions occupy, which allows us to naturally adopt the formalism of entanglement between distinguishable constituents. Both pictures reveal essential and interconnected aspects of fermionic entanglement, and thus offer precise tools for studying electron entanglement in highly relevant systems such as atoms and molecules. We showcase here two applications: i) resolving the correlation paradox in the molecular dissociation limit, ii) quantitative electronic structure analysis with orbital entanglement.


title: Jacobian of solutions to the conductivity equation in limited view

abstract: The aim of hybrid inverse problems such as Acousto-Electric Tomography or Current Density Imaging is the reconstruction of the electrical conductivity in a domain that can only be accessed from its exterior. In the inversion procedure, the solutions to the conductivity equation play a central role. In particular, it is important that the Jacobian of the solutions is non-vanishing. In the present paper we address a two-dimensional limited view setting, where only a part of the boundary of the domain can be controlled by a non-zero Dirichlet condition, while on the remaining boundary there is a zero Dirichlet condition. For this setting, we propose sufficient conditions on the boundary functions so that the Jacobian of the corresponding solutions is non-vanishing. In that regard we allow for discontinuous boundary functions, which requires the use of solutions in weighted Sobolev spaces. We implement the procedure of reconstructing a conductivity from power density data numerically and investigate how this limited view setting affects the Jacobian and the quality of the reconstructions.


title: First Measurement of the EMC Effect in $^{10}$B and $^{11}$B

abstract: The nuclear dependence of the inclusive inelastic electron scattering cross section (the EMC effect) has been measured for the first time in $^{10}$B and $^{11}$B. Previous measurements of the EMC effect in $A \leq 12$ nuclei showed an unexpected nuclear dependence; $^{10}$B and $^{11}$B were measured to explore the EMC effect in this region in more detail. Results are presented for $^9$Be, $^{10}$B, $^{11}$B, and $^{12}$C at an incident beam energy of 10.6~GeV. The EMC effect in the boron isotopes was found to be similar to that for $^9$Be and $^{12}$C, yielding almost no nuclear dependence in the EMC effect in the range $A=4-12$. This represents important, new data supporting the hypothesis that the EMC effect depends primarily on the local nuclear environment due to the cluster structure of these nuclei.


title: Storehouse: a Reinforcement Learning Environment for Optimizing Warehouse Management

abstract: Warehouse Management Systems have been evolving and improving thanks to new Data Intelligence techniques. However, many current optimizations have been applied to specific cases or are in great need of manual interaction. Here is where Reinforcement Learning techniques come into play, providing automatization and adaptability to current optimization policies. In this paper, we present Storehouse, a customizable environment that generalizes the definition of warehouse simulations for Reinforcement Learning. We also validate this environment against state-of-the-art reinforcement learning algorithms and compare these results to human and random policies.


title: Tandem Multitask Training of Speaker Diarisation and Speech Recognition for Meeting Transcription

abstract: Self-supervised-learning-based pre-trained models for speech data, such as Wav2Vec 2.0 (W2V2), have become the backbone of many speech tasks. In this paper, to achieve speaker diarisation and speech recognition using a single model, a tandem multitask training (TMT) method is proposed to fine-tune W2V2. For speaker diarisation, the tasks of voice activity detection (VAD) and speaker classification (SC) are required, and connectionist temporal classification (CTC) is used for ASR. The multitask framework implements VAD, SC, and ASR using an early layer, middle layer, and late layer of W2V2, which coincides with the order of segmenting the audio with VAD, clustering the segments based on speaker embeddings, and transcribing each segment with ASR. Experimental results on the augmented multi-party (AMI) dataset showed that using different W2V2 layers for VAD, SC, and ASR from the earlier to later layers for TMT not only saves computational cost, but also reduces diarisation error rates (DERs). Joint fine-tuning of VAD, SC, and ASR yielded 16%/17% relative reductions of DER with manual/automatic segmentation respectively, and consistent reductions in speaker attributed word error rate, compared to the baseline with separately fine-tuned models.


title: Decision Trees for Analyzing Influences on the Accuracy of Indoor Localization Systems

abstract: Absolute position accuracy is the key performance criterion of an Indoor Localization System (ILS). Since ILS are heterogeneous and complex cyber-physical systems, the localization accuracy depends on various influences from the environment, system configuration, and the application processes. To determine the position accuracy of a system in a reproducible, comparable, and realistic manner, these factors must be taken into account. We propose a strategy for analyzing the influences on the position accuracy of ILS using decision trees in combination with application-related or technology-related categorization. The proposed strategy is validated using empirical data from 120 experiments. The accuracy of an Ultra-Wideband and a LiDAR-based ILS was determined under different application-driven influencing factors, considering the application of autonomous mobile robots in warehouses. Finally, the opportunities and limitations of analyzing decision trees to compare system performance, find a suitable system, optimize the environment or system configuration, and understand the relevance of different influencing factors are presented.


title: Possible quantum effects at the transition from cosmological deceleration to acceleration

abstract: The recent transition from decelerated to accelerated expansion can be seen as a reflection (or "bounce") in the connection variable, defined by the inverse comoving Hubble length ($b=\dot a$, on-shell). We study the quantum cosmology of this process. We use a formalism for obtaining relational time variables either through the demotion of the constants of Nature to integration constants, or by identifying fluid constants of motion. We extend its previous application to a toy model (radiation and $\Lambda$) to the realistic setting of a transition from dust matter to $\Lambda$ domination. In the dust and $\Lambda$ model two time variables may be defined, conjugate to $\Lambda$ and to the dust constant of motion, and we work out the monochromatic solutions to the Schr\"odinger equation representing the Hamiltonian constraint. As for their radiation and $\Lambda$ counterparts, these solutions exhibit "ringing", whereby the incident and reflected waves interfere, leading to oscillations in the amplitude. In the semi-classical approximation we find that, close to the bounce, the probability distribution becomes double-peaked, one peak following a trajectory close to the classical limit but with a Hubble parameter slightly shifted downwards, the other with a value of $b$ stuck at its minimum $b=b_\star$. Still closer to the transition, the distribution is better approximated by an exponential distribution, with a single peak at $b=b_\star$, and a (more representative) average $b$ biased towards a value higher than the classical trajectory. Thus, we obtain a distinctive prediction for the average Hubble parameter with redshift: slightly lower than its classical value when $z\approx 0$, but potentially much higher than the classical prediction around $z\sim 0.64$, where the bounce most likely occurred. The implications for the "Hubble tension" have not escaped us.


title: Predictive Power of the Exact Constraints and Appropriate Norms in Density Functional Theory

abstract: Ground-state Kohn-Sham density functional theory provides, in principle, the exact ground-state energy and electronic spin-densities of real interacting electrons in a static external potential. In practice, the exact density functional for the exchange-correlation (xc) energy must be approximated in a computationally efficient way. About twenty mathematical properties of the exact xc functional are known. In this work, we review and discuss these known constraints on the xc energy and hole. By analyzing a sequence of increasingly sophisticated density functional approximations (DFAs), we argue that: (1) the satisfaction of more exact constraints and appropriate norms makes a functional more predictive over the immense space of many-electron systems; (2) fitting to bonded systems yields an interpolative DFA that may not extrapolate well to systems unlike those in the fitting set. We discuss how the class of well-described systems has grown along with constraint satisfaction, and the possibilities for future functional development.


title: Participatory Action for Citizens' Engagement to Develop a Pro-Environmental Research Application

abstract: To understand and begin to address the challenge of air pollution in Europe we conducted participatory research, art and design activities with the residents of one of the areas most affected by smog in Poland. The participatory research events, described in detail in this article, centered around the theme of ecology and served to design an application that would allow us to conduct field research on pro-environmental behaviours at a larger scale. As a result we developed a research application, rooted in local culture and history and place attachment, which makes use of gamification techniques. The application gathers air quality data from the densest network of air pollution sensors in Europe, thereby aligning the visible signs of pollution in the app with the local sensor data. At the same time it reinforces the users' pro-environmental habits and exposes them to educational messages about air quality and the environment. The data gathered with this application will validate the efficacy of this kind of an intervention in addressing residents' smog-causing behaviours.


title: Longitudinally strong focusing lattice for Compton--ring gamma sources

abstract: Electron storage rings of GeV energy with laser pulse stacking cavities are promising intense sources of polarised hard photons which, via pair production, can be used to generate polarised positron beams. Dynamics of electron bunches circulating in a storage ring and interacting with high-power laser pulses is studied both analytically and by simulation. Common features and differences in the behaviour of bunches interacting with an extremely high power laser pulse and with a moderate pulse are discussed. Also considerations on particular lattice designs for Compton gamma rings are presented.


title: DSTEA: Improving Dialogue State Tracking via Entity Adaptive Pre-training

abstract: Dialogue State Tracking (DST) is critical for comprehensively interpreting user and system utterances, thereby forming the cornerstone of efficient dialogue systems. Despite past research efforts focused on enhancing DST performance through alterations to the model structure or integrating additional features like graph relations, they often require additional pre-training with external dialogue corpora. In this study, we propose DSTEA, improving Dialogue State Tracking via Entity Adaptive pre-training, which can enhance the encoder through by intensively training key entities in dialogue utterances. DSTEA identifies these pivotal entities from input dialogues utilizing four different methods: ontology information, named-entity recognition, the spaCy, and the flair library. Subsequently, it employs selective knowledge masking to train the model effectively. Remarkably, DSTEA only requires pre-training without the direct infusion of extra knowledge into the DST model. This approach resulted in substantial performance improvements of four robust DST models on MultiWOZ 2.0, 2.1, and 2.2, with joint goal accuracy witnessing an increase of up to 2.69% (from 52.41% to 55.10%). Further validation of DSTEA's efficacy was provided through comparative experiments considering various entity types and different entity adaptive pre-training configurations such as masking strategy and masking rate.


title: Variational Inference of overparameterized Bayesian Neural Networks: a theoretical and empirical study

abstract: This paper studies the Variational Inference (VI) used for training Bayesian Neural Networks (BNN) in the overparameterized regime, i.e., when the number of neurons tends to infinity. More specifically, we consider overparameterized two-layer BNN and point out a critical issue in the mean-field VI training. This problem arises from the decomposition of the lower bound on the evidence (ELBO) into two terms: one corresponding to the likelihood function of the model and the second to the Kullback-Leibler (KL) divergence between the prior distribution and the variational posterior. In particular, we show both theoretically and empirically that there is a trade-off between these two terms in the overparameterized regime only when the KL is appropriately re-scaled with respect to the ratio between the the number of observations and neurons. We also illustrate our theoretical results with numerical experiments that highlight the critical choice of this ratio.


title: Consecutive Pretraining: A Knowledge Transfer Learning Strategy with Relevant Unlabeled Data for Remote Sensing Domain

abstract: Currently, under supervised learning, a model pretrained by a large-scale nature scene dataset and then fine-tuned on a few specific task labeling data is the paradigm that has dominated the knowledge transfer learning. It has reached the status of consensus solution for task-aware model training in remote sensing domain (RSD). Unfortunately, due to different categories of imaging data and stiff challenges of data annotation, there is not a large enough and uniform remote sensing dataset to support large-scale pretraining in RSD. Moreover, pretraining models on large-scale nature scene datasets by supervised learning and then directly fine-tuning on diverse downstream tasks seems to be a crude method, which is easily affected by inevitable labeling noise, severe domain gaps and task-aware discrepancies. Thus, in this paper, considering the self-supervised pretraining and powerful vision transformer (ViT) architecture, a concise and effective knowledge transfer learning strategy called ConSecutive PreTraining (CSPT) is proposed based on the idea of not stopping pretraining in natural language processing (NLP), which can gradually bridge the domain gap and transfer knowledge from the nature scene domain to the RSD. The proposed CSPT also can release the huge potential of unlabeled data for task-aware model training. Finally, extensive experiments are carried out on twelve datasets in RSD involving three types of downstream tasks (e.g., scene classification, object detection and land cover classification) and two types of imaging data (e.g., optical and SAR). The results show that by utilizing the proposed CSPT for task-aware model training, almost all downstream tasks in RSD can outperform the previous method of supervised pretraining-then-fine-tuning and even surpass the state-of-the-art (SOTA) performance without any expensive labeling consumption and careful model design.


title: Systematic Modification of Functionality in Disordered Elastic Networks Through Free Energy Surface Tailoring

abstract: Advances in manufacturing and characterization of complex molecular systems have created a need for new methods for design at molecular length scales. Emerging approaches are increasingly relying on the use of Artificial Intelligence (AI), and the training of AI models on large data libraries. This paradigm shift has led to successful applications, but shortcomings related to interpretability and generalizability continue to pose challenges. Here, we explore an alternative paradigm in which AI is combined with physics-based considerations for molecular and materials engineering. Specifically, collective variables, akin to those used in enhanced sampled simulations, are constructed using a machine learning (ML) model trained on data gathered from a single system. Through the ML-constructed collective variables, it becomes possible to identify critical molecular interactions in the system of interest, the modulation of which enables a systematic tailoring of the system's free energy landscape. To explore the efficacy of the proposed approach, we use it to engineer allosteric regulation, and uniaxial strain fluctuations in a complex disordered elastic network. Its successful application in these two cases provides insights regarding how functionality is governed in systems characterized by extensive connectivity, and points to its potential for design of complex molecular systems.

categories: cond-mat.soft cond-mat.mtrl-sci physics.bio-ph physics.chem-ph physics.comp-ph


title: Probing non-standard $HVV (V=W, Z)$ couplings in single Higgs production at future electron-proton collider

abstract: The couplings of the Higgs boson ($H$) with massive gauge bosons of weak interaction ($V= W, Z$), can be probed in single Higgs boson production at the proposed future Large Hadron-Electron Collider (LHeC). In the collision of an electron with a proton, single Higgs production takes place via so-called charged-current ($e^-p \to \nu_e H j$) and neutral-current ($e^-p \to e^-H j$) processes. We explore the potential of the azimuthal angle correlation between the forward jet and scattered neutrino or electron in probing the non-standard $HVV$ couplings at the collider center-of-mass energy of $\sqrt{s} \approx 1.3$~TeV. We choose the most general modifications (of $CP$-even and $CP$-odd nature) to these couplings due to new physics effects beyond the standard model. We derive exclusion limits on new physics parameters of $HVV$ couplings as a function of integrated luminosity at $95\%$ C.L. using the azimuthal angular correlations in charged- and neutral-current processes. We find that using 1000 $fb^{-1}$ data, the standard model-like new physics parameters in $HWW$ and $HZZ$ couplings can be constrained with accuracies of $4\%$ and $15\%$, respectively. The least constrained $CP$-even parameters of $HWW$ coupling can be as large as 0.04, while those of $HZZ$ coupling can have values around 0.31. Allowed values of $CP$-odd parameters in $HWW$ and $HZZ$ couplings are found to be around 0.14 and 0.34, respectively. We also study changes in the allowed values of non-trivial new physics parameters in the presence of other parameters.


title: Maximum Weight b-Matchings in Random-Order Streams

abstract: We consider the maximum weight $b$-matching problem in the random-order semi-streaming model. Assuming all weights are small integers drawn from $[1,W]$, we present a $2 - \frac{1}{2W} + \varepsilon$ approximation algorithm, using a memory of $O(\max(|M_G|, n) \cdot poly(\log(m),W,1/\varepsilon))$, where $|M_G|$ denotes the cardinality of the optimal matching. Our result generalizes that of Bernstein [Bernstein, 2015], which achieves a $3/2 + \varepsilon$ approximation for the maximum cardinality simple matching. When $W$ is small, our result also improves upon that of Gamlath et al. [Gamlath et al., 2019], which obtains a $2 - \delta$ approximation (for some small constant $\delta \sim 10^{-17}$) for the maximum weight simple matching. In particular, for the weighted $b$-matching problem, ours is the first result beating the approximation ratio of $2$. Our technique hinges on a generalized weighted version of edge-degree constrained subgraphs, originally developed by Bernstein and Stein [Bernstein and Stein, 2015]. Such a subgraph has bounded vertex degree (hence uses only a small number of edges), and can be easily computed. The fact that it contains a $2 - \frac{1}{2W} + \varepsilon$ approximation of the maximum weight matching is proved using the classical K\H{o}nig-Egerv\'ary's duality theorem.


title: Impact of granular inclusions on the phase behavior of colloidal gels

abstract: Colloidal gels formed from small attractive particles are commonly used in formulations to keep larger components in suspension. However, despite extensive work characterizing unfilled gels, little is known about how larger inclusions alter the phase behavior and microstructure of the colloidal system. Here we use numerical simulations to examine how larger `granular' particles can alter the gel transition phase boundaries. We find two distinct regimes depending on both the filler size and native gel structure: a `passive' regime where the filler fits into already-present voids, giving little change in the transition, and an `active' regime where the filler no longer fits in these voids and instead perturbs the native structure. In this second regime the phase boundary is controlled by an effective colloidal volume fraction given by the available free volume.


title: A new perspective on the fictitious space lemma

abstract: In the present contribution we propose a new proof of the so-called fictitious space lemma. For the proof, we exhibit an explicit expression for the inverse of additive Schwarz preconditioners in terms of Moore-Penrose pseudo inverse of the map associated to the decomposition over the subdomain partition.


title: Pixel-level Correspondence for Self-Supervised Learning from Video

abstract: While self-supervised learning has enabled effective representation learning in the absence of labels, for vision, video remains a relatively untapped source of supervision. To address this, we propose Pixel-level Correspondence (PiCo), a method for dense contrastive learning from video. By tracking points with optical flow, we obtain a correspondence map which can be used to match local features at different points in time. We validate PiCo on standard benchmarks, outperforming self-supervised baselines on multiple dense prediction tasks, without compromising performance on image classification.


title: Rhymes in primes

abstract: This is a popular article about the work of James Maynard, 2022 Fields medalist.


title: Learning Sequential Descriptors for Sequence-based Visual Place Recognition

abstract: In robotics, Visual Place Recognition is a continuous process that receives as input a video stream to produce a hypothesis of the robot's current position within a map of known places. This task requires robust, scalable, and efficient techniques for real applications. This work proposes a detailed taxonomy of techniques using sequential descriptors, highlighting different mechanism to fuse the information from the individual images. This categorization is supported by a complete benchmark of experimental results that provides evidence on the strengths and weaknesses of these different architectural choices. In comparison to existing sequential descriptors methods, we further investigate the viability of Transformers instead of CNN backbones, and we propose a new ad-hoc sequence-level aggregator called SeqVLAD, which outperforms prior state of the art on different datasets. The code is available at https://github.com/vandal-vpr/vg-transformers.


title: List-Edge-Coloring with Bounded Maximum Degree

abstract: For a graph $G$, we show that if $mad(G)<m$, then $\chi'_\ell(G)\leq \Delta+1$ where $m$ depends upon $\Delta$ and $\chi'_\ell(G)$ is the list-chromatic index of $G$. When $\Delta\leq 20$ the value of $m$ is close to $\frac{1}{2}\Delta$, but as $\Delta$ increases $m$ becomes asymptotic to about $\frac{1}{4}\Delta+5$.


title: BlindSpotNet: Seeing Where We Cannot See

abstract: We introduce 2D blind spot estimation as a critical visual task for road scene understanding. By automatically detecting road regions that are occluded from the vehicle's vantage point, we can proactively alert a manual driver or a self-driving system to potential causes of accidents (e.g., draw attention to a road region from which a child may spring out). Detecting blind spots in full 3D would be challenging, as 3D reasoning on the fly even if the car is equipped with LiDAR would be prohibitively expensive and error prone. We instead propose to learn to estimate blind spots in 2D, just from a monocular camera. We achieve this in two steps. We first introduce an automatic method for generating ``ground-truth'' blind spot training data for arbitrary driving videos by leveraging monocular depth estimation, semantic segmentation, and SLAM. The key idea is to reason in 3D but from 2D images by defining blind spots as those road regions that are currently invisible but become visible in the near future. We construct a large-scale dataset with this automatic offline blind spot estimation, which we refer to as Road Blind Spot (RBS) dataset. Next, we introduce BlindSpotNet (BSN), a simple network that fully leverages this dataset for fully automatic estimation of frame-wise blind spot probability maps for arbitrary driving videos. Extensive experimental results demonstrate the validity of our RBS Dataset and the effectiveness of our BSN.


title: The magic of 8 and 24

abstract: This is a popular article about the work of Maryna Viazovska, 2022 Fields medalist.


title: Investigating the link between inner gravitational potential and star-formation quenching in CALIFA galaxies

abstract: It has been suggested that the gravitational potential can have a significant role in suppressing the star formation in the nearby galaxies. To establish observational constrains on this scenario, we investigate the connection between the dynamics, through the circular velocity curves (CVCs) as a proxy of the inner gravitational potential, and star formation quenching in 215 non-active galaxies across Hubble sequence from the Calar Alto Legacy Integral Field Area (CALIFA) survey. Our results show that galaxies with similar CVCs tend to have a certain star-formation quenching pattern. To explore these findings in more details, we construct kpc-resolved relations of the equivalent width of the H$\alpha$ ($W_{{\rm H}\alpha}$) versus the amplitude ($V_c$) and shape ($\beta= d\ln V_c/ d\ln R$) of the circular velocity at given radius. We find that the $W_{{\rm H}\alpha}-V_c$ is a declining relationship, where the retired regions of the galaxies (the ones with $W_{{\rm H}\alpha}$ values below 3 \r{A}) tend to have higher $V_c$. Differently, $W_{{\rm H}\alpha}-\beta$ is a bi-modal relationship, characterised by two peaks: concentration of the star forming regions at a positive $\beta$ (rising CVC) and another one of the retired regions with a negative $\beta$ (declining CVC). Our results show that both the amplitude of the CVC, driven by the mass of the galaxies, and the shape of the CVC, reflecting the internal structure of the galaxies, play an important role in galaxy's quenching history.


title: Maximal ideals in countable rings, constructively

abstract: The existence of a maximal ideal in a general nontrivial commutative ring is tied together with the axiom of choice. Following Berardi, Valentini and thus Krivine but using the relative interpretation of negation (that is, as "implies 0 = 1") we show, in constructive set theory with minimal logic, how for countable rings one can do without any kind of choice and without the usual decidability assumption that the ring is strongly discrete (membership in finitely generated ideals is decidable). By a functional recursive definition we obtain a maximal ideal in the sense that the quotient ring is a residue field (every noninvertible element is zero), and with strong discreteness even a geometric field (every element is either invertible or else zero). Krull's lemma for the related notion of prime ideal follows by passing to rings of fractions. All this equally applies to rings indexed by any well-founded set, and can be carried over to Heyting arithmetic with minimal logic. We further show how a metatheorem of Joyal and Tierney can be used to expand our treatment to arbitrary rings. Along the way we do a case study for proofs in algebra with minimal logic. An Agda formalization is available at an accompanying repository.


title: The Ising model in our dimension and our times

abstract: This is a popular article about the work of Hugo Duminil-Copin, 2022 Fields medalist.


title: Combinatorial geometry takes the lead

abstract: This is a popular article about the work of June Huh, 2022 Fields medalist.


title: Reinforced Lin-Kernighan-Helsgaun Algorithms for the Traveling Salesman Problems

abstract: TSP is a classical NP-hard combinatorial optimization problem with many practical variants. LKH is one of the state-of-the-art local search algorithms for the TSP. LKH-3 is a powerful extension of LKH that can solve many TSP variants. Both LKH and LKH-3 associate a candidate set to each city to improve the efficiency, and have two different methods, $\alpha$-measure and POPMUSIC, to decide the candidate sets. In this work, we first propose a Variable Strategy Reinforced LKH (VSR-LKH) algorithm, which incorporates three reinforcement learning methods (Q-learning, Sarsa, Monte Carlo) with LKH, for the TSP. We further propose a new algorithm called VSR-LKH-3 that combines the variable strategy reinforcement learning method with LKH-3 for typical TSP variants, including the TSP with time windows (TSPTW) and Colored TSP (CTSP). The proposed algorithms replace the inflexible traversal operations in LKH and LKH-3 and let the algorithms learn to make a choice at each search step by reinforcement learning. Both LKH and LKH-3, with either $\alpha$-measure or POPMUSIC, can be significantly improved by our methods. Extensive experiments on 236 widely-used TSP benchmarks with up to 85,900 cities demonstrate the excellent performance of VSR-LKH. VSR-LKH-3 also significantly outperforms the state-of-the-art heuristics for TSPTW and CTSP.


title: Light-induced magnetization driven by interorbital charge motion in a spin-orbit assisted Mott insulator alpha-RuCl3

abstract: In a honeycomb-lattice spin-orbit assisted Mott insulator {\alpha}-RuCl3, an ultrafast magnetization is induced by circularly polarized excitation below the Mott gap. Photo-carriers play an important role, which are generated by turning down the synergy of the on-site Coulomb interaction and the spin-orbit interaction realizing the insulator state. An ultrafast 6- fs measurement of photo-carrier dynamics and a quantum mechanical analysis clarify the mechanism, according to which the magnetization emerges from a coherent charge motion between different t2g orbitals (dyz-dxz-dxy) of Ru3+ ions. This ultrafast magnetization is weakened in the antiferromagnetic (AF) phase, which is opposite to the general tendency that the inverse Faraday effect is larger in AF compounds than in paramagnetic ones. This temperature dependence indicates that the interorbital charge motion is affected by pseudo-spin rotational symmetry breaking in the AF phase.


title: Phase transitions and latent heat in magnetized matter

abstract: Based on the assumption that the QCD phase diagram gives a realistic picture of hadronic and quark matter under different regimes, it is possible to claim that a quark core may be present inside compact objects commonly named hybrid neutron stars or even that a pure strange star may exist. In this work we explore how the phase transition is modified by the presence of strong magnetic fields and how it is impacted by parameters of the quark phase, for which we use the MIT-model with vector interactions. The phase transition is assumed to conserve flavor when hadrons turn into deconfined quarks. The hadronic equation of state is calculated with the NL3$\omega\rho^\ast$ parametrization of quantum hadrodynamics. We find that the magnetic field slightly reduces the pressure and chemical potential of the phase transition and the latent heat, the latter being very model dependent.


title: Type-0 singularities in the network flow -- Evolution of trees

abstract: The motion by curvature of networks is the generalization to finite union of curves of the curve shortening flow. This evolution has several peculiar features, mainly due to the presence of junctions where the curves meet. In this paper we show that whenever the length of one single curve vanishes and two triple junctions coalesce, then the curvature of the evolving networks remains bounded. This topological singularity is exclusive of the network flow and it can be referred as a Type-0 singularity, in contrast to the well known Type-I and Type-II ones of the usual mean curvature flow of smooth curves or hypersurfaces, characterized by the different rates of blow up of the curvature. As a consequence, we are able to give a complete description of the evolution of tree-like networks till the first singular time, under the assumption that all the tangents flows have unit multiplicity. If the lifespan of such solutions is finite, then the curvature of the network remains bounded and we can apply the results by Ilmanen-Neves-Schulze/Lira-Mazzeo-Pluda-Saez to restart the flow after the singularity.


title: Constrained Training of Neural Networks via Theorem Proving

abstract: We introduce a theorem proving approach to the specification and generation of temporal logical constraints for training neural networks. We formalise a deep embedding of linear temporal logic over finite traces (LTL$_f$) and an associated evaluation function characterising its semantics within the higher-order logic of the Isabelle theorem prover. We then proceed to formalise a loss function $\mathcal{L}$ that we formally prove to be sound, and differentiable to a function $d\mathcal{L}$. We subsequently use Isabelle's automatic code generation mechanism to produce OCaml versions of LTL$_f$, $\mathcal{L}$ and $d\mathcal{L}$ that we integrate with PyTorch via OCaml bindings for Python. We show that, when used for training in an existing deep learning framework for dynamic movement, our approach produces expected results for common movement specification patterns such as obstacle avoidance and patrolling. The distinctive benefit of our approach is the fully rigorous method for constrained training, eliminating many of the risks inherent to ad-hoc implementations of logical aspects directly in an "unsafe" programming language such as Python.


title: The Power of Transfer Learning in Agricultural Applications: AgriNet

abstract: Advances in deep learning and transfer learning have paved the way for various automation classification tasks in agriculture, including plant diseases, pests, weeds, and plant species detection. However, agriculture automation still faces various challenges, such as the limited size of datasets and the absence of plant-domain-specific pretrained models. Domain specific pretrained models have shown state of art performance in various computer vision tasks including face recognition and medical imaging diagnosis. In this paper, we propose AgriNet dataset, a collection of 160k agricultural images from more than 19 geographical locations, several images captioning devices, and more than 423 classes of plant species and diseases. We also introduce AgriNet models, a set of pretrained models on five ImageNet architectures: VGG16, VGG19, Inception-v3, InceptionResNet-v2, and Xception. AgriNet-VGG19 achieved the highest classification accuracy of 94 % and the highest F1-score of 92%. Additionally, all proposed models were found to accurately classify the 423 classes of plant species, diseases, pests, and weeds with a minimum accuracy of 87% for the Inception-v3 model.Finally, experiments to evaluate of superiority of AgriNet models compared to ImageNet models were conducted on two external datasets: pest and plant diseases dataset from Bangladesh and a plant diseases dataset from Kashmir.


title: Generation of synchronized high-intensity x-rays and mid-infrared pulses by Doppler-shifting of relativistically intense radiation from near-critical-density plasmas

abstract: It is shown that when relativistically intense ultrashort laser pulses are reflected from the boundary of a plasma with a near-critical density, Doppler frequency shift leads to generation of intense radiation both in the high-frequency, up to the X-ray, range, and in the low-frequency, mid-infrared, range. The efficiency of energy conversion into the wavelength range of greater than 3 $\mu$m can reach several percent, which makes it possible to obtain relativistically intense pulses in the mid-infrared range. These pulses are synchronized with high harmonics in the ultraviolet and X-ray ranges, which opens up opportunities for high-precision pump-probe measurements, in particular, laser-induced electron diffraction and transient absorption spectroscopy.


title: An introduction to rating triggers for collateral-inclusive XVA in an ICTMC framework

abstract: In this paper, we model the rating process of an entity as a piecewise homogeneous continuous time Markov chain. We focus specifically on calibrating the model to both historical data (rating transition matrices) and market data (CDS quotes), relying on a simple change of measure to switch from the historical probability to the risk-neutral one. We overcome some of the imperfections of the data by proposing a novel calibration procedure, which leads to an improvement of the entire scheme. We apply our model to compute bilateral credit and debit valuation adjustments of a netting set under a CSA with thresholds depending on ratings of the two parties.


title: NExG: Provable and Guided State Space Exploration of Neural Network Control Systems using Sensitivity Approximation

abstract: We propose a new technique for performing state space exploration of closed loop control systems with neural network feedback controllers. Our approach involves approximating the sensitivity of the trajectories of the closed loop dynamics. Using such an approximator and the system simulator, we present a guided state space exploration method that can generate trajectories visiting the neighborhood of a target state at a specified time. We present a theoretical framework which establishes that our method will produce a sequence of trajectories that will reach a suitable neighborhood of the target state. We provide thorough evaluation of our approach on various systems with neural network feedback controllers of different configurations. We outperform earlier state space exploration techniques and achieve significant improvement in both the quality (explainability) and performance (convergence rate). Finally, we adopt our algorithm for the falsification of a class of temporal logic specification, assess its performance against a state-of-the-art falsification tool, and show its potential in supplementing existing falsification algorithms.


title: A Medical Information Extraction Workbench to Process German Clinical Text

abstract: Background: In the information extraction and natural language processing domain, accessible datasets are crucial to reproduce and compare results. Publicly available implementations and tools can serve as benchmark and facilitate the development of more complex applications. However, in the context of clinical text processing the number of accessible datasets is scarce -- and so is the number of existing tools. One of the main reasons is the sensitivity of the data. This problem is even more evident for non-English languages. Approach: In order to address this situation, we introduce a workbench: a collection of German clinical text processing models. The models are trained on a de-identified corpus of German nephrology reports. Result: The presented models provide promising results on in-domain data. Moreover, we show that our models can be also successfully applied to other biomedical text in German. Our workbench is made publicly available so it can be used out of the box, as a benchmark or transferred to related problems.


title: Kardar-Parisi-Zhang universality in discrete two-dimensional driven-dissipative exciton polariton condensates

abstract: The statistics of the fluctuations of quantum many-body systems are highly revealing of their nature. In driven-dissipative systems displaying macroscopic quantum coherence, as exciton polariton condensates under incoherent pumping, the phase dynamics can be mapped to the stochastic Kardar-Parisi-Zhang (KPZ) equation. However, in two dimensions (2D), it was theoretically argued that the KPZ regime may be hindered by the presence of vortices, and a non-equilibrium BKT behavior was reported close to condensation threshold. We demonstrate here that, when a discretized 2D polariton system is considered, universal KPZ properties can emerge. We support our analysis by extensive numerical simulations of the discrete stochastic generalized Gross-Pitaevskii equation. We show that the first-order correlation function of the condensate exhibits stretched exponential behaviors in space and time with critical exponents characteristic of the 2D KPZ universality class, and find that the related scaling function accurately matches the KPZ theoretical one, stemming from functional Renormalization Group. We also obtain the distribution of the phase fluctuations and find that it is non-Gaussian, as expected for a KPZ stochastic process.


title: Generative Adversarial Networks and Other Generative Models

abstract: Generative networks are fundamentally different in their aim and methods compared to CNNs for classification, segmentation, or object detection. They have initially not been meant to be an image analysis tool, but to produce naturally looking images. The adversarial training paradigm has been proposed to stabilize generative methods, and has proven to be highly successful -- though by no means from the first attempt. This chapter gives a basic introduction into the motivation for Generative Adversarial Networks (GANs) and traces the path of their success by abstracting the basic task and working mechanism, and deriving the difficulty of early practical approaches. Methods for a more stable training will be shown, and also typical signs for poor convergence and their reasons. Though this chapter focuses on GANs that are meant for image generation and image analysis, the adversarial training paradigm itself is not specific to images, and also generalizes to tasks in image analysis. Examples of architectures for image semantic segmentation and abnormality detection will be acclaimed, before contrasting GANs with further generative modeling approaches lately entering the scene. This will allow a contextualized view on the limits but also benefits of GANs.


title: Rotatory power reversal induced by magnetic-current in bi-isotropic media

abstract: Bi-isotropic media constitute a proper scenario for scrutinizing optical effects stemming from magnetoelectric parameters. Chiral magnetic current is a macroscopic effect arising from the chiral magnetic effect that enriches the phenomenology of a classical dielectric medium. This work examines optical aspects of bi-isotropic media in the presence of magnetic conductivity. The full isotropic scenario manifests circular birefringence described by a dispersive rotatory power that changes sign at a given frequency. For a bi-isotropic medium with antisymmetric magnetic conductivity, an intricate dispersive rotatory power is attained, supplied with sign reversal as well. This scenario also indicates a handedness reversion of the medium, an unusual property in dielectrics, which may work as a signature of bi-isotropic media supporting chiral magnetic current.


title: Effect of a femtosecond-scale temporal structure of a laser driver on generation of betatron radiation by wakefield accelerated electrons

abstract: A brightness of a betatron radiation generated by laser wakefield accelerated electrons can be increased by utilizing the laser driver with shorter duration at the same energy. Such shortening is possible by pulse compression after its nonlinear self-phase modulation in thin plate. However, this method can lead to a rather complex femtosecond-scale time structure of the pulse. In this work, the results of numerical simulations show that the presence of a pedestal or prepulses containing few percents or more of the main pulse energy can inhibit the acceleration process and lead to lower energies of accelerated electrons and generated photons. Simultaneously, the presence of a relatively long and intense postpulse following the main pulse at optimal distance can enhance the oscillations of accelerating electrons and increase the brightness of betatron radiation.


title: ENCODE: Encoding NetFlows for Network Anomaly Detection

abstract: NetFlow data is a popular network log format used by many network analysts and researchers. The advantages of using NetFlow over deep packet inspection are that it is easier to collect and process, and it is less privacy intrusive. Many works have used machine learning to detect network attacks using NetFlow data. The first step for these machine learning pipelines is to pre-process the data before it is given to the machine learning algorithm. Many approaches exist to pre-process NetFlow data; however, these simply apply existing methods to the data, not considering the specific properties of network data. We argue that for data originating from software systems, such as NetFlow or software logs, similarities in frequency and contexts of feature values are more important than similarities in the value itself. In this work, we propose an encoding algorithm that directly takes the frequency and the context of the feature values into account when the data is being processed. Different types of network behaviours can be clustered using this encoding, thus aiding the process of detecting anomalies within the network. We train several machine learning models for anomaly detection using the data that has been encoded with our encoding algorithm. We evaluate the effectiveness of our encoding on a new dataset that we created for network attacks on Kubernetes clusters and two well-known public NetFlow datasets. We empirically demonstrate that the machine learning models benefit from using our encoding for anomaly detection.


title: Some thoughts on Wilhelm von Waldenfels and on universal second order constructions

abstract: This article contains some thoughts on Wilhelm von Waldenfels and on universal second order constructions. It is my contribution to the Special Commemorative Issue of IDAQP in Honour of Professor Robin Lyth Hudson and Professor Wilhelm von Waldenfels.


title: Relevant Consequence Relations: An Invitation

abstract: We generalize the notion of consequence relation standard in abstract treatments of logic to accommodate intuitions of relevance. The guiding idea follows the \emph{use criterion}, according to which in order for some premises to have some conclusion(s) as consequence(s), the premises must each be \emph{used} in some way to obtain the conclusion(s). This relevance intuition turns out to require not just a failure of monotonicity, but also a move to considering consequence relations as obtaining between \emph{multisets}. We motivate and state basic definitions of relevant consequence relations, both in single conclusion (asymmetric) and multiple conclusion (symmetric) settings, as well as derivations and theories, guided by the use intuitions, and prove a number of results indicating that the definitions capture the desired results (at least in many cases).


title: Periodic and Event-Triggering for Joint Capacity Maximization and Safe Intersection Crossing

abstract: Intersection crossing represents a bottleneck for transportation systems and Connected Autonomous Vehicles (CAVs) may be the groundbreaking solution to the problem. This work proposes a novel framework, i.e, AVOID-PERIOD, where an Intersection Manager (IM) controls CAVs approaching an intersection in order to maximize intersection capacity while minimizing the CAVs' gas consumption. Contrary to most of the works in the literature, the CAVs' location uncertainty is accounted for and periodic communication and re-optimization allows for the creation of safe trajectories for the CAVs. To improve scalability for high-traffic intersections, an event-triggering approach is also developed (AVOID-EVENT) that minimizes computational and communication complexity. AVOID-EVENT reduces the number of re-optimizations required by 92.2%, while retaining most of the benefits introduced by AVOID-PERIOD.


title: Copy Propagation subsumes Constant Propagation

abstract: Constant propagation and copy propagation are code transformations that may avoid some load operations and can enable other optimizations. In literature, constant and copy propagations are considered two independent transformations requiring two different data flow analyses. Here we give a generic definition for copy propagation which enables us to view constant propagation as a particular case of copy propagation and formulate a novel data flow analysis that unifies these two transformations.


title: Defense Against Multi-target Trojan Attacks

abstract: Adversarial attacks on deep learning-based models pose a significant threat to the current AI infrastructure. Among them, Trojan attacks are the hardest to defend against. In this paper, we first introduce a variation of the Badnet kind of attacks that introduces Trojan backdoors to multiple target classes and allows triggers to be placed anywhere in the image. The former makes it more potent and the latter makes it extremely easy to carry out the attack in the physical space. The state-of-the-art Trojan detection methods fail with this threat model. To defend against this attack, we first introduce a trigger reverse-engineering mechanism that uses multiple images to recover a variety of potential triggers. We then propose a detection mechanism by measuring the transferability of such recovered triggers. A Trojan trigger will have very high transferability i.e. they make other images also go to the same class. We study many practical advantages of our attack method and then demonstrate the detection performance using a variety of image datasets. The experimental results show the superior detection performance of our method over the state-of-the-arts.


title: A short proof for the twisted multiplicativity property of the operator-valued S-transform

abstract: We provide a short proof for the twisted multiplicativity property of the operator-valued S-transform. This is my contribution to the topical collection ''Multivariable Operator Theory. The J\"org Eschmeier Memorial'' of Complex Analysis and Operator Theory.


title: Lipschitz trivial values of polynomial mappings

abstract: Real or complex polynomial mappings between affines spaces admitting a Lipschitz-trivial value are completely characterized.