title: Towards Quaternion Quadratic Phase Fourier Transform

abstract: The quadratic phase Fourier transform QPFT is a neoteric addition to the class of Fourier transforms and embodies a variety of signal processing tools including the Fourier, fractional Fourier, linear canonical, and special affine Fourier transform. In this paper, we generalize the quadratic phase Fourier transform to quaternion valued signals, known as the quaternion QPFT QQPFT. We initiate our investigation by studying the QPFT of 2D quaternionic signals, then we introduce the QQPFT of 2D quaternionic signals. Using the fundamental relationship between the QQPFT and quaternion Fourier transform QFT, we derive the inverse transform and Parseval and Plancherel formulas associated with the QQPFT. Some other properties including linearity, shift and modulation of the QQPFT are also studied. Finally, we formulate several classes of uncertainty principles UPs for the QQPFT, which including Heisenberg type UP, logarithmic UP, Hardys UP, Beurlings UP and Donohon Starks UP. It can be regarded as the first step in the applications of the QQPFT in the real world.


title: ViGAT: Bottom-up event recognition and explanation in video using factorized graph attention network

abstract: In this paper a pure-attention bottom-up approach, called ViGAT, that utilizes an object detector together with a Vision Transformer (ViT) backbone network to derive object and frame features, and a head network to process these features for the task of event recognition and explanation in video, is proposed. The ViGAT head consists of graph attention network (GAT) blocks factorized along the spatial and temporal dimensions in order to capture effectively both local and long-term dependencies between objects or frames. Moreover, using the weighted in-degrees (WiDs) derived from the adjacency matrices at the various GAT blocks, we show that the proposed architecture can identify the most salient objects and frames that explain the decision of the network. A comprehensive evaluation study is performed, demonstrating that the proposed approach provides state-of-the-art results on three large, publicly available video datasets (FCVID, Mini-Kinetics, ActivityNet).


title: Upgrading the protection of children from manipulative and addictive strategies in online games: Legal and technical solutions beyond privacy regulation

abstract: Despite the increasing awareness from academia, civil society and media to the issue of child manipulation online, the current EU regulatory system fails at providing sufficient levels of protection. Given the universality of the issue, there is a need to combine and further these scattered efforts into a unitary, multidisciplinary theory of digital manipulation that identifies causes and effects, systematizes the technical and legal knowledge on manipulative and addictive tactics, and to find effective regulatory mechanisms to fill the legislative gaps. In this paper we discuss manipulative and exploitative strategies in the context of online games for children, suggest a number of possible reasons for the failure of the applicable regulatory system, propose an "upgrade" for the regulatory approach to address these risks from the perspective of freedom of thought, and present and discuss technological approaches that allow for the development of games that verifiably protect the privacy and freedoms of players.


title: The Chromatic Nullstellensatz

abstract: We show that Lubin--Tate theories attached to algebraically closed fields are characterized among $T(n)$-local $\mathbb{E}_{\infty}$-rings as those that satisfy an analogue of Hilbert's Nullstellensatz. Furthermore, we show that for every $T(n)$-local $\mathbb{E}_{\infty}$-ring $R$, the collection of $\mathbb{E}_\infty$-ring maps from $R$ to such Lubin-Tate theories jointly detect nilpotence. In particular, we deduce that every non-zero $T(n)$-local $\mathbb{E}_{\infty}$-ring $R$ admits an $\mathbb{E}_\infty$-ring map to such a Lubin-Tate theory. As consequences, we construct $\mathbb{E}_{\infty}$ complex orientations of algebraically closed Lubin-Tate theories, compute the strict Picard spectra of such Lubin-Tate theories, and prove redshift for the algebraic $\mathrm{K}$-theory of arbitrary $\mathbb{E}_{\infty}$-rings.


title: Deep reinforcement learning for key distribution based on quantum repeaters

abstract: This work examines secret key rates of key distribution based on quantum repeaters in a broad parameter space of the communication distance and coherence time of the quantum memories. As the first step in this task, a Markov decision process modeling the distribution of entangled quantum states via quantum repeaters is developed. Based on this model, a simulation is implemented, which is employed to determine secret key rates under naively controlled, limited memory storage times for a wide range of parameters. The complexity of the quantum state evolution in a multiple-segment quantum repeater chain motivates the use of deep reinforcement learning to search for optimal solutions for the memory storage time limits - the so-called memory cut-offs. The novel contribution in this work is to explore very general cut-off strategies which dynamically adapt to the state of the quantum repeater. An implementation of this approach is presented, with a particular focus on four-segment quantum repeaters, achieving proof of concept of its validity by finding exemplary solutions that outperform the naive strategies.


title: Bias-correction and Test for Mark-point Dependence with Replicated Marked Point Processes

abstract: Mark-point dependence plays a critical role in research problems that can be fitted into the general framework of marked point processes. In this work, we focus on adjusting for mark-point dependence when estimating the mean and covariance functions of the mark process, given independent replicates of the marked point process. We assume that the mark process is a Gaussian process and the point process is a log-Gaussian Cox process, where the mark-point dependence is generated through the dependence between two latent Gaussian processes. Under this framework, naive local linear estimators ignoring the mark-point dependence can be severely biased. We show that this bias can be corrected using a local linear estimator of the cross-covariance function and establish uniform convergence rates of the bias-corrected estimators. Furthermore, we propose a test statistic based on local linear estimators for mark-point independence, which is shown to converge to an asymptotic normal distribution in a parametric $\sqrt{n}$-convergence rate. Model diagnostics tools are developed for key model assumptions and a robust functional permutation test is proposed for a more general class of mark-point processes. The effectiveness of the proposed methods is demonstrated using extensive simulations and applications to two real data examples.


title: Determining the volume fraction in 2-phase composites and bodies using time varying applied fields

abstract: A body $\Theta$ containing two phases, which may form a periodic composite with microstructure much smaller that the body, or which may have structure on a length scale comparable to the body, is subjected to slowly time varying boundary conditions that would produce an approximate uniform field in $\Theta$ were it filled with homogeneous material. Here slowly time varying means that the wavelengths and attenuation lengths of waves at the frequencies associated with the time variation are much larger than the size of $\Theta$, so that we can make a quasistatic approximation. At least one of the two phase does not have an instantaneous response but rather depends on fields at prior times. The fields may be those associated with electricity, magnetism, fluid flow in porous media, or antiplane elasticity. We find, subject to these approximations, that the time variation of the boundary conditions can be designed so boundary measurements at a specific time $t=t_0$ exactly yield the volume fractions of the phases, independent of the detailed geometric configuration of the phases. Moreover, for specially tailored time variations, the volume fraction can be exactly determined frommeasurements at any time $t$, not just at the specific time $t=t_0$. We also show how time varying boundary conditions, not oscillating at the single frequency $\omega_0$, can be designed to exactly retrieve the response at $\omega_0$.


title: Robust Landmark-based Stent Tracking in X-ray Fluoroscopy

abstract: In clinical procedures of angioplasty (i.e., open clogged coronary arteries), devices such as balloons and stents need to be placed and expanded in arteries under the guidance of X-ray fluoroscopy. Due to the limitation of X-ray dose, the resulting images are often noisy. To check the correct placement of these devices, typically multiple motion-compensated frames are averaged to enhance the view. Therefore, device tracking is a necessary procedure for this purpose. Even though angioplasty devices are designed to have radiopaque markers for the ease of tracking, current methods struggle to deliver satisfactory results due to the small marker size and complex scenes in angioplasty. In this paper, we propose an end-to-end deep learning framework for single stent tracking, which consists of three hierarchical modules: U-Net based landmark detection, ResNet based stent proposal and feature extraction, and graph convolutional neural network (GCN) based stent tracking that temporally aggregates both spatial information and appearance features. The experiments show that our method performs significantly better in detection compared with the state-of-the-art point-based tracking models. In addition, its fast inference speed satisfies clinical requirements.


title: DeepIPC: Deeply Integrated Perception and Control for an Autonomous Vehicle in Real Environments

abstract: In this work, we introduce DeepIPC, a novel end-to-end model tailored for autonomous driving, which seamlessly integrates perception and control tasks. Unlike traditional models that handle these tasks separately, DeepIPC innovatively combines a perception module, which processes RGBD images for semantic segmentation and generates bird's eye view (BEV) mappings, with a controller module that utilizes these insights along with GNSS and angular speed measurements to accurately predict navigational waypoints. This integration allows DeepIPC to efficiently translate complex environmental data into actionable driving commands. Our comprehensive evaluation demonstrates DeepIPC's superior performance in terms of drivability and multi-task efficiency across diverse real-world scenarios, setting a new benchmark for end-to-end autonomous driving systems with a leaner model architecture. The experimental results underscore DeepIPC's potential to significantly enhance autonomous vehicular navigation, promising a step forward in the development of autonomous driving technologies. For further insights and replication, we will make our code and datasets available at https://github.com/oskarnatan/DeepIPC.


title: Towards Efficient and Scale-Robust Ultra-High-Definition Image Demoireing

abstract: With the rapid development of mobile devices, modern widely-used mobile phones typically allow users to capture 4K resolution (i.e., ultra-high-definition) images. However, for image demoireing, a challenging task in low-level vision, existing works are generally carried out on low-resolution or synthetic images. Hence, the effectiveness of these methods on 4K resolution images is still unknown. In this paper, we explore moire pattern removal for ultra-high-definition images. To this end, we propose the first ultra-high-definition demoireing dataset (UHDM), which contains 5,000 real-world 4K resolution image pairs, and conduct a benchmark study on current state-of-the-art methods. Further, we present an efficient baseline model ESDNet for tackling 4K moire images, wherein we build a semantic-aligned scale-aware module to address the scale variation of moire patterns. Extensive experiments manifest the effectiveness of our approach, which outperforms state-of-the-art methods by a large margin while being much more lightweight. Code and dataset are available at https://xinyu-andy.github.io/uhdm-page.


title: A Secure Clustering Protocol with Fuzzy Trust Evaluation and Outlier Detection for Industrial Wireless Sensor Networks

abstract: Security is one of the major concerns in Industrial Wireless Sensor Networks (IWSNs). To assure the security in clustered IWSNs, this paper presents a secure clustering protocol with fuzzy trust evaluation and outlier detection (SCFTO). Firstly, to deal with the transmission uncertainty in an open wireless medium, an interval type-2 fuzzy logic controller is adopted to estimate the trusts. And then a density based outlier detection mechanism is introduced to acquire an adaptive trust threshold used to isolate the malicious nodes from being cluster heads. Finally, a fuzzy based cluster heads election method is proposed to achieve a balance between energy saving and security assurance, so that a normal sensor node with more residual energy or less confidence on other nodes has higher probability to be the cluster head. Extensive experiments verify that our secure clustering protocol can effectively defend the network against attacks from internal malicious or compromised nodes.


title: Abelian Combinatorics on Words: a Survey

abstract: We survey known results and open problems in abelian combinatorics on words. Abelian combinatorics on words is the extension to the commutative setting of the classical theory of combinatorics on words. The extension is based on \emph{abelian equivalence}, which is the equivalence relation defined in the set of words by having the same Parikh vector, that is, the same number of occurrences of each letter of the alphabet. In the past few years, there was a lot of research on abelian analogues of classical definitions and properties in combinatorics on words. This survey aims to gather these results.


title: Deep Preconditioners and their application to seismic wavefield processing

abstract: Seismic data processing heavily relies on the solution of physics-driven inverse problems. In the presence of unfavourable data acquisition conditions (e.g., regular or irregular coarse sampling of sources and/or receivers), the underlying inverse problem becomes very ill-posed and prior information is required to obtain a satisfactory solution. Sparsity-promoting inversion, coupled with fixed-basis sparsifying transforms, represent the go-to approach for many processing tasks due to its simplicity of implementation and proven successful application in a variety of acquisition scenarios. Leveraging the ability of deep neural networks to find compact representations of complex, multi-dimensional vector spaces, we propose to train an AutoEncoder network to learn a direct mapping between the input seismic data and a representative latent manifold. The trained decoder is subsequently used as a nonlinear preconditioner for the physics-driven inverse problem at hand. Synthetic and field data are presented for a variety of seismic processing tasks and the proposed nonlinear, learned transformations are shown to outperform fixed-basis transforms and convergence faster to the sought solution.


title: Fireball sheath instability

abstract: The evolutionary existence of plasma fireballs is a generic phenomenon realizable in diversified physical plasma-dominated circumstances starting from the laboratory to the astrocosmic scales of space and time. A fair understanding of such fireballs and associated instabilities is indeed needed to enrich astroplasmic communities from various perspectives of applied value. Naturally occurring plasma fireball events include novae, meteors, stellar structures, etc. We propose a theoretical model formalism to analyze the plasma fireball sheath (PFS) instability with the application of a quasi-linear perturbative analysis on the laboratory spatiotemporal scales. This treatment reduces the steady-state system into a unique second-order ordinary differential equation (ODE) on the perturbed electrostatic potential with variable multiparametric coefficients. A numerical illustrative platform to integrate this ODE results in an atypical set of peakon-type potential-field structures. It is noticed that both the potential and field associated with the peakonic patterns change significantly with the effective radial distance from the reference origin outwards. The variations are more pronounced at the center (steep, stiff) than that in the off-centric regions (non-steep, non-stiff). A colormap obtained with the triangulation of the potential-field correlation with the radial distance further confirms the PFS stability behaviors in a qualitative corroboration with the previous predictions reported in the literature. The applicability of our analysis in both the laboratory and astrocosmic contexts is finally indicated.


title: Fault-Tolerant Distributed Directories

abstract: A distributed directory is an overlay data structure on a graph $G$ that helps to access a shared token $t$. The directory supports three operations: publish, to announce the token, lookup, to read the contents of the token, and move, to get exclusive update access to the token. The directory is built upon a hierarchical partition of the graph using either weak or strong clusters. The main mechanism is the maintenance of a directory path that starts at the root node in the hierarchy and points to the current owner of the token. In the literature, there are known directory algorithms based on hierarchical graph structures, but none of them have considered failures. Given a hierarchical partition, we consider the impact of $f$ edge failures on the functionality and performance of the distributed directory. The edge failures may result in the splitting of clusters into up to $f+1$ connected components and an increase in the number of levels in the hierarchy. To recover the hierarchical partition after failures, we maintain spanning trees in the clusters and their connected components. If $G$ remains connected, we show that each level of the directory path is dilated by only a factor $f$. We also show that the performance of the publish and lookup operations is affected in the worst case by a factor $f$ with respect to the message complexity. The message complexity of the move operation increases by an $f$ factor and the number of additional layers in the hierarchy.


title: Electronic Phase Detection with sub-10 fs Timing Jitter for Terahertz Time-Domain Spectroscopy Systems

abstract: Terahertz time-domain spectroscopy systems based on resonator-internal repetition-rate modulation, such as SLAPCOPS [12] and ECOPS [11], rely on electronic phase detectors which are typically prone to exhibit both a non-negligible random and systematic timing error. This limits the quality of the recorded information significantly. Here, we present the results of our recent attempt to reduce these errors in our own electronic phase detection systems. A more than six-fold timing-jitter reduction from 59.0 fs to 8.6 fs led to a significant increase in both exploitable terahertz bandwidth and signal-to-noise ratio. Additionally, utilizing our interferometrically monitored delay line as a calibration standard, the systematic error could be removed almost entirely and thus, excellent resolution of spectral absorption lines be accomplished. These improvements increased the accuracy of our multi-layer thickness measurements based on electronic phase detection by more than a factor of five, pushing the overall performance well into the sub-{\mu}m regime.


title: Layer Zero-Line Modes in Antiferromagnetic Topological Insulators

abstract: Recently, the magnetic domain walls have been experimentally observed in antiferromagnetic topological insulators MnBi$_2$Te$_4$, where we find that the topological zero-line modes (ZLMs) appear along the domain walls. Here, we theoretically demonstrate that these ZLMs are layer-dependent in MnBi$_2$Te$_4$ multilayers. For domain walls with out-of-plane ferromagnetism, we find that ZLMs are equally distributed in the odd-number layers. When domain walls possess in-plane magnetization, the ZLMs can also exist in even-number layers due to in-plane mirror-symmetry breaking. Moreover, the conductive channels are mainly distributed in the outermost layers with increasing layer thickness. Our findings lay out a strategy in manipulating ZLMs and also can be utilized to distinguish the corresponding magnetic structures.


title: Efficient Bias Correction for Cross-section and Panel Data

abstract: Bias correction can often improve the finite sample performance of estimators. We show that the choice of bias correction method has no effect on the higher-order variance of semiparametrically efficient parametric estimators, so long as the estimate of the bias is asymptotically linear. It is also shown that bootstrap, jackknife, and analytical bias estimates are asymptotically linear for estimators with higher-order expansions of a standard form. In particular, we find that for a variety of estimators the straightforward bootstrap bias correction gives the same higher-order variance as more complicated analytical or jackknife bias corrections. In contrast, bias corrections that do not estimate the bias at the parametric rate, such as the split-sample jackknife, result in larger higher-order variances in the i.i.d. setting we focus on. For both a cross-sectional MLE and a panel model with individual fixed effects, we show that the split-sample jackknife has a higher-order variance term that is twice as large as that of the `leave-one-out' jackknife.


title: Probable Domain Generalization via Quantile Risk Minimization

abstract: Domain generalization (DG) seeks predictors which perform well on unseen test distributions by leveraging data drawn from multiple related training distributions or domains. To achieve this, DG is commonly formulated as an average- or worst-case problem over the set of possible domains. However, predictors that perform well on average lack robustness while predictors that perform well in the worst case tend to be overly-conservative. To address this, we propose a new probabilistic framework for DG where the goal is to learn predictors that perform well with high probability. Our key idea is that distribution shifts seen during training should inform us of probable shifts at test time, which we realize by explicitly relating training and test domains as draws from the same underlying meta-distribution. To achieve probable DG, we propose a new optimization problem called Quantile Risk Minimization (QRM). By minimizing the $\alpha$-quantile of predictor's risk distribution over domains, QRM seeks predictors that perform well with probability $\alpha$. To solve QRM in practice, we propose the Empirical QRM (EQRM) algorithm and provide: (i) a generalization bound for EQRM; and (ii) the conditions under which EQRM recovers the causal predictor as $\alpha \to 1$. In our experiments, we introduce a more holistic quantile-focused evaluation protocol for DG and demonstrate that EQRM outperforms state-of-the-art baselines on datasets from WILDS and DomainBed.


title: Casimir Wormholes in Modified Symmetric Teleparallel Gravity

abstract: In recent years there has been a growing interest in the field of Casimir wormhole. In classical general relativity (GR), it is known that the null energy condition (NEC) has to be violated to have a wormhole to be stable. The Casimir effect is an experimentally verified effect that is caused due to the vacuum field fluctuations in quantum field theory. Since the Casimir effect provides the negative energy density, thus this act as an ideal candidate for the exotic matter needed for the stability of the wormhole. In this paper, we study the Casimir effect on the wormhole geometry in modified symmetric teleparallel gravity or $f(Q)$ gravity, where the non-metricity scalar $Q$ drives the gravitation interaction. We consider three systems of the Casimir effect such as (i) two parallel plates, (ii) two parallel cylindrical plates, and (iii) two-sphere separated by a large distance to make it more experimentally feasible. Further, we studied the obtained wormhole solutions for each case with energy conditions at the wormhole throat with radius $r_0$ and found that some arbitrary quantity violates the classical energy conditions at the wormhole throat. Furthermore, the behavior of the equation of state (EoS) is also analyzed for each case. Finally, we investigate the stability of the obtained Casimir effect wormhole solutions with the generalized Tolman-Oppenheimer-Volkoff (TOV) equation.


title: Convergence of space-discretised gKPZ via Regularity Structures

abstract: In this work, we show a convergence result for the discrete formulation of the generalised KPZ equation $\partial_t u = (\Delta u) + g(u)(\nabla u)^2 + k(\nabla u) + h(u) + f(u)\xi_t(x)$, where the $\xi$ is a real-valued random field, $\Delta$ is the discrete Laplacian, and $\nabla$ is a discrete gradient, without fixing the spatial dimension. Our convergence result is established within the discrete regularity structures introduced by Hairer and Erhard [arXiv:1705.02836]. We extend with new ideas the convergence result found in [arXiv:2103.13479] that deals with a discrete form of the Parabolic Anderson model driven by a (rescaled) symmetric simple exclusion process. This is the first time that a discrete generalised KPZ equation is treated and it is a major step toward a general convergence result that will cover a large family of discrete models.


title: Fixed Points of Cone Mapping with the Application to Neural Networks

abstract: We derive conditions for the existence of fixed points of cone mappings without assuming scalability of functions. Monotonicity and scalability are often inseparable in the literature in the context of searching for fixed points of interference mappings. In applications, such mappings are approximated by non-negative neural networks. It turns out, however, that the process of training non-negative networks requires imposing an artificial constraint on the weights of the model. However, in the case of specific non-negative data, it cannot be said that if the mapping is non-negative, it has only non-negative weights. Therefore, we considered the problem of the existence of fixed points for general neural networks, assuming the conditions of tangency conditions with respect to specific cones. This does not relax the physical assumptions, because even assuming that the input and output are to be non-negative, the weights can have (small, but) less than zero values. Such properties (often found in papers on the interpretability of weights of neural networks) lead to the weakening of the assumptions about the monotonicity or scalability of the mapping associated with the neural network. To the best of our knowledge, this paper is the first to study this phenomenon.


title: Study and characterization of GaN MOS capacitors: planar versus trench topographies

abstract: Developing high quality GaN/dielectric interfaces is a fundamental step for manufacturing GaN vertical power transistors. In this paper, we quantitatively investigate the effect of planar etching treatment and trench formation on the performance of GaN-based MOS (metal oxide semiconductor) stacks. The results demonstrate that (i) blanket etching the GaN surface does not degrade the robustness of the deposited dielectric layer; (ii) the addition of the trench etch, while improving reproducibility, results in a decrease of breakdown performance compared to the planar structures. (iii) for the trench structures, the voltage for a 10 years lifetime is still above 20 V, indicating a good robustness. (iv) To review the trapping performance across the metal-dielectric-GaN stack, forward-reverse capacitance-voltage measurements with and without stress and photo-assistance are performed. Overall, as-grown planar capacitors devoid of prior etching steps show lowest trapping, while trench capacitors have higher interface trapping, and bulk trapping comparable to the blanket etched capacitors. (v) The nanostructure of the GaN/dielectric interface was characterized by high resolution scanning transmission electron microscopy (HR-STEM). An increased roughness of 2-3 monolayers at the GaN surface was observed after blanket etching, which was correlated to the higher density of interface traps. The results presented in this paper give fundamental insight on how the etch and trench processing affects the trapping and robustness of trench-gate GaN-MOSFETs, and provide guidance for the optimization of device performance.


title: VirtualPose: Learning Generalizable 3D Human Pose Models from Virtual Data

abstract: While monocular 3D pose estimation seems to have achieved very accurate results on the public datasets, their generalization ability is largely overlooked. In this work, we perform a systematic evaluation of the existing methods and find that they get notably larger errors when tested on different cameras, human poses and appearance. To address the problem, we introduce VirtualPose, a two-stage learning framework to exploit the hidden "free lunch" specific to this task, i.e. generating infinite number of poses and cameras for training models at no cost. To that end, the first stage transforms images to abstract geometry representations (AGR), and then the second maps them to 3D poses. It addresses the generalization issue from two aspects: (1) the first stage can be trained on diverse 2D datasets to reduce the risk of over-fitting to limited appearance; (2) the second stage can be trained on diverse AGR synthesized from a large number of virtual cameras and poses. It outperforms the SOTA methods without using any paired images and 3D poses from the benchmarks, which paves the way for practical applications. Code is available at https://github.com/wkom/VirtualPose.


title: MeritRank: Sybil Tolerant Reputation for Merit-based Tokenomics

abstract: Decentralized reputation schemes present a promising area of experimentation in blockchain applications. These solutions aim to overcome the shortcomings of simple monetary incentive mechanisms of naive tokenomics. However, there is a significant research gap regarding the limitations and benefits of such solutions. We formulate these trade-offs as a conjecture on the irreconcilability of three desirable properties of the reputation system in this context. Such a system can not be simultaneously generalizable, trustless, and Sybil resistant. To handle the limitations of this trilemma, we propose MeritRank: Sybil tolerant feedback aggregation mechanism for reputation. Instead of preventing Sybil attacks, our approach successfully bounds the benefits of these attacks. Using a dataset of participants' interactions in MakerDAO, we run experiments to demonstrate Sybil tolerance of MeritRank. Decay parameters of reputation in MeritRank: transitivity decay and connectivity decay, allow for a fine-tuning of desirable levels of reputation utility and Sybil tolerance in different use contexts.


title: Deep Reinforcement Learning for Market Making Under a Hawkes Process-Based Limit Order Book Model

abstract: The stochastic control problem of optimal market making is among the central problems in quantitative finance. In this paper, a deep reinforcement learning-based controller is trained on a weakly consistent, multivariate Hawkes process-based limit order book simulator to obtain market making controls. The proposed approach leverages the advantages of Monte Carlo backtesting and contributes to the line of research on market making under weakly consistent limit order book models. The ensuing deep reinforcement learning controller is compared to multiple market making benchmarks, with the results indicating its superior performance with respect to various risk-reward metrics, even under significant transaction costs.


title: Toledo invariants of Topological Quantum Field Theories

abstract: We prove that the Fibonacci quantum representations $\rho_{g,n}:\rm{Mod}_{g,n}\to \rm{PU}(p,q)$ for $(g,n)\in\{(0,4),(0,5),(1,2),(1,3),(2,1)\}$ are holonomy representations of complex hyperbolic structures on some compactifications of the corresponding moduli spaces $\mathcal{M}_{g,n}$. As a corollary, the forgetful map between the corresponding compactifications of $\mathcal M_{1,3}$ and $\mathcal M_{1,2}$ is a surjective holomorphic map between compact complex hyperbolic orbifolds of different dimensions higher than one, giving an answer to a problem raised by Siu. The proof consists in computing their Toledo invariants: we put this computation in a broader context, replacing the Fibonacci representations with any Hermitian modular functor and extending the Toledo invariant to a full series of cohomological invariants beginning with the signature $p-q$. We prove that these invariants satisfy the axioms of a Cohomological Field Theory and compute the $R$-matrix at first order (hence the usual Toledo invariants) in the case of the $\rm{SU}_2/\rm{SO}_3$-quantum representations at any level.


title: Learning Pedestrian Group Representations for Multi-modal Trajectory Prediction

abstract: Modeling the dynamics of people walking is a problem of long-standing interest in computer vision. Many previous works involving pedestrian trajectory prediction define a particular set of individual actions to implicitly model group actions. In this paper, we present a novel architecture named GP-Graph which has collective group representations for effective pedestrian trajectory prediction in crowded environments, and is compatible with all types of existing approaches. A key idea of GP-Graph is to model both individual-wise and group-wise relations as graph representations. To do this, GP-Graph first learns to assign each pedestrian into the most likely behavior group. Using this assignment information, GP-Graph then forms both intra- and inter-group interactions as graphs, accounting for human-human relations within a group and group-group relations, respectively. To be specific, for the intra-group interaction, we mask pedestrian graph edges out of an associated group. We also propose group pooling&unpooling operations to represent a group with multiple pedestrians as one graph node. Lastly, GP-Graph infers a probability map for socially-acceptable future trajectories from the integrated features of both group interactions. Moreover, we introduce a group-level latent vector sampling to ensure collective inferences over a set of possible future trajectories. Extensive experiments are conducted to validate the effectiveness of our architecture, which demonstrates consistent performance improvements with publicly available benchmarks. Code is publicly available at https://github.com/inhwanbae/GPGraph.


title: The swelling and shrinking of spherical thermo-responsive hydrogels

abstract: Thermo-responsive hydrogels are a promising material for creating controllable actuators for use in micro-scale devices, since they expand and contract significantly (absorbing or expelling fluid) in response to relatively small temperature changes. Understanding such systems can be difficult because of the spatially- and temporally-varying properties of the gel, and the complex relationships between the fluid dynamics, elastic deformation of the gel and chemical interaction between the polymer and fluid. We address this using a poro-elastic model, considering the dynamics of a thermo-responsive spherical hydrogel after a sudden change in the temperature that should result in substantial swelling or shrinking. We focus on two model examples, with equilibrium parameters extracted from data in the literature. We find a range of qualitatively different behaviours when swelling and shrinking, including cases where swelling and shrinking happen smoothly from the edge, and other situations which result in the formation of an inwards-travelling spherical front that separates a core and shell with markedly different degrees of swelling. We then characterise when each of these scenarios is expected to occur. An approximate analytical form for the front dynamics is developed, with two levels of constant porosity, that well-approximates the numerical solutions. This system can be evolved forward in time, and is simpler to solve than the full numerics, allowing for more efficient predictions to be made, such as when deciding dosing strategies for drug-laden hydrogels.


title: Operation-Level Performance Benchmarking of Graph Neural Networks for Scientific Applications

abstract: As Graph Neural Networks (GNNs) increase in popularity for scientific machine learning, their training and inference efficiency is becoming increasingly critical. Additionally, the deep learning field as a whole is trending towards wider and deeper networks, and ever increasing data sizes, to the point where hard hardware bottlenecks are often encountered. Emerging specialty hardware platforms provide an exciting solution to this problem. In this paper, we systematically profile and select low-level operations pertinent to GNNs for scientific computing implemented in the Pytorch Geometric software framework. These are then rigorously benchmarked on NVIDIA A100 GPUs for several various combinations of input values, including tensor sparsity. We then analyze these results for each operation. At a high level, we conclude that on NVIDIA systems: (1) confounding bottlenecks such as memory inefficiency often dominate runtime costs moreso than data sparsity alone, (2) native Pytorch operations are often as or more competitive than their Pytorch Geometric equivalents, especially at low to moderate levels of input data sparsity, and (3) many operations central to state-of-the-art GNN architectures have little to no optimization for sparsity. We hope that these results serve as a baseline for those developing these operations on specialized hardware and that our subsequent analysis helps to facilitate future software and hardware based optimizations of these operations and thus scalable GNN performance as a whole.


title: Telepresence Video Quality Assessment

abstract: Video conferencing, which includes both video and audio content, has contributed to dramatic increases in Internet traffic, as the COVID-19 pandemic forced millions of people to work and learn from home. Global Internet traffic of video conferencing has dramatically increased Because of this, efficient and accurate video quality tools are needed to monitor and perceptually optimize telepresence traffic streamed via Zoom, Webex, Meet, etc. However, existing models are limited in their prediction capabilities on multi-modal, live streaming telepresence content. Here we address the significant challenges of Telepresence Video Quality Assessment (TVQA) in several ways. First, we mitigated the dearth of subjectively labeled data by collecting ~2k telepresence videos from different countries, on which we crowdsourced ~80k subjective quality labels. Using this new resource, we created a first-of-a-kind online video quality prediction framework for live streaming, using a multi-modal learning framework with separate pathways to compute visual and audio quality predictions. Our all-in-one model is able to provide accurate quality predictions at the patch, frame, clip, and audiovisual levels. Our model achieves state-of-the-art performance on both existing quality databases and our new TVQA database, at a considerably lower computational expense, making it an attractive solution for mobile and embedded systems.


title: Estimating Model Performance under Domain Shifts with Class-Specific Confidence Scores

abstract: Machine learning models are typically deployed in a test setting that differs from the training setting, potentially leading to decreased model performance because of domain shift. If we could estimate the performance that a pre-trained model would achieve on data from a specific deployment setting, for example a certain clinic, we could judge whether the model could safely be deployed or if its performance degrades unacceptably on the specific data. Existing approaches estimate this based on the confidence of predictions made on unlabeled test data from the deployment's domain. We find existing methods struggle with data that present class imbalance, because the methods used to calibrate confidence do not account for bias induced by class imbalance, consequently failing to estimate class-wise accuracy. Here, we introduce class-wise calibration within the framework of performance estimation for imbalanced datasets. Specifically, we derive class-specific modifications of state-of-the-art confidence-based model evaluation methods including temperature scaling (TS), difference of confidences (DoC), and average thresholded confidence (ATC). We also extend the methods to estimate Dice similarity coefficient (DSC) in image segmentation. We conduct experiments on four tasks and find the proposed modifications consistently improve the estimation accuracy for imbalanced datasets. Our methods improve accuracy estimation by 18\% in classification under natural domain shifts, and double the estimation accuracy on segmentation tasks, when compared with prior methods.


title: Embedded Point Iteration Based Recursive Algorithm for Online Identification of Nonlinear Regression Models

abstract: This paper presents a novel online identification algorithm for nonlinear regression models. The online identification problem is challenging due to the presence of nonlinear structure in the models. Previous works usually ignore the special structure of nonlinear regression models, in which the parameters can be partitioned into a linear part and a nonlinear part. In this paper, we develop an efficient recursive algorithm for nonlinear regression models based on analyzing the equivalent form of variable projection (VP) algorithm. By introducing the embedded point iteration (EPI) step, the proposed recursive algorithm can properly exploit the coupling relationship of linear parameters and nonlinear parameters. In addition, we theoretically prove that the proposed algorithm is mean-square bounded. Numerical experiments on synthetic data and real-world time series verify the high efficiency and robustness of the proposed algorithm.


title: Exploration of Parameter Spaces Assisted by Machine Learning

abstract: We demonstrate two sampling procedures assisted by machine learning models via regression and classification. The main objective is the use of a neural network to suggest points likely inside regions of interest, reducing the number of evaluations of time consuming calculations. We compare results from this approach with results from other sampling methods, namely Markov chain Monte Carlo and MultiNest, obtaining results that range from comparably similar to arguably better. In particular, we augment our classifier method with a boosting technique that rapidly increases the efficiency within a few iterations. We show results from our methods applied to a toy model and the type II 2HDM, using 3 and 7 free parameters, respectively. The code used for this paper and instructions are publicly available on the web.


title: Measuring and signing fairness as performance under multiple stakeholder distributions

abstract: As learning machines increase their influence on decisions concerning human lives, analyzing their fairness properties becomes a subject of central importance. Yet, our best tools for measuring the fairness of learning systems are rigid fairness metrics encapsulated as mathematical one-liners, offer limited power to the stakeholders involved in the prediction task, and are easy to manipulate when we exhort excessive pressure to optimize them. To advance these issues, we propose to shift focus from shaping fairness metrics to curating the distributions of examples under which these are computed. In particular, we posit that every claim about fairness should be immediately followed by the tagline "Fair under what examples, and collected by whom?". By highlighting connections to the literature in domain generalization, we propose to measure fairness as the ability of the system to generalize under multiple stress tests -- distributions of examples with social relevance. We encourage each stakeholder to curate one or multiple stress tests containing examples reflecting their (possibly conflicting) interests. The machine passes or fails each stress test by falling short of or exceeding a pre-defined metric value. The test results involve all stakeholders in a discussion about how to improve the learning system, and provide flexible assessments of fairness dependent on context and based on interpretable data. We provide full implementation guidelines for stress testing, illustrate both the benefits and shortcomings of this framework, and introduce a cryptographic scheme to enable a degree of prediction accountability from system providers.


title: Quasi-normal modes for the D3-branes and Exact WKB analysis

abstract: We demonstrate how the Exact WKB analysis works in the study of the quasi-normal modes (QNMs). We apply the Exact WKB analysis to a massless scalar perturbation to the D3-brane metric as a concrete example. The Exact WKB analysis provides an exact condition for the QNMs. We numerically check our exact condition by using the Borel-Pad\'{e} approximation. We also present an analytic form and an asymptotic behavior of the QNMs.


title: PPAD-Complete Pure Approximate Nash Equilibria in Lipschitz Games

abstract: Lipschitz games, in which there is a limit $\lambda$ (the Lipschitz value of the game) on how much a player's payoffs may change when some other player deviates, were introduced about 10 years ago by Azrieli and Shmaya. They showed via the probabilistic method that $n$-player Lipschitz games with $m$ strategies per player have pure $\epsilon$-approximate Nash equilibria, for $\epsilon\geq\lambda\sqrt{8n\log(2mn)}$. Here we provide the first hardness result for the corresponding computational problem, showing that even for a simple class of Lipschitz games (Lipschitz polymatrix games), finding pure $\epsilon$-approximate equilibria is PPAD-complete, for suitable pairs of values $(\epsilon(n), \lambda(n))$. Novel features of this result include both the proof of PPAD hardness (in which we apply a population game reduction from unrestricted polymatrix games) and the proof of containment in PPAD (by derandomizing the selection of a pure equilibrium from a mixed one). In fact, our approach implies containment in PPAD for any class of Lipschitz games where payoffs from mixed-strategy profiles can be deterministically computed.


title: Rethinking Few-Shot Class-Incremental Learning with Open-Set Hypothesis in Hyperbolic Geometry

abstract: Few-Shot Class-Incremental Learning (FSCIL) aims at incrementally learning novel classes from a few labeled samples by avoiding the overfitting and catastrophic forgetting simultaneously. The current protocol of FSCIL is built by mimicking the general class-incremental learning setting, while it is not totally appropriate due to the different data configuration, i.e., novel classes are all in the limited data regime. In this paper, we rethink the configuration of FSCIL with the open-set hypothesis by reserving the possibility in the first session for incoming categories. To assign better performances on both close-set and open-set recognition to the model, Hyperbolic Reciprocal Point Learning module (Hyper-RPL) is built on Reciprocal Point Learning (RPL) with hyperbolic neural networks. Besides, for learning novel categories from limited labeled data, we incorporate a hyperbolic metric learning (Hyper-Metric) module into the distillation-based framework to alleviate the overfitting issue and better handle the trade-off issue between the preservation of old knowledge and the acquisition of new knowledge. The comprehensive assessments of the proposed configuration and modules on three benchmark datasets are executed to validate the effectiveness concerning three evaluation indicators.


title: On a Generalized Framework for Time-Aware Knowledge Graphs

abstract: Knowledge graphs have emerged as an effective tool for managing and standardizing semistructured domain knowledge in a human- and machine-interpretable way. In terms of graph-based domain applications, such as embeddings and graph neural networks, current research is increasingly taking into account the time-related evolution of the information encoded within a graph. Algorithms and models for stationary and static knowledge graphs are extended to make them accessible for time-aware domains, where time-awareness can be interpreted in different ways. In particular, a distinction needs to be made between the validity period and the traceability of facts as objectives of time-related knowledge graph extensions. In this context, terms and definitions such as dynamic and temporal are often used inconsistently or interchangeably in the literature. Therefore, with this paper we aim to provide a short but well-defined overview of time-aware knowledge graph extensions and thus faciliate future research in this field as well.


title: M2-Net: Multi-stages Specular Highlight Detection and Removal in Multi-scenes

abstract: In this paper, we propose a novel uniformity framework for highlight detection and removal in multi-scenes, including synthetic images, face images, natural images, and text images. The framework consists of three main components, highlight feature extractor module, highlight coarse removal module, and highlight refine removal module. Firstly, the highlight feature extractor module can directly separate the highlight feature and non-highlight feature from the original highlight image. Then highlight removal image is obtained using a coarse highlight removal network. To further improve the highlight removal effect, the refined highlight removal image is finally obtained using refine highlight removal module based on contextual highlight attention mechanisms. Extensive experimental results in multiple scenes indicate that the proposed framework can obtain excellent visual effects of highlight removal and achieve state-of-the-art results in several quantitative evaluation metrics. Our algorithm is applied for the first time in video highlight removal with promising results.


title: Temporal and cross-modal attention for audio-visual zero-shot learning

abstract: Audio-visual generalised zero-shot learning for video classification requires understanding the relations between the audio and visual information in order to be able to recognise samples from novel, previously unseen classes at test time. The natural semantic and temporal alignment between audio and visual data in video data can be exploited to learn powerful representations that generalise to unseen classes at test time. We propose a multi-modal and Temporal Cross-attention Framework (\modelName) for audio-visual generalised zero-shot learning. Its inputs are temporally aligned audio and visual features that are obtained from pre-trained networks. Encouraging the framework to focus on cross-modal correspondence across time instead of self-attention within the modalities boosts the performance significantly. We show that our proposed framework that ingests temporal features yields state-of-the-art performance on the \ucf, \vgg, and \activity benchmarks for (generalised) zero-shot learning. Code for reproducing all results is available at \url{https://github.com/ExplainableML/TCAF-GZSL}.


title: Dark Matter as an effect of a minimal length

abstract: In this work, we consider the implications of a phenomenological model of quantum gravitational effects related to a minimal length, implemented via the Generalized Uncertainty Principle. Such effects are applied to the Bekenstein-Hawking entropy to derive a modified law of gravity through Verlinde's conjecture. Implications on galactic scales, and in particular on the shape of rotational curves, are investigated, exploring the possibility to mimic dark matter-like effects via a minimal length.


title: Primordial black holes from an inflationary potential valley

abstract: Primordial black holes (PBHs) could be formed if large perturbations are generated on small scales in inflation. We study a toy inflation model with a local minimum. The curvature perturbations are enhanced when the inflaton passes through the local minimum, with more efficient amplification rate than that of quasi-inflection point inflation, leading to the production of PBHs on small scales. The PBHs could comprise the total dark matter in the mass window $10^{16}$--$10^{20}$g.


title: A Unified Approach to Evaluation and Routing in Public Transport Systems

abstract: Both evaluating the service quality of a public transport system and understanding how passengers choose between modes or routes is imperative for public transport operators, providers of competing mobility services and policy makers. However, the literature does not offer consensus on how either of these tasks should be performed, which can lead to inconsistent or counter-intuitive results. This paper provides a formal treatment on how common manifestations of public transport (route sets, timetables and line plans) can be evaluated consistently, and how passengers distribute over routes. Our main insight is that evaluation and routing are two sides of the same coin: by solving an appropriate optimization model one obtains both the quality of the route set, timetable or line plan (the optimal objective value), and the distribution of the travelers over the routes (the optimal solution itself). We further demonstrate that the framework developed in this paper enables planners to (i) improve service by taking better decisions and (ii) assess to what degree of accuracy traveler behavior should be modeled on their network, potentially avoiding investing in complicated methods that may not be necessary.


title: Modelling bubble collapse anisotropy in complex geometries

abstract: A gas or vapor bubble collapsing in the vicinity of a rigid boundary displaces towards the boundary and produces a high-speed jet directed at the boundary. This behavior has been shown to be a function of the 'anisotropy' of the collapse, measured by a dimensionless representation of the Kelvin impulse known as the anisotropy parameter [Supponen et al., J. Fluid Mech. 802, 263-293 (2016)]. However, characterisation of the anisotropy parameter in different geometries has been limited to simplified analytic solutions. In this work we develop an inexpensive numerical model, based on the Boundary Element Method, capable of predicting the anisotropy parameter for any rigid complex geometry. We experimentally explore a robust measure of bubble displacement, showing that the bubble displacement in a range of complex geometries behaves as a single function of the predicted anisotropy parameter values.


title: NeuralNEB -- Neural Networks can find Reaction Paths Fast

abstract: Quantum mechanical methods like Density Functional Theory (DFT) are used with great success alongside efficient search algorithms for studying kinetics of reactive systems. However, DFT is prohibitively expensive for large scale exploration. Machine Learning (ML) models have turned out to be excellent emulators of small molecule DFT calculations and could possibly replace DFT in such tasks. For kinetics, success relies primarily on the models capability to accurately predict the Potential Energy Surface (PES) around transition-states and Minimal Energy Paths (MEPs). Previously this has not been possible due to scarcity of relevant data in the literature. In this paper we train state of the art equivariant Graph Neural Network (GNN)-based models on around 10.000 elementary reactions from the Transition1x dataset. We apply the models as potentials for the Nudged Elastic Band (NEB) algorithm and achieve a Mean Average Error (MAE) of 0.13+/-0.03 eV on barrier energies on unseen reactions. We compare the results against equivalent models trained on QM9 and ANI1x. We also compare with and outperform Density Functional based Tight Binding (DFTB) on both accuracy and computational resource. The implication is that ML models, given relevant data, are now at a level where they can be applied for downstream tasks in quantum chemistry transcending prediction of simple molecular features.


title: Improved mixing for the convex polygon triangulation flip walk

abstract: We prove that the well-studied triangulation flip walk on a convex point set mixes in time O(n^3 log^3 n), the first progress since McShine and Tetali's O(n^5 log n) bound in 1997. In the process we give lower and upper bounds of respectively Omega(1/(sqrt n log n)) and O(1/sqrt n) -- asymptotically tight up to an O(log n) factor -- for the expansion of the associahedron graph K_n. The upper bound recovers Molloy, Reed, and Steiger's Omega(n^{3/2}) bound on the mixing time of the walk. To obtain these results, we introduce a framework consisting of a set of sufficient conditions under which a given Markov chain mixes rapidly. This framework is a purely combinatorial analogue that in some circumstances gives better results than the projection-restriction technique of Jerrum, Son, Tetali, and Vigoda. In particular, in addition to the result for triangulations, we show quasipolynomial mixing for the k-angulation flip walk on a convex point set, for fixed k >= 4.


title: Causal nonseparability and its implications for spatiotemporal relations

abstract: Quantum nonseparability is a central feature of quantum mechanics, and raises important philosophical questions. Interestingly, a particular theoretical development of quantum mechanics, called the process matrix formalism (PMF), features another kind of nonseparability, called causal nonseparability. The PMF appeals to the notion of quantum process, which is a generalisation of the concept of quantum state allowing to represent quantum-like correlations between quantum events over multiple parties without specifying a priori their spatiotemporal locations. Crucially, since the PMF makes no assumption about the global causal structure between quantum events, it allows for the existence of causally nonseparable quantum processes having an indefinite causal structure. This work aims at investigating the philosophical implications of causal nonseparability, especially for the notion of spatiotemporal relations. A preliminary discussion will study the formal connection between quantum and causal nonseparability. It will be emphasised that, although quantum processes can be seen as a generalisation of density matrices, the conceptual distinction between the two notions yields significant differences between quantum and causal nonseparability. From there, it will be shown that, depending on the interpretative framework, causal nonseparability suggests some kind of indeterminacy of spatiotemporal relations. Namely, within a realist context, spatiotemporal relations can be epistemically or metaphysically indeterminate. Finally, it will be argued that, in spite of the disanalogies between standard and causal nonseparability, similar implications for spatial relations can already be defended in the context of standard quantum mechanics. This work highlights the potentially very fruitful explorations of the implications of quantum features on the conception of spacetime.


title: Cooling flow regime of a plasma thermal quench

abstract: A large class of Laboratory, Space, and Astrophysical plasmas is nearly collisionless. When a localized energy or particle sink, for example, in the form of a radiative cooling spot or a black hole, is introduced into such a plasma, it can trigger a plasma thermal collapse, also known as a thermal quench in tokamak fusion. Here we show that the electron thermal conduction in such a nearly collisionless plasma follows the convective energy transport scaling in itself or in its spatial gradient, due to the constraint of ambipolar transport. As the result, a robust cooling flow aggregates mass toward the cooling spot and the thermal collapse of the surrounding plasma takes the form of four propagating fronts that originate from the radiative cooling spot, along the magnetic field line in a magnetized plasma. The slowest one, which is responsible for deep cooling, is a shock front.


title: Implementacion de un sistema IoT de bajo costo para el monitoreo de la calidad del aire en El Salvador

abstract: Environmental pollution is a factor that represents a significant health risk. In El Salvador, The entity in charge of monitoring air quality is the ministry of Environment and Natural Resources, currently said ministry only has 3 stations for monitoring air quality throughout the territory of the country. The main objective of this work was the application of internet of things techniques in the design and implementation of a station of remote particulate pollution monitoring in the surrounding air. As well as setting up an Internet of Things (IoT) platform for the deployment of the data collected by the remote station. The development methodology of this research was based on the Model of Reference Architecture for IoT systems, which has as based on the development of system prototypes based on the correct choice of components available and suitable for the specific environment or application. For this case, they were used as inputs for the electronic hardware and Esp32 controller together with a Wemos-Lolin development board together with a sensor of particulate matter contamination PMS5003; by the side of software for the IoT platform was implemented a storage system, graphics and website based on low-cost tools The main result obtained in this work was an IoT prototype of an electronic station that allows monitoring the levels of contamination by the material of particles in the environment, whose data are accessible from any device with internet access through a site web, another result of this work is the configuring an IoT platform or cloud to connect wireless with the electronic station, the storage of the data produced by it and a web visualization stage.


title: The circumstellar material around the Type IIP SN 2021yja

abstract: The majority of Type II-plateau supernovae (SNe IIP) have light curves that are not compatible with the explosions of stars in a vacuum; instead, the light curves require the progenitors to be embedded in circumstellar matter (CSM). We report on the successful fitting of the well-observed SN IIP 2021yja as a core-collapse explosion of a massive star with an initial mass of ~15 Msun and a pre-explosion radius of 631 Rsun. To explain the early-time behaviour of the broad-band light curves, the presence of 0.55 Msun CSM within ~2x10^14 cm is needed. Like many other SNe IIP, SN 2021yja exhibits an early-time flux excess including ultraviolet wavelengths. This, together with the short rise time (<2 days) in the gri bands, indicates the presence of a compact component in the CSM, essentially adjacent to the progenitor. We discuss the origin of the pre-existing CSM, which is most likely a common property of highly convective red supergiant envelopes. We argue that the difficulty in fitting the entire light curve with one spherical distribution indicates that the CSM around the SN 2021yja progenitor was asymmetric.


title: Improved renormalization scheme for nonlocal operators

abstract: In this paper we present an improved RI-type prescription appropriate for the non-perturbative renormalization of gauge invariant nonlocal operators. In this prescription, the non-perturbative vertex function is improved by subtracting unwanted finite lattice spacing ($a$) effects, calculated in lattice perturbation theory. The method is versatile and can be applied to a wide range of fermion and gluon actions, as well as types of nonlocal operators. The presence of operator mixing can also be accommodated. Compared to the standard RI' prescription, this variant can be recast as a supplementary finite renormalization, whose coefficients bring about corrections of higher order in $a$; consequently, it coincides with standard RI' as $a\to 0$, however it can afford us a smoother and more controlled extrapolation to the continuum limit. In this proof-of-concept calculation we focus on nonlocal fermion bilinear operators containing a straight Wilson line. In the numerical implementation we use Wilson/clover fermions and Iwasaki improved gluons. The finite-$a$ terms were calculated to one-loop level in lattice perturbation theory, and to all orders in $a$, using the same action as the non-perturbative vertex functions. We find that the method leads to significant improvement in the perturbative region indicated by small and intermediate values of the length of the Wilson line. This results in a robust extraction of the renormalization functions in that region. We have also applied the above method to operators with stout-smeared links. We show how to perform the perturbative correction for any number of smearing iterations, and evaluate its effect on the power divergent renormalization coefficients.


title: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds

abstract: We introduce a method for instance proposal generation for 3D point clouds. Existing techniques typically directly regress proposals in a single feed-forward step, leading to inaccurate estimation. We show that this serves as a critical bottleneck, and propose a method based on iterative bilateral filtering with learned kernels. Following the spirit of bilateral filtering, we consider both the deep feature embeddings of each point, as well as their locations in the 3D space. We show via synthetic experiments that our method brings drastic improvements when generating instance proposals for a given point of interest. We further validate our method on the challenging ScanNet benchmark, achieving the best instance segmentation performance amongst the sub-category of top-down methods.


title: Search for a New B-L Z' Gauge Boson with the NA64 Experiment at CERN

abstract: A search for a new $Z'$ gauge boson associated with (un)broken B-L symmetry in the keV-GeV mass range is carried out for the first time using the missing-energy technique in the NA64 experiment at the CERN SPS. From the analysis of the data with 3.22e11 electrons on target collected during 2016-2021 runs no signal events were found. This allows to derive new constraints on the $Z'-e$ coupling strength, which for the mass range $0.3 < m_{Z'} < 100$ MeV are more stringent compared to those obtained from the neutrino-electron scattering data.


title: ReFactor GNNs: Revisiting Factorisation-based Models from a Message-Passing Perspective

abstract: Factorisation-based Models (FMs), such as DistMult, have enjoyed enduring success for Knowledge Graph Completion (KGC) tasks, often outperforming Graph Neural Networks (GNNs). However, unlike GNNs, FMs struggle to incorporate node features and generalise to unseen nodes in inductive settings. Our work bridges the gap between FMs and GNNs by proposing ReFactor GNNs. This new architecture draws upon both modelling paradigms, which previously were largely thought of as disjoint. Concretely, using a message-passing formalism, we show how FMs can be cast as GNNs by reformulating the gradient descent procedure as message-passing operations, which forms the basis of our ReFactor GNNs. Across a multitude of well-established KGC benchmarks, our ReFactor GNNs achieve comparable transductive performance to FMs, and state-of-the-art inductive performance while using an order of magnitude fewer parameters.


title: Synchronizing the helicity of Rayleigh-B\'enard convection by a tide-like electromagnetic forcing

abstract: We present results on the synchronization of the helicity in a liquid-metal Rayleigh-B\'enard (RB) experiment under the influence of a tide-like electromagnetic forcing with azimuthal wavenumber m=2. We show that for a critical forcing strength the typical Large Scale Circulation (LSC) in the cylindrical vessel of aspect ratio unity is entrained by the period of the tide-like forcing, leading to synchronized helicity oscillations with opposite signs in two half-spaces. The obtained experimental results are consistent with and supported by numerical simulations. A similar entrainment mechanism for the helicity in the solar tachocline may be responsible for the astonishing synchronization of the solar dynamo by the 11.07-year triple synodic alignment cycle of the tidally dominant planets Venus, Earth and Jupiter.


title: Global sensitivity analysis for studies extending inferences from a randomized trial to a target population

abstract: When individuals participating in a randomized trial differ with respect to the distribution of effect modifiers compared compared with the target population where the trial results will be used, treatment effect estimates from the trial may not directly apply to target population. Methods for extending -- generalizing or transporting -- causal inferences from the trial to the target population rely on conditional exchangeability assumptions between randomized and non-randomized individuals. The validity of these assumptions is often uncertain or controversial and investigators need to examine how violation of the assumptions would impact study conclusions. We describe methods for global sensitivity analysis that directly parameterize violations of the assumptions in terms of potential (counterfactual) outcome distributions. Our approach does not require detailed knowledge about the distribution of specific unmeasured effect modifiers or their relationship with the observed variables. We illustrate the methods using data from a trial nested within a cohort of trial-eligible individuals to compare coronary artery surgery plus medical therapy versus medical therapy alone for stable ischemic heart disease.


title: Diffsound: Discrete Diffusion Model for Text-to-sound Generation

abstract: Generating sound effects that humans want is an important topic. However, there are few studies in this area for sound generation. In this study, we investigate generating sound conditioned on a text prompt and propose a novel text-to-sound generation framework that consists of a text encoder, a Vector Quantized Variational Autoencoder (VQ-VAE), a decoder, and a vocoder. The framework first uses the decoder to transfer the text features extracted from the text encoder to a mel-spectrogram with the help of VQ-VAE, and then the vocoder is used to transform the generated mel-spectrogram into a waveform. We found that the decoder significantly influences the generation performance. Thus, we focus on designing a good decoder in this study. We begin with the traditional autoregressive decoder, which has been proved as a state-of-the-art method in previous sound generation works. However, the AR decoder always predicts the mel-spectrogram tokens one by one in order, which introduces the unidirectional bias and accumulation of errors problems. Moreover, with the AR decoder, the sound generation time increases linearly with the sound duration. To overcome the shortcomings introduced by AR decoders, we propose a non-autoregressive decoder based on the discrete diffusion model, named Diffsound. Specifically, the Diffsound predicts all of the mel-spectrogram tokens in one step and then refines the predicted tokens in the next step, so the best-predicted results can be obtained after several steps. Our experiments show that our proposed Diffsound not only produces better text-to-sound generation results when compared with the AR decoder but also has a faster generation speed, e.g., MOS: 3.56 \textit{v.s} 2.786, and the generation speed is five times faster than the AR decoder.


title: Adiabatic based Algorithm for SAT: a comprehensive algorithmic description

abstract: This paper concerns quantum heuristics able to extend the domain of quantum computing, defining a promising way in the large number of well-known classical algorithms. Quantum approximate heuristics take advantage of alternation between a Hamiltonian defining the problem to solve and a mixing Hamiltonian. The adiabatic theorem initially defined in quantum physic allows to compute a solution for the Schr\"odinger equation, but the foundation of this methods requires strong skill in physics and mathematics. Our main objectives in this paper are at first to provide an algorithm-based presentation (as close as possible of the classical computer science community in operational research practice) of the adiabatic optimization and secondly to give a comprehensive resolution of the well-known SAT problem. This gives opportunities to provide a concise but explicit analysis of the adiabatic capability to define a new efficient operational research trend. Our experiments encompass numerical evaluations on both simulator and on real quantum computer provided by IBM. Numerical experiments on simulator have been achieved on both Qiskit and MyQLM.


title: Searching for giant planets in the outer Solar System with far-infrared all-sky surveys

abstract: We have explored a method for finding giant planets in the outer Solar System by detecting their thermal emission and proper motion between two far-infrared all-sky surveys separated by 23.4 years, taken with the InfraRed Astronomical Satellite (IRAS) and the AKARI Space Telescope. An upper distance limit of about 8,000 AU is given by both the sensitivities of these surveys and the distance at which proper motion becomes too small to be detected. This paper covers the region from 8,000 AU to 700 AU. We have used a series of filtering and SED-fitting algorithms to find candidate pairs, whose IRAS and AKARI flux measurements could together plausibly be fitted by a Planck thermal distribution for a likely planetary temperature. Theoretical studies have placed various constraints on the likely existence of unknown planets in the outer solar system. The main observational constraint to date comes from a WISE study: an upper limit on an unknown planet's mass out into the Oort cloud. Our work confirms this result for our distance range, and provides additional observational constraints for lower distances and planetary masses, subject to the proviso that the planet is not confused with Galactic cirrus. We found 535 potential candidates with reasonable spectral energy distribution (SED) fits. Most would have masses close to or below that of Neptune (~0.05 Jupiter mass), and be located below 1,000 AU. However, examination of the infrared images of these candidates suggests that none is sufficiently compelling to warrant follow-up, since all are located inside or close to cirrus clouds, which are most likely the source of the far-infrared flux.


title: Sub-exponential stability for the Beam equation

abstract: We consider a one-parameter family of beam equations with Hamiltonian non-linearity in one space dimension under periodic boundary conditions. In a unified functional framework we study the long time evolution of initial data in two categories of differentiability: (i) a subspace of Sobolev regularity, (ii) a subspace of infinitely many differentiable functions which is strictly contained in the Sobolev space but which strictly contains the Gevrey one. In both cases we prove exponential type times of stability. The result holds for almost all mass parameters and it is obtained by combining normal form techniques with a suitable Diophantine condition weaker than the one proposed by Bourgain. This is the first result of this kind in Sobolev regularity for a degenerate equation, where only one parameter is used to tune the linear frequencies of oscillations.


title: Iterated function systems of affine expanding and contracting maps on the unit interval

abstract: We analyze the two-point motions of iterated function systems on the unit interval generated by expanding and contracting affine maps, where the expansion and contraction rates are determined by a pair $(M,N)$ of integers. This dynamics depends on the Lyapunov exponent. For a negative Lyapunov exponent we establish synchronization, meaning convergence of orbits with different initial points. For a vanishing Lyapunov exponent we establish intermittency, where orbits are close for a set of iterates of full density, but are intermittently apart. For a positive Lyapunov exponent we show the existence of an absolutely continuous stationary measure for the two-point dynamics and discuss its consequences. For nonnegative Lyapunov exponent and pairs $(M,N)$ that are multiplicatively dependent integers, we provide explicit expressions for absolutely continuous stationary measures of the two-point motions. These stationary measures are infinite $\sigma$-finite measures in the case of zero Lyapunov exponent. For varying Lyapunov exponent we find here a phase transition for the system of two-point motions, in which the support of the stationary measure explodes with intermittent dynamics and an infinite stationary measure at the transition point.


title: DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentation

abstract: Unsupervised domain adaptation in semantic segmentation has been raised to alleviate the reliance on expensive pixel-wise annotations. It leverages a labeled source domain dataset as well as unlabeled target domain images to learn a segmentation network. In this paper, we observe two main issues of the existing domain-invariant learning framework. (1) Being distracted by the feature distribution alignment, the network cannot focus on the segmentation task. (2) Fitting source domain data well would compromise the target domain performance. To address these issues, we propose DecoupleNet that alleviates source domain overfitting and enables the final model to focus more on the segmentation task. Furthermore, we put forward Self-Discrimination (SD) and introduce an auxiliary classifier to learn more discriminative target domain features with pseudo labels. Finally, we propose Online Enhanced Self-Training (OEST) to contextually enhance the quality of pseudo labels in an online manner. Experiments show our method outperforms existing state-of-the-art methods, and extensive ablation studies verify the effectiveness of each component. Code is available at https://github.com/dvlab-research/DecoupleNet.


title: The Regularised Inertial Dean-Kawasaki equation: discontinuous Galerkin approximation and modelling for low-density regime

abstract: The Regularised Inertial Dean-Kawasaki model (RIDK) -- introduced by the authors and J. Zimmer in earlier works -- is a nonlinear stochastic PDE capturing fluctuations around the mean-field limit for large-scale particle systems in both particle density and momentum density. We focus on the following two aspects. Firstly, we set up a Discontinuous Galerkin (DG) discretisation scheme for the RIDK model: we provide suitable definitions of numerical fluxes at the interface of the mesh elements which are consistent with the wave-type nature of the RIDK model and grant stability of the simulations, and we quantify the rate of convergence in mean square to the continuous RIDK model. Secondly, we introduce modifications of the RIDK model in order to preserve positivity of the density (such a feature only holds in a ''high-probability sense'' for the original RIDK model). By means of numerical simulations, we show that the modifications lead to physically realistic and positive density profiles. In one case, subject to additional regularity constraints, we also prove positivity. Finally, we present an application of our methodology to a system of diffusing and reacting particles. Our Python code is available in open-source format.


title: Entanglement Verification of Hyperentangled Photon Pairs

abstract: We experimentally investigate the properties of hyperentangled states displaying simultaneous entanglement in multiple degrees of freedom, and find that Bell tests beyond the standard Clauser, Horne, Shimony, Holt inequality can reveal a higher-dimensional nature in a device-independent way. Specifically, we show that hyperentangled states possess more than just simultaneous entanglement in separate degrees of freedom but also entanglement in a higher dimensional Hilbert space. We also verify the steerability of hyperentangled quantum states by steering different photonic degrees of freedom.


title: Causal Models, Prediction, and Extrapolation in Cell Line Perturbation Experiments

abstract: In cell line perturbation experiments, a collection of cells is perturbed with external agents (e.g. drugs) and responses such as protein expression measured. Due to cost constraints, only a small fraction of all possible perturbations can be tested in vitro. This has led to the development of computational (in silico) models which can predict cellular responses to perturbations. Perturbations with clinically interesting predicted responses can be prioritized for in vitro testing. In this work, we compare causal and non-causal regression models for perturbation response prediction in a Melanoma cancer cell line. The current best performing method on this data set is Cellbox which models how proteins causally effect each other using a system of ordinary differential equations (ODEs). We derive a closed form solution to the Cellbox system of ODEs in the linear case. These analytic results facilitate comparison of Cellbox to regression approaches. We show that causal models such as Cellbox, while requiring more assumptions, enable extrapolation in ways that non-causal regression models cannot. For example, causal models can predict responses for never before tested drugs. We illustrate these strengths and weaknesses in simulations. In an application to the Melanoma cell line data, we find that regression models outperform the Cellbox causal model.


title: Complexity emerges in measures of the marking dynamics in football games

abstract: In this article, we study the dynamics of marking in football matches. To do this, we surveyed and analyzed a database containing the trajectories of players from both teams on the field of play during three professional games. We describe the dynamics through the construction of temporal bipartite networks of proximity. Based on the introduced concept of proximity, the nodes are the players, and the links are defined between opponents that are close enough to each other at a given moment. By studying the evolution of the heterogeneity parameter of the networks during the game, we characterized a scaling law for the average shape of the fluctuations, unveiling the emergence of complexity in the system. Moreover, we proposed a simple model to simulate the players' motion in the field from where we obtained the evolution of a synthetic proximity network. We show that the model captures with a remarkable agreement the complexity of the empirical case, hence it proves to be helpful to elucidate the underlying mechanisms responsible for the observed phenomena.


title: Computing Tree Decompositions with Small Independence Number

abstract: The independence number of a tree decomposition is the maximum of the independence numbers of the subgraphs induced by its bags. The tree-independence number of a graph is the minimum independence number of a tree decomposition of it. Several NP-hard graph problems, like maximum weight independent set, can be solved in time n^{O(k)} if the input n-vertex graph is given together with a tree decomposition of independence number k. Yolov, in [SODA 2018], gave an algorithm that, given an n-vertex graph G and an integer k, in time n^{O(k^3)} either constructs a tree decomposition of G whose independence number is O(k^3) or correctly reports that the tree-independence number of G is larger than k. In this paper, we first give an algorithm for computing the tree-independence number with a better approximation ratio and running time and then prove that our algorithm is, in some sense, the best one can hope for. More precisely, our algorithm runs in time 2^{O(k^2)} n^{O(k)} and either outputs a tree decomposition of G with independence number at most $8k$, or determines that the tree-independence number of G is larger than k. This implies 2^{O(k^2)} n^{O(k)}-time algorithms for various problems, like maximum weight independent set, parameterized by the tree-independence number k without needing the decomposition as an input. Assuming Gap-ETH, an n^{\Omega(k)} factor in the running time is unavoidable for any approximation algorithm for the tree-independence number. Our second result is that the exact computation of the tree-independence number is para-NP-hard: We show that for every constant k \ge 4 it is NP-hard to decide if a given graph has the tree-independence number at most k.


title: Simulating large-size quantum spin chains on cloud-based superconducting quantum computers

abstract: Quantum computers have the potential to efficiently simulate large-scale quantum systems for which classical approaches are bound to fail. Even though several existing quantum devices now feature total qubit numbers of more than one hundred, their applicability remains plagued by the presence of noise and errors. Thus, the degree to which large quantum systems can successfully be simulated on these devices remains unclear. Here, we report on cloud simulations performed on several of IBM's superconducting quantum computers to simulate ground states of spin chains having a wide range of system sizes up to one hundred and two qubits. We find that the ground-state energies extracted from realizations across different quantum computers and system sizes reach the expected values to within errors that are small (i.e. on the percent level), including the inference of the energy density in the thermodynamic limit from these values. We achieve this accuracy through a combination of physics-motivated variational Ansatzes, and efficient, scalable energy-measurement and error-mitigation protocols, including the use of a reference state in the zero-noise extrapolation. By using a 102-qubit system, we have been able to successfully apply up to 3186 CNOT gates in a single circuit when performing gate-error mitigation. Our accurate, error-mitigated results for random parameters in the Ansatz states suggest that a standalone hybrid quantum-classical variational approach for large-scale XXZ models is feasible.


title: Euclid: Testing the Copernican principle with next-generation surveys

abstract: The Copernican principle, the notion that we are not at a special location in the Universe, is one of the cornerstones of modern cosmology and its violation would invalidate the Friedmann-Lema\^{\i}tre-Robertson-Walker (FLRW) metric, causing a major change in our understanding of the Universe. Thus, it is of fundamental importance to perform observational tests of this principle. We determine the precision with which future surveys will be able to test the Copernican principle and their ability to detect any possible violations. We forecast constraints on the inhomogeneous Lema\^{\i}tre-Tolman-Bondi model with a cosmological constant $\Lambda$ ($\Lambda$LTB), basically a cosmological constant $\Lambda$ and cold dark matter ($\Lambda$CDM) model, but endowed with a spherical inhomogeneity. We consider combinations of currently available data and simulated Euclid data, together with external data products, based on both $\Lambda$CDM and $\Lambda$LTB fiducial models. These constraints are compared to the expectations from the Copernican principle. When considering the $\Lambda$CDM fiducial model, we find that Euclid data, in combination with other current and forthcoming surveys, will improve the constraints on the Copernican principle by about $30\%$, with $\pm10\%$ variations depending on the observables and scales considered. On the other hand, when considering a $\Lambda$LTB fiducial model, we find that future Euclid data, combined with other current and forthcoming data sets, will be able to detect Gpc-scale inhomogeneities of contrast $-0.1$. Next-generation surveys, such as Euclid, will thoroughly test homogeneity at large scales, tightening the constraints on possible violations of the Copernican principle.


title: Phenomenon-Signal Model: Formalisation, Graph and Application

abstract: Considering information as the basis of action, it may be of interest to examine the flow and acquisition of information between the actors in traffic. The central question is: Which signals does an automated driving system (which will be referred to as an automaton in the remainder of this paper) in traffic have to receive, decode or send in road traffic in order to act safely and in a manner that is compliant with valid standards. The phenomenon-signal model (PSM) is a method for structuring the problem area and for analysing and describing this very signal flow. The aim of this paper is to explain the basics, the structure and the application of this method.


title: Some identities on degenerate r-stirling numbers via boson operators

abstract: Broder introduced the r-Stirling numbers of the first kind and of the second kind which enumerate restricted permutations and respectively restricted partitions, the restriction being that the first r elements must be in distinct cycles and respectively in distinct subsets. Kim-Kim-Lee-Park constructed the degenerate r-Stirling numbers of both kinds as degenerate versions of them. The aim of this paper is to derive some identities and recurrence relations for the degenerate r-Stirling numbers of the first kind and of the second kind via boson operators. In particular, we obtain the normal ordering of a degenerate integral power of the number operator multiplied by an integral power of the creation boson operator in terms of boson operators where the degenerate r-Stirling numbers of the second kind appear as the coefficients.


title: Short-Depth Circuits for Dicke State Preparation

abstract: We present short-depth circuits to deterministically prepare any Dicke state |Dn,k>, which is the equal-amplitude superposition of all n-qubit computational basis states with Hamming Weight k. Dicke states are an important class of entangled quantum states with a large variety of applications, and a long history of experimental creation in physical systems. On the other hand, not much is known regarding efficient scalable quantum circuits for Dicke state preparation on realistic quantum computing hardware connectivities. Here we present preparation circuits for Dicke states |Dn,k> with (i) a depth of O(k log(n/k)) for All-to-All connectivity (such as on current ion trap devices); (ii) a depth of O(k sqrt(n/k)) = O(sqrt(nk) for Grid connectivity on grids of size Omega(sqrt(n/s)) x O(sqrt(ns)) with s<=k (such as on current superconducting qubit devices). Both approaches have a total gate count of O(kn), need no ancilla qubits, and generalize to both the preparation and compression of symmetric pure states in which all non-zero amplitudes correspond to states with Hamming weight at most k. Thus our work significantly improves and expands previous state-of-the art circuits which had depth O(n) on a Linear Nearest Neighbor connectivity for arbitrary k (Fundamentals of Computation Theory 2019) and depth O(log n) on All-to-All connectivity for k=1 (Advanced Quantum Technologies 2019).


title: Digital Twin-based Intrusion Detection for Industrial Control Systems

abstract: Digital twins have recently gained significant interest in simulation, optimization, and predictive maintenance of Industrial Control Systems (ICS). Recent studies discuss the possibility of using digital twins for intrusion detection in industrial systems. Accordingly, this study contributes to a digital twin-based security framework for industrial control systems, extending its capabilities for simulation of attacks and defense mechanisms. Four types of process-aware attack scenarios are implemented on a standalone open-source digital twin of an industrial filling plant: command injection, network Denial of Service (DoS), calculated measurement modification, and naive measurement modification. A stacked ensemble classifier is proposed as the real-time intrusion detection, based on the offline evaluation of eight supervised machine learning algorithms. The designed stacked model outperforms previous methods in terms of F1-Score and accuracy, by combining the predictions of various algorithms, while it can detect and classify intrusions in near real-time (0.1 seconds). This study also discusses the practicality and benefits of the proposed digital twin-based security framework.


title: Lagrangian particle simulation of hydrogen pellets and SPI into runaway electron beam in ITER

abstract: Numerical studies of the ablation of pellets and shattered pellet injection (SPI) fragments into a runaway electron beam in ITER have been performed using a time-dependent pellet ablation code [R. Samulyak at el., Nucl Fusion, 61 (4), 046007 (2021)]. The code resolves detailed ablation physics near pellet fragments and large-scale expansion of ablated clouds. The study of a single fragment ablation quantifies the influence of various factors, in particular the impact ionization by runaway electrons and cross-field transport models, on the dynamics of ablated plasma and its penetration into the runaway beam. Simulations of SPI performed using different numbers of pellet fragments study the formation and evolution of ablation clouds and their large-scale dynamics in ITER. The penetration depth of ablation clouds is found to be of the order of 50 cm.


title: Search for merger ejecta emission from late time radio observations of short GRBs using GMRT

abstract: Short gamma-ray bursts (GRBs) are the aftermath of compact binary mergers involving neutron stars. If the merger remnant is a millisecond magnetar instead of a black hole, a significant proportion of the rotational energy deposited to the emerging ejecta can produce a late-time radio brightening from its interaction with the ambient medium. Detection of this late-time radio emission from short GRBs can have profound implications for understanding the physics of the progenitor. We report the radio observations of five short GRBs - 050709, 061210, 100625A, 140903A, and 160821B using the Giant Metrewave Radio Telescope (GMRT) at 1250, 610, and 325 MHz frequencies after $\sim$ $2 - 11$ years from the time of the burst. The GMRT observations at low frequencies are particularly important to detect the signature of merger ejecta emission at the peak. These observations are the most delayed searches associated with some of these GRBs for any late-time low-frequency emission. We find no evidence for such an emission. We find that none of these GRBs are consistent with maximally rotating magnetar with a rotational energy of $\sim 10^{53}\, {\rm ergs}$. However, magnetars with lower rotational energies cannot be completely ruled out. Despite the non detection, our study underscores the power of radio observations in the search for magnetar signatures associated with short GRBs. However, only future radio observatories may have the capabilities to either detect these signatures or put more stringent constraints on the model.


title: Overcoming Shortcut Learning in a Target Domain by Generalizing Basic Visual Factors from a Source Domain

abstract: Shortcut learning occurs when a deep neural network overly relies on spurious correlations in the training dataset in order to solve downstream tasks. Prior works have shown how this impairs the compositional generalization capability of deep learning models. To address this problem, we propose a novel approach to mitigate shortcut learning in uncontrolled target domains. Our approach extends the training set with an additional dataset (the source domain), which is specifically designed to facilitate learning independent representations of basic visual factors. We benchmark our idea on synthetic target domains where we explicitly control shortcut opportunities as well as real-world target domains. Furthermore, we analyze the effect of different specifications of the source domain and the network architecture on compositional generalization. Our main finding is that leveraging data from a source domain is an effective way to mitigate shortcut learning. By promoting independence across different factors of variation in the learned representations, networks can learn to consider only predictive factors and ignore potential shortcut factors during inference.


title: BYEL : Bootstrap Your Emotion Latent

abstract: With the improved performance of deep learning, the number of studies trying to apply deep learning to human emotion analysis is increasing rapidly. But even with this trend going on, it is still difficult to obtain high-quality images and annotations. For this reason, the Learning from Synthetic Data (LSD) Challenge, which learns from synthetic images and infers from real images, is one of the most interesting areas. In general, Domain Adaptation methods are widely used to address LSD challenges, but there is a limitation that target domains (real images) are still needed. Focusing on these limitations, we propose a framework Bootstrap Your Emotion Latent (BYEL), which uses only synthetic images in training. BYEL is implemented by adding Emotion Classifiers and Emotion Vector Subtraction to the BYOL framework that performs well in Self-Supervised Representation Learning. We train our framework using synthetic images generated from the Aff-wild2 dataset and evaluate it using real images from the Aff-wild2 dataset. The result shows that our framework (0.3084) performs 2.8% higher than the baseline (0.3) on the macro F1 score metric.


title: Hydrodynamic approach to two-dimensional electron systems

abstract: The last few years have seen an explosion of interest in hydrodynamic effects in interacting electron systems in ultra-pure materials. One such material, graphene, is not only an excellent platform for the experimental realization of the hydrodynamic flow of electrons, but also allows for a controlled derivation of the hydrodynamic equations on the basis of kinetic theory. The resulting hydrodynamic theory of electronic transport in graphene yields quantitative predictions for experimentally relevant quantities, e.g. viscosity, electrical conductivity, etc. Here I review recent theoretical advances in the field, compare the hydrodynamic theory of charge carriers in graphene with relativistic hydrodynamics and recent experiments, and discuss applications of hydrodynamic approach to novel materials beyond graphene.

categories: cond-mat.mes-hall cond-mat.stat-mech cond-mat.str-el physics.flu-dyn physics.plasm-ph