title: Hierarchically Modular Dynamical Neural Network Relaxing in a Warped Space: Basic Model and its Characteristics

abstract: We propose a hierarchically modular, dynamical neural network model whose architecture minimizes a specifically designed energy function and defines its temporal characteristics. The model has an internal and an external space that are connected with a layered internetwork that consists of a pair of forward and backward subnets composed of static neurons (with an instantaneous time-course). Dynamical neurons with large time constants in the internal space determine the overall time-course. The model offers a framework in which state variables in the network relax in a warped space, due to the cooperation between dynamic and static neurons. We assume that the system operates in either a learning or an association mode, depending on the presence or absence of feedback paths and input ports. In the learning mode, synaptic weights in the internetwork are modified by strong inputs corresponding to repetitive neuronal bursting, which represents sinusoidal or quasi-sinusoidal waves in the short-term average density of nerve impulses or in the membrane potential. A two-dimensional mapping relationship can be formed by employing signals with different frequencies based on the same mechanism as Lissajous curves. In the association mode, the speed of convergence to a goal point greatly varies with the mapping relationship of the previously trained internetwork, and owing to this property, the convergence trajectory in the two-dimensional model with the non-linear mapping internetwork cannot go straight but instead must curve. We further introduce a constrained association mode with a given target trajectory and elucidate that in the internal space, an output trajectory is generated, which is mapped from the external space according to the inverse of the mapping relationship of the forward subnet.


title: Quantum Euler angles and agency-dependent spacetime

abstract: Quantum gravity is expected to introduce quantum aspects into the description of reference frames. Here we set the stage for exploring how quantum gravity induced deformations of classical symmetries could modify the transformation laws among reference frames in an effective regime. We invoke the quantum group $SU_q(2)$ as a description of deformed spatial rotations and interpret states of a representation of its algebra as describing the relative orientation between two reference frames. This leads to a quantization of one of the Euler angles and to the new paradigm of agency-dependence: space is reconstructed as a collection of fuzzy points, exclusive to each agent, which depends on their choice of reference frame. Each agent can choose only one direction in which points can be sharp, while points in all other directions become fuzzy in a way that depends on this choice. Two agents making different choices will thus observe the same points with different degrees of fuzziness.


title: Enhancing Mobile Robot Navigation Safety and Efficiency through NMPC with Relaxed CBF in Dynamic Environments

abstract: In this paper, a safety-critical control strategy for a nonholonomic robot is developed to generate control signals that result in optimal, obstacle-free paths through dynamic environments. We formulate the control synthesis problem as an Optimal Control Problem (OCP) that enforces Control Lyapunov Function (CLF) constraints for system stability as well as safety-critical constraints using Control Barrier Function (CBF) with a relaxing decay rate of the barrier function. A Nonlinear Model Predictive Control (NMPC) integrates with CLF and CBF to ensure system safety and facilitate optimal performance within a short prediction horizon, reducing the computational burden in real-time implementation. Additionally, we incorporate an obstacle avoidance constraint based on the Euclidean norm into the NMPC framework, showcasing the CBF approach's superiority in addressing mobile robotic systems' point stabilisation and trajectory tracking challenges. Through extensive simulations, the proposed controller demonstrates proficiency in static and dynamic obstacle avoidance under various scenarios. Experimental validations conducted using the Husky A200 robot align with simulation results, reinforcing the applicability of our proposed approach in real-world scenarios, notably improving the computational efficiency and safety in practical mobile robot applications.


title: Data-Driven Offline Decision-Making via Invariant Representation Learning

abstract: The goal in offline data-driven decision-making is synthesize decisions that optimize a black-box utility function, using a previously-collected static dataset, with no active interaction. These problems appear in many forms: offline reinforcement learning (RL), where we must produce actions that optimize the long-term reward, bandits from logged data, where the goal is to determine the correct arm, and offline model-based optimization (MBO) problems, where we must find the optimal design provided access to only a static dataset. A key challenge in all these settings is distributional shift: when we optimize with respect to the input into a model trained from offline data, it is easy to produce an out-of-distribution (OOD) input that appears erroneously good. In contrast to prior approaches that utilize pessimism or conservatism to tackle this problem, in this paper, we formulate offline data-driven decision-making as domain adaptation, where the goal is to make accurate predictions for the value of optimized decisions ("target domain"), when training only on the dataset ("source domain"). This perspective leads to invariant objective models (IOM), our approach for addressing distributional shift by enforcing invariance between the learned representations of the training dataset and optimized decisions. In IOM, if the optimized decisions are too different from the training dataset, the representation will be forced to lose much of the information that distinguishes good designs from bad ones, making all choices seem mediocre. Critically, when the optimizer is aware of this representational tradeoff, it should choose not to stray too far from the training distribution, leading to a natural trade-off between distributional shift and learning performance.


title: Rooms with Text: A Dataset for Overlaying Text Detection

abstract: In this paper, we introduce a new dataset of room interior pictures with overlaying and scene text, totalling to 4836 annotated images in 25 product categories. We provide details on the collection and annotation process of our dataset, and analyze its statistics. Furthermore, we propose a baseline method for overlaying text detection, that leverages the character region-aware text detection framework to guide the classification model. We validate our approach and show its efficiency in terms of binary classification metrics, reaching the final performance of 0.95 F1 score, with false positive and false negative rates of 0.02 and 0.06 correspondingly.


title: Are All Combinations Equal? Combining Textual and Visual Features with Multiple Space Learning for Text-Based Video Retrieval

abstract: In this paper we tackle the cross-modal video retrieval problem and, more specifically, we focus on text-to-video retrieval. We investigate how to optimally combine multiple diverse textual and visual features into feature pairs that lead to generating multiple joint feature spaces, which encode text-video pairs into comparable representations. To learn these representations our proposed network architecture is trained by following a multiple space learning procedure. Moreover, at the retrieval stage, we introduce additional softmax operations for revising the inferred query-video similarities. Extensive experiments in several setups based on three large-scale datasets (IACC.3, V3C1, and MSR-VTT) lead to conclusions on how to best combine text-visual features and document the performance of the proposed network. Source code is made publicly available at: https://github.com/bmezaris/TextToVideoRetrieval-TtimesV


title: Brief Announcement: Broadcasting Time in Dynamic Rooted Trees is Linear

abstract: We study the broadcast problem on dynamic networks with $n$ processes. The processes communicate in synchronous rounds along an arbitrary rooted tree. The sequence of trees is given by an adversary whose goal is to maximize the number of rounds until at least one process reaches all other processes. Previous research has shown a $\lceil{\frac{3n-1}{2}}\rceil-2$ lower bound and an $O(n\log\log n)$ upper bound. We show the first linear upper bound for this problem, namely $\lceil{(1 + \sqrt 2) n-1}\rceil \approx 2.4n$. Our result follows from a detailed analysis of the evolution of the adjacency matrix of the network over time.


title: Generalized ILW hierarchy: Solutions and limit to extended lattice GD hierarchy

abstract: The intermediate long wave (ILW) hierarchy and its generalization, labelled by a positive integer $N$, can be formulated as reductions of the lattice KP hierarchy. The integrability of the lattice KP hierarchy is inherited by these reduced systems. In particular, all solutions can be captured by a factorization problem of difference operators. A special solution among them is obtained from Okounkov and Pandharipande's dressing operators for the equivariant Gromov-Witten theory of $\mathbb{CP}^1$. This indicates a hidden link with the equivariant Toda hierarchy. The generalized ILW hierarchy is also related to the lattice Gelfand-Dickey (GD) hierarchy and its extension by logarithmic flows. The logarithmic flows can be derived from the generalized ILW hierarchy by a scaling limit as a parameter of the system tends to $0$. This explains an origin of the logarithmic flows. A similar scaling limit of the equivariant Toda hierarchy yields the extended 1D/bigraded Toda hierarchy.


title: Object-level 3D Semantic Mapping using a Network of Smart Edge Sensors

abstract: Autonomous robots that interact with their environment require a detailed semantic scene model. For this, volumetric semantic maps are frequently used. The scene understanding can further be improved by including object-level information in the map. In this work, we extend a multi-view 3D semantic mapping system consisting of a network of distributed smart edge sensors with object-level information, to enable downstream tasks that need object-level input. Objects are represented in the map via their 3D mesh model or as an object-centric volumetric sub-map that can model arbitrary object geometry when no detailed 3D model is available. We propose a keypoint-based approach to estimate object poses via PnP and refinement via ICP alignment of the 3D object model with the observed point cloud segments. Object instances are tracked to integrate observations over time and to be robust against temporary occlusions. Our method is evaluated on the public Behave dataset where it shows pose estimation accuracy within a few centimeters and in real-world experiments with the sensor network in a challenging lab environment where multiple chairs and a table are tracked through the scene online, in real time even under high occlusions.


title: Blind Knowledge Distillation for Robust Image Classification

abstract: Optimizing neural networks with noisy labels is a challenging task, especially if the label set contains real-world noise. Networks tend to generalize to reasonable patterns in the early training stages and overfit to specific details of noisy samples in the latter ones. We introduce Blind Knowledge Distillation - a novel teacher-student approach for learning with noisy labels by masking the ground truth related teacher output to filter out potentially corrupted knowledge and to estimate the tipping point from generalizing to overfitting. Based on this, we enable the estimation of noise in the training data with Otsus algorithm. With this estimation, we train the network with a modified weighted cross-entropy loss function. We show in our experiments that Blind Knowledge Distillation detects overfitting effectively during training and improves the detection of clean and noisy labels on the recently published CIFAR-N dataset. Code is available at GitHub.


title: Black holes shielded by magnetic fields

abstract: Black holes (BHs) formed by collapsing and/or merging of magnetized progenitors, have magnetic fields penetrating the event horizon, and there are several possible scenarios. Thus, the no-hair theorem that assumes the outside medium is a vacuum, is not applicable in this case. Bearing this in mind and considering a Schwarzschild BH of mass $M$ immersed in a uniform magnetic field $B$, we show that all three frequencies related to the equatorial circular orbit of a test particle become imaginary for the orbits of radii $r_B > 2B^{-1}$. It signifies that if a BH is surrounded by a magnetic field of order $B \sim R_g^{-1}$ (where $R_g$ is the gravitational radius of the BH), a test particle could unable to continue its regular geodesic motion from/at $r > r_B$, hence the accretion disk could not be formed, and the motion of other stellar objects around the BH could be absent. As the BHs are generally detected by watching for their effects on nearby stars and gas, a magnetic field of order $B \sim R_g^{-1}$ could be able to shield a BH in such a way that it could remain undetectable. Motivated with this theoretical investigation and considering the sphere (of radius $r_f$) of magnetic influence around an astrophysical BH, we constrain $B$, above which a magnetized BH could remain undetectable. For example, $M=10^9M_{\odot}$ BH surrounded by $B > 10^6$ G and $M=10M_{\odot}$ BH surrounded by $B > 10^{14}$ G could remain undetectable for $r_f \sim 10^5R_g$. In other words, our result also explains why a detected SMBH has surprisingly weak magnetic field.


title: A Tale of Frozen Clouds: Quantifying the Impact of Algorithmic Complexity Vulnerabilities in Popular Web Servers

abstract: Algorithmic complexity vulnerabilities are a class of security problems that enables attackers to trigger the worst-case complexity of certain algorithms. Such vulnerabilities can be leveraged to deploy low-volume, asymmetric, CPU-based denial-of-service (DoS) attacks. Previous work speculates that these vulnerabilities are more dangerous in certain web servers, like Node.js, than in traditional ones, like Apache. We believe it is of utmost importance to understand if this is indeed the case or if there are ways to compensate against such problems using various deployment strategies. To this end, we study the resilience of popular web servers against CPU-based DoS attacks in four major cloud platforms under realistic deployment conditions. We find that there are indeed significant differences in how various web servers react to an attack. However, our results suggest a more nuanced landscape than previously believed: while event-based systems tend to recover faster from DoS in certain scenarios, they also suffer the worst performance degradation overall. Nevertheless, in some setups, Apache performs worse than event-based systems, and there are cloud platforms in which all the considered servers are seriously exposed to the attack. We also find that developers can harden their servers against CPU-based DoS attacks by increasing the number of server instances running in parallel. This, in turn, can lead to an increased cost of operation or a slight degradation of performance in non-DoS conditions.


title: An expedition to the islands of stability in the first-order causal hydrodynamics

abstract: The recently proposed connection between the Lorentz invariance of stability and the speed of signal propagation has been tested for a first-order relativistic dissipative hydrodynamic theory. The fact that the stability situation in different reference frames agrees with each other only as long as the signal propagation respects causality, has been explicitly established for the theory, which is microscopically derived from the covariant kinetic equation in general hydrodynamic frames with arbitrary momentum-dependent interactions.


title: Challenges and Applications of Automated Extraction of Socio-political Events from Text (CASE 2022): Workshop and Shared Task Report

abstract: We provide a summary of the fifth edition of the CASE workshop that is held in the scope of EMNLP 2022. The workshop consists of regular papers, two keynotes, working papers of shared task participants, and task overview papers. This workshop has been bringing together all aspects of event information collection across technical and social science fields. In addition to the progress in depth, the submission and acceptance of multimodal approaches show the widening of this interdisciplinary research topic.


title: Extended Multilingual Protest News Detection -- Shared Task 1, CASE 2021 and 2022

abstract: We report results of the CASE 2022 Shared Task 1 on Multilingual Protest Event Detection. This task is a continuation of CASE 2021 that consists of four subtasks that are i) document classification, ii) sentence classification, iii) event sentence coreference identification, and iv) event extraction. The CASE 2022 extension consists of expanding the test data with more data in previously available languages, namely, English, Hindi, Portuguese, and Spanish, and adding new test data in Mandarin, Turkish, and Urdu for Sub-task 1, document classification. The training data from CASE 2021 in English, Portuguese and Spanish were utilized. Therefore, predicting document labels in Hindi, Mandarin, Turkish, and Urdu occurs in a zero-shot setting. The CASE 2022 workshop accepts reports on systems developed for predicting test data of CASE 2021 as well. We observe that the best systems submitted by CASE 2022 participants achieve between 79.71 and 84.06 F1-macro for new languages in a zero-shot setting. The winning approaches are mainly ensembling models and merging data in multiple languages. The best two submissions on CASE 2021 data outperform submissions from last year for Subtask 1 and Subtask 2 in all languages. Only the following scenarios were not outperformed by new submissions on CASE 2021: Subtask 3 Portuguese \& Subtask 4 English.


title: Minimal Leptogenesis in Brane-inspired Cosmology

abstract: We discuss how a post inflationary reheating phase characterized by a nonstandard multiple scalar field cosmology can change the thermal history of the universe, affecting minimal high scale leptogenesis. In particular, we explore a class of models where a set of scalar fields in a brane-inspired dynamical scenario modifies the Boltzmann equations concerning standard leptogenesis. The produced lepton asymmetry, due to the decays of heavy Majorana right-handed neutrinos responsible for generating Standard Model neutrino masses via the type-I seesaw, is affected as well.


title: Crowdsensing-based Road Damage Detection Challenge (CRDDC-2022)

abstract: This paper summarizes the Crowdsensing-based Road Damage Detection Challenge (CRDDC), a Big Data Cup organized as a part of the IEEE International Conference on Big Data'2022. The Big Data Cup challenges involve a released dataset and a well-defined problem with clear evaluation metrics. The challenges run on a data competition platform that maintains a real-time online evaluation system for the participants. In the presented case, the data constitute 47,420 road images collected from India, Japan, the Czech Republic, Norway, the United States, and China to propose methods for automatically detecting road damages in these countries. More than 60 teams from 19 countries registered for this competition. The submitted solutions were evaluated using five leaderboards based on performance for unseen test images from the aforementioned six countries. This paper encapsulates the top 11 solutions proposed by these teams. The best-performing model utilizes ensemble learning based on YOLO and Faster-RCNN series models to yield an F1 score of 76% for test data combined from all 6 countries. The paper concludes with a comparison of current and past challenges and provides direction for the future.


title: AF Adapter: Continual Pretraining for Building Chinese Biomedical Language Model

abstract: Continual pretraining is a popular way of building a domain-specific pretrained language model from a general-domain language model. In spite of its high efficiency, continual pretraining suffers from catastrophic forgetting, which may harm the model's performance in downstream tasks. To alleviate the issue, in this paper, we propose a continual pretraining method for the BERT-based model, named Attention-FFN Adapter. Its main idea is to introduce a small number of attention heads and hidden units inside each self-attention layer and feed-forward network. Furthermore, we train a domain-specific language model named AF Adapter based RoBERTa for the Chinese biomedical domain. In experiments, models are applied to downstream tasks for evaluation. The results demonstrate that with only about 17% of model parameters trained, AF Adapter achieves 0.6%, 2% gain in performance on average, compared to strong baselines. Further experimental results show that our method alleviates the catastrophic forgetting problem by 11% compared to the fine-tuning method.


title: On the liquid film instability of an internally coated horizontal tube

abstract: We study numerically and theoretically the gravity-driven flow of a viscous liquid film coating the inner side of a horizontal cylindrical tube and surrounding a shear-free dynamically inert gaseous core. The liquid-gas interface is prone to the Rayleigh-Plateau and Rayleigh-Taylor instabilities. Here, we focus on the limit of low and intermediate Bond numbers, Bo, where the capillary and gravitational forces are comparable and the Rayleigh-Taylor instability is known to be suppressed. We first study the evolution of the axially invariant draining flow, initiating from a uniform film thickness until reaching a quasi-static regime as the bubble approaches the upper tube wall. We then investigate the flow linear stability within two frameworks: frozen time-frame (quasi-steady) stability analysis and transient growth analysis. We explore the effect of the surface tension (Bo) and inertia (measured by the Ohnesorge number, Oh) on the flow and its stability. The linear stability analysis suggests that the interface deformation at large Bo results in the suppression of the Rayleigh-Plateau instability in the asymptotic long-time limit. Furthermore, the transient growth analysis suggests that the initial flow evolution does not lead to any considerable additional amplification of initial interface perturbations, a posteriori rationalising the quasi-steady assumption. The present study yields a satisfactory prediction of the stabilisation threshold found experimentally by Duclaux et al. [15].


title: Chiral instabilities & the fate of chirality imbalance in non-Abelian plasmas

abstract: We present a first principles study of chiral plasma instabilities and axial charge transfer in non-Abelian plasmas with a strong gauge-matter coupling $g^2N_f=64$, by performing $3+1$ D real-time classical-statistical lattice simulation with dynamical fermions. We explicitly demonstrate for the first time that -- unlike in an Abelian plasma -- the transfer of chirality from the matter sector to the gauge fields occurs predominantly due to topological sphaleron transitions. We elaborate on the similarities and differences of the axial charge dynamics in cold Abelian $U(1)$ and non-Abelian $SU(2)$ plasmas, and comment on the implications of our findings for the study of anomalous transport phenomena, such as the chiral magnetic effect in QCD matter.


title: cegpy: Modelling with Chain Event Graphs in Python

abstract: Chain event graphs (CEGs) are a recent family of probabilistic graphical models that generalise the popular Bayesian networks (BNs) family. Crucially, unlike BNs, a CEG is able to embed, within its graph and its statistical model, asymmetries exhibited by a process. These asymmetries might be in the conditional independence relationships or in the structure of the graph and its underlying event space. Structural asymmetries are common in many domains, and can occur naturally (e.g. a defendant vs prosecutor's version of events) or by design (e.g. a public health intervention). However, there currently exists no software that allows a user to leverage the theoretical developments of the CEG model family in modelling processes with structural asymmetries. This paper introduces cegpy, the first Python package for learning and analysing complex processes using CEGs. The key feature of cegpy is that it is the first CEG package in any programming language that can model processes with symmetric as well as asymmetric structures. cegpy contains an implementation of Bayesian model selection and probability propagation algorithms for CEGs. We illustrate the functionality of cegpy using a structurally asymmetric dataset.


title: High-Order Optimization of Gradient Boosted Decision Trees

abstract: Gradient Boosted Decision Trees (GBDTs) are dominant machine learning algorithms for modeling discrete or tabular data. Unlike neural networks with millions of trainable parameters, GBDTs optimize loss function in an additive manner and have a single trainable parameter per leaf, which makes it easy to apply high-order optimization of the loss function. In this paper, we introduce high-order optimization for GBDTs based on numerical optimization theory which allows us to construct trees based on high-order derivatives of a given loss function. In the experiments, we show that high-order optimization has faster per-iteration convergence that leads to reduced running time. Our solution can be easily parallelized and run on GPUs with little overhead on the code. Finally, we discuss future potential improvements such as automatic differentiation of arbitrary loss function and combination of GBDTs with neural networks.


title: Precise Asymptotics for Spectral Methods in Mixed Generalized Linear Models

abstract: In a mixed generalized linear model, the objective is to learn multiple signals from unlabeled observations: each sample comes from exactly one signal, but it is not known which one. We consider the prototypical problem of estimating two statistically independent signals in a mixed generalized linear model with Gaussian covariates. Spectral methods are a popular class of estimators which output the top two eigenvectors of a suitable data-dependent matrix. However, despite the wide applicability, their design is still obtained via heuristic considerations, and the number of samples $n$ needed to guarantee recovery is super-linear in the signal dimension $d$. In this paper, we develop exact asymptotics on spectral methods in the challenging proportional regime in which $n, d$ grow large and their ratio converges to a finite constant. By doing so, we are able to optimize the design of the spectral method, and combine it with a simple linear estimator, in order to minimize the estimation error. Our characterization exploits a mix of tools from random matrices, free probability and the theory of approximate message passing algorithms. Numerical simulations for mixed linear regression and phase retrieval demonstrate the advantage enabled by our analysis over existing designs of spectral methods.

categories: math.ST cs.IT cs.LG math.IT stat.ML stat.TH


title: Enterprise Model Library for Business-IT-Alignment

abstract: The knowledge of the world is passed on through libraries. Accordingly, domain expertise and experiences should also be transferred within an enterprise by a knowledge base. Therefore, models are an established medium to describe good practices for complex systems, processes, and interconnections. However, there is no structured and detailed approach for a design of an enterprise model library. The objective of this work is the reference architecture of a repository for models with function of reuse. It includes the design of the data structure for filing, the processes for administration and possibilities for usage. Our approach enables consistent mapping of requirements into models via meta-data attributes. Furthermore, the adaptation of reference architectures in specific use cases as well as a reconciliation of interrelationships is enabled. A case study with industry demonstrates the practical benefits of reusing work already done. It provides an organization with systematic access to specifications, standards and guidelines. Thus, further development is accelerated and supported in a structured manner, while complexity remains controllable. The presented approach enriches various enterprise architecture frameworks. It provides benefits for development based on models.


title: A knot-theoretic approach to comparing the Grothendieck-Teichm\"{u}ller and Kashiwara-Vergne groups

abstract: Homomorphic expansions are combinatorial invariants of knotted objects, which are universal in the sense that all finite-type (Vassiliev) invariants factor through them. Homomorphic expansions are also important as bridging objects between low-dimensional topology and quantum algebra. For example, homomorphic expansions of parenthesised braids are in one-to-one correspondence with Drinfel'd associators (Bar-Natan 1998), and homomorphic expansions of $w$-foams are in one-to-one correspondence with solutions to the Kashiwara-Vergne (KV) equations (Bar-Natan and the first author, 2017). The sets of Drinfel'd associators and KV solutions are both bi-torsors, with actions by the pro-unipotent Grothendieck-Teichm\"{u}ller and Kashiwara-Vergne groups, respectively. The above correspondences are in fact maps of bi-torsors (Bar-Natan 1998, and the first and third authors with Halacheva 2022). There is a deep relationship between Drinfel'd associators and KV equations--discovered by Alekseev, Enriquez and Torossian in the 2010s--including an explicit formula constructing KV solutions in terms of associators, and an injective map $\rho:\mathsf{GRT}_1 \to \mathsf{KRV}$. This paper is a topological/diagrammatic study of the image of the Grothendieck-Teichm\"{u}ller groups in the Kashiwara-Vergne symmetry groups, using the fact that both parenthesised braids and $w$-foams admit respective finite presentations as an operad and as a tensor category (circuit algebra or prop).


title: On the number of rational points of Artin-Schreier curves and hypersurfaces

abstract: Let $\mathbb F_{q^n}$ denote the finite field with $q^n$ elements. In this paper we determine the number of $\mathbb F_{q^n}$-rational points of the affine Artin-Schreier curve given by $y^q-y = x(x^{q^i}-x)-\lambda$ and of the Artin-Schreier hypersurface $y^q-y=\sum_{j=1}^r a_jx_j(x_j^{q^{i_j}}-x_j)-\lambda.$ Moreover in both cases, we show that the Weil bound is attained only in the case where the trace of $\lambda\in\mathbb F_{q^n}$ over $\mathbb F_q$ is zero. We use quadratic forms and permutation matrices to determine the number of affine rational points of these curves and hypersurfaces.


title: Topological superconductivity and large spin Hall effect in the kagome family Ti6X4 (X = Bi, Sb, Pb, Tl, In)

abstract: Topological superconductors (TSC) become a focus of research due to the accompanying Majorana fermions. However, the experimentally reported TSC are extremely rare. The recent experiments reported the kagome TSC AV$_{3}$Sb$_{5}$ (A=K, Rb, Cs), which exhibit unique superconductivity, topological surface states (TSS), and Majorana bound states. More recently, the first titanium-based kagome superconductor CsTi$ _{3} $Bi$ _{5} $ with nontrivial topology was successfully synthesized as a perspective TSC. Given that Cs contributes little to the electronic structures of CsTi$ _{3} $Bi$ _{5} $ and binary compounds may be easier to be synthesized, here, by density functional theory calculations, we predict five stable non-magnetic kagome compounds Ti$ _{6} $X$ _{4} $ (X = Bi, Sb, Pb, Tl, In) which exhibit superconductivity with critical temperature Tc = 3.8$ - $5.1 K, nontrivial $\mathbb{Z}$$_2$ band topology, and TSS close to the Fermi level. In addition, the large intrinsic spin Hall effect is obtained in Ti$ _{6} $X$ _{4} $, which is caused by gapped Dirac nodes and nodal lines due to a strong spin-orbit coupling. This work offers new platforms for TSC and spintronic devices.


title: Rotational Elliptic Weingarten surfaces in S2xR and the Hopf problem

abstract: We prove that any uniformly elliptic Weingarten (topological) sphere in S2xR must be congruent to the canonical example associated to the Weingarten equation. The result is obtained by proving that rotational uniformly elliptic Weingarten surfaces in S2xR have bounded second fundamental form together with a Hopf type result by J. A. G\'alvez and P. Mira.


title: Room Temperature Optically and Magnetically Active Edges in Phosphorene Nanoribbons

abstract: Nanoribbons - nanometer wide strips of a two-dimensional material - are a unique system in condensed matter physics. They combine the exotic electronic structures of low-dimensional materials with an enhanced number of exposed edges, where phenomena including ultralong spin coherence times, quantum confinement and topologically protected states can emerge. An exciting prospect for this new material concept is the potential for both a tunable semiconducting electronic structure and magnetism along the nanoribbon edge. This combination of magnetism and semiconducting properties is the first step in unlocking spin-based electronics such as non-volatile transistors, a route to low-energy computing, and has thus far typically only been observed in doped semiconductor systems and/or at low temperatures. Here, we report the magnetic and semiconducting properties of phosphorene nanoribbons (PNRs). Static (SQUID) and dynamic (EPR) magnetization probes demonstrate that at room temperature, films of PNRs exhibit macroscopic magnetic properties, arising from their edge, with internal fields of ~ 250 to 800 mT. In solution, a giant magnetic anisotropy enables the alignment of PNRs at modest sub-1T fields. By leveraging this alignment effect, we discover that upon photoexcitation, energy is rapidly funneled to a dark-exciton state that is localized to the magnetic edge and coupled to a symmetry-forbidden edge phonon mode. Our results establish PNRs as a unique candidate system for studying the interplay of magnetism and semiconducting ground states at room temperature and provide a stepping-stone towards using low-dimensional nanomaterials in quantum electronics.


title: Macdonald-Hurwitz Number

abstract: Inspired by J. Novak's works on the asymptotic behavior of the BGW and the HCIZ matrix integrals \cite{[N0]} and by the algebraic and geometric properties of the Hurwitz numbers \cite{[IP]}, \cite{[LZZ]}, \cite{[LR]}, \cite{[OP]}, \cite{[Z1]}, and by the symplectic surgery theory of the relative GW-invariants \cite{[IP]}, \cite{[LR]}, using the elements of the transform matrix from the integral Macdonald function with two parameters to the homogeneous symmetric power sum functions \cite{[M]}, we have constructed the Macdonald-Hurwitz numbers. As an application, we have constructed a series of new genus-expanded cut-and-join differential operators, which can be thought of as the generalization of the Laplace-Beltrami operators and have the genus-expanded integral Macdonald functions as their common eigenfunctions. We have also obtained some generating wave functions of the same degree, which are generated by the Macdonald-Hurwitz numbers and can be expressed in terms of the new cut-and-join differential operators and the initial values. Another application is that we have constructed a new commutative associative algebra $(C(\mathbb{F}[S_{d}]),\circ_{q,t})$ (referring to the last section (6)). By taking the limit along a special path $\eta(A|B)$ (referring to the formulas (140), (141)), we specialize $(C(\mathbb{F}[S_{d}]),\circ_{q,t})$ to be a commutative associative algebra $(C(\hat{\mathbb{F}}[S_{d}]),\circ_{A|B})$, which will be proven to be isomorphic to the middle-dimensional $\mathbb{\mathbb{C}^*}$-equivalent cohomological rings via the Jack functions over the Hilbert scheme points of $\mathbb{C}^2$ constructed by W. Li, Z. Qin, and W. Wang in \cite{[LQW2]}.}


title: Classical-quantum correspondence of special and extraordinary-log criticality: Villain's bridge

abstract: There has been much recent progress on exotic surface critical behavior, yet the classical-quantum correspondence of special and extraordinary-log criticality remains largely unclear. Employing worm Monte Carlo simulations, we explore the surface criticality at an emergent superfluid-Mott insulator critical point in the Villain representation, which is believed to connect classical and quantum O(2) critical systems. We observe a special transition with the thermal and magnetic renormalization exponents $y_t=0.58(1)$ and $y_h=1.690(1)$ respectively, which are close to recent estimates from models with discrete spin variables. The existence of extraordinary-log universality is evidenced by the critical exponent $\hat{q}=0.58(2)$ from two-point correlation and the renormalization-group parameter $\alpha=0.28(1)$ from superfluid stiffness, which obey the scaling relation of extraordinary-log critical theory and recover the logarithmic finite-size scaling of critical superfluid stiffness in open-edge quantum Bose-Hubbard model. Our results bridge recent observations of surface critical behavior in the classical statistical mechanical models [Parisen Toldin, Phys. Rev. Lett. 126, 135701 (2021); Hu $et$ $al.$, $ibid.$ 127, 120603 (2021); Parisen Toldin $et$ $al.$, $ibid.$ 128, 215701 (2022)] and the open-edge quantum Bose-Hubbard model [Sun $et$ $al.$, Phys. Rev. B 106, 224502 (2022)].


title: Lifespan estimates for the compressible Euler equations with damping via Orlicz spaces techniques

abstract: In this paper we are interested in the upper bound of the lifespan estimate for the compressible Euler system with time dependent damping and small initial perturbations. We employ some techniques from the blow-up study of nonlinear wave equations. The novelty consists in the introduction of tools from the Orlicz spaces theory to handle the nonlinear term emerging from the pressure $p \equiv p(\rho)$, which admits different asymptotic behavior for large and small values of $\rho-1$, being $\rho$ the density. Hence we can establish, in high dimensions $n\in\{2,3\}$, unified upper bounds of the lifespan estimate depending only on the dimension $n$ and on the damping strength, and independent of the adiabatic index $\gamma>1$. We conjecture our results to be optimal. The method employed here not only improves the known upper bounds of the lifespan for $n\in\{2,3\}$, but has potential application in the study of related problems.


title: Learning on tree architectures outperforms a convolutional feedforward network

abstract: Advanced deep learning architectures consist of tens of fully connected and convolutional hidden layers, currently extended to hundreds, are far from their biological realization. Their implausible biological dynamics relies on changing a weight in a non-local manner, as the number of routes between an output unit and a weight is typically large, using the backpropagation technique. Here, a 3-layer tree architecture inspired by experimental-based dendritic tree adaptations is developed and applied to the offline and online learning of the CIFAR-10 database. The proposed architecture outperforms the achievable success rates of the 5-layer convolutional LeNet. Moreover, the highly pruned tree backpropagation approach of the proposed architecture, where a single route connects an output unit and a weight, represents an efficient dendritic deep learning.


title: Modelling spatiotemporal turbulent dynamics with the convolutional autoencoder echo state network

abstract: The spatiotemporal dynamics of turbulent flows is chaotic and difficult to predict. This makes the design of accurate and stable reduced-order models challenging. The overarching objective of this paper is to propose a nonlinear decomposition of the turbulent state for a reduced-order representation of the dynamics. We divide the turbulent flow into a spatial problem and a temporal problem. First, we compute the latent space, which is the manifold onto which the turbulent dynamics live (i.e., it is a numerical approximation of the turbulent attractor). The latent space is found by a series of nonlinear filtering operations, which are performed by a convolutional autoencoder (CAE). The CAE provides the decomposition in space. Second, we predict the time evolution of the turbulent state in the latent space, which is performed by an echo state network (ESN). The ESN provides the decomposition in time. Third, by assembling the CAE and the ESN, we obtain an autonomous dynamical system: the convolutional autoncoder echo state network (CAE-ESN). This is the reduced-order model of the turbulent flow. We test the CAE-ESN on a two-dimensional flow. We show that, after training, the CAE-ESN (i) finds a latent-space representation of the turbulent flow that has less than 1% of the degrees of freedom than the physical space; (ii) time-accurately and statistically predicts the flow in both quasiperiodic and turbulent regimes; (iii) is robust for different flow regimes (Reynolds numbers); and (iv) takes less than 1% of computational time to predict the turbulent flow than solving the governing equations. This work opens up new possibilities for nonlinear decompositions and reduced-order modelling of turbulent flows from data.


title: Self adaptive global-local feature enhancement for radiology report generation

abstract: Automated radiology report generation aims at automatically generating a detailed description of medical images, which can greatly alleviate the workload of radiologists and provide better medical services to remote areas. Most existing works pay attention to the holistic impression of medical images, failing to utilize important anatomy information. However, in actual clinical practice, radiologists usually locate important anatomical structures, and then look for signs of abnormalities in certain structures and reason the underlying disease. In this paper, we propose a novel framework AGFNet to dynamically fuse the global and anatomy region feature to generate multi-grained radiology report. Firstly, we extract important anatomy region features and global features of input Chest X-ray (CXR). Then, with the region features and the global features as input, our proposed self-adaptive fusion gate module could dynamically fuse multi-granularity information. Finally, the captioning generator generates the radiology reports through multi-granularity features. Experiment results illustrate that our model achieved the state-of-the-art performance on two benchmark datasets including the IU X-Ray and MIMIC-CXR. Further analyses also prove that our model is able to leverage the multi-grained information from radiology images and texts so as to help generate more accurate reports.


title: LISA: Localized Image Stylization with Audio via Implicit Neural Representation

abstract: We present a novel framework, Localized Image Stylization with Audio (LISA) which performs audio-driven localized image stylization. Sound often provides information about the specific context of the scene and is closely related to a certain part of the scene or object. However, existing image stylization works have focused on stylizing the entire image using an image or text input. Stylizing a particular part of the image based on audio input is natural but challenging. In this work, we propose a framework that a user provides an audio input to localize the sound source in the input image and another for locally stylizing the target object or scene. LISA first produces a delicate localization map with an audio-visual localization network by leveraging CLIP embedding space. We then utilize implicit neural representation (INR) along with the predicted localization map to stylize the target object or scene based on sound information. The proposed INR can manipulate the localized pixel values to be semantically consistent with the provided audio input. Through a series of experiments, we show that the proposed framework outperforms the other audio-guided stylization methods. Moreover, LISA constructs concise localization maps and naturally manipulates the target object or scene in accordance with the given audio input.


title: Bias and Refinement of Multiscale Mean Field Models

abstract: Mean field approximation is a powerful technique which has been used in many settings to study large-scale stochastic systems. In the case of two-timescale systems, the approximation is obtained by a combination of scaling arguments and the use of the averaging principle. This paper analyzes the approximation error of this `average' mean field model for a two-timescale model $(\boldsymbol{X}, \boldsymbol{Y})$, where the slow component $\boldsymbol{X}$ describes a population of interacting particles which is fully coupled with a rapidly changing environment $\boldsymbol{Y}$. The model is parametrized by a scaling factor $N$, e.g. the population size, which as $N$ gets large decreases the jump size of the slow component in contrast to the unchanged dynamics of the fast component. We show that under relatively mild conditions, the `average' mean field approximation has a bias of order $O(1/N)$ compared to $\mathbb{E}[\boldsymbol{X}]$. This holds true under any continuous performance metric in the transient regime, as well as for the steady-state if the model is exponentially stable. To go one step further, we derive a bias correction term for the steady-state, from which we define a new approximation called the refined `average' mean field approximation whose bias is of order $O(1/N^2)$. This refined `average' mean field approximation allows computing an accurate approximation even for small scaling factors, i.e., $N\approx 10 -50$. We illustrate the developed framework and accuracy results through an application to a random access CSMA model.


title: A Variational Inference method for Bayesian variable selection

abstract: Variable selection is a classic problem in statistics. In this paper, we consider a Bayes variable selection problem based on spike-and-slab prior with mixed normal distribution proposed by Ro\v{c}kov\'a and George (2014). Motivated by Ormerod and You (2017, 2023), we use the variational inference and collapsed variational inference method to solve the Bayesian problem instead of MCMC. Like Ormerod and You (2017, 2023), we also explain how the sparsity estimator is induced, and under certain mild assumptions, we also prove the consistent and asymptotic results.


title: Expander Decomposition in Dynamic Streams

abstract: In this paper we initiate the study of expander decompositions of a graph $G=(V, E)$ in the streaming model of computation. The goal is to find a partitioning $\mathcal{C}$ of vertices $V$ such that the subgraphs of $G$ induced by the clusters $C \in \mathcal{C}$ are good expanders, while the number of intercluster edges is small. Expander decompositions are classically constructed by a recursively applying balanced sparse cuts to the input graph. In this paper we give the first implementation of such a recursive sparsest cut process using small space in the dynamic streaming model. Our main algorithmic tool is a new type of cut sparsifier that we refer to as a power cut sparsifier - it preserves cuts in any given vertex induced subgraph (or, any cluster in a fixed partition of $V$) to within a $(\delta, \epsilon)$-multiplicative/additive error with high probability. The power cut sparsifier uses $\tilde{O}(n/\epsilon\delta)$ space and edges, which we show is asymptotically tight up to polylogarithmic factors in $n$ for constant $\delta$.


title: A route from maximal chaoticity to integrability

abstract: We study the chaos exponent of some variants of the Sachdev-Ye-Kitaev (SYK) model, namely, the $\Ns=1$ supersymmetry (SUSY)-SYK model and its sibling, the $(N|M)$-SYK model which is not supersymmetric in general, for arbitrary interaction strength. We find that for large $q$ the chaos exponent of these variants, as well as the SYK and the $\Ns=2$ SUSY-SYK model, all follow a single-parameter scaling law. By quantitative arguments we further make a conjecture, i.e. that the found scaling law might hold for general one-dimensional (1D) SYK-like models with large $q$. This points out a universal route from maximal chaos towards completely regular or integrable motion in the SYK model and its 1D variants.


title: PS-Transformer: Learning Sparse Photometric Stereo Network using Self-Attention Mechanism

abstract: Existing deep calibrated photometric stereo networks basically aggregate observations under different lights based on the pre-defined operations such as linear projection and max pooling. While they are effective with the dense capture, simple first-order operations often fail to capture the high-order interactions among observations under small number of different lights. To tackle this issue, this paper presents a deep sparse calibrated photometric stereo network named {\it PS-Transformer} which leverages the learnable self-attention mechanism to properly capture the complex inter-image interactions. PS-Transformer builds upon the dual-branch design to explore both pixel-wise and image-wise features and individual feature is trained with the intermediate surface normal supervision to maximize geometric feasibility. A new synthetic dataset named CyclesPS+ is also presented with the comprehensive analysis to successfully train the photometric stereo networks. Extensive results on the publicly available benchmark datasets demonstrate that the surface normal prediction accuracy of the proposed method significantly outperforms other state-of-the-art algorithms with the same number of input images and is even comparable to that of dense algorithms which input 10$\times$ larger number of images.


title: Sudden braking and turning with a two-field potential bump: primordial black hole formation

abstract: We investigate the amplification of curvature perturbations in a two-field inflation model featuring a Gaussian potential bump. When the inflaton encounters a potential bump along the inflationary trajectory, its rolling speed is generally reduced, potentially causing a violation of the slow-roll condition. Consequently, the original decaying modes of comoving curvature perturbations during the slow-roll phase start growing, and lead to enhanced small-scale density perturbations which can produce amounts of primordial black holes (PBHs) and associated scalar-induced gravitational waves. In addition, inflaton also undergoes sudden turnings at the encounter of the Gaussian potential bump, which is insignificant to the overall curvature power spectrum due to the short duration of these turns. Our paper offers a simple example of the extension of a bump-like potential for PBH formation in a single-field inflation to a two-field case, which helps alleviate the fine-tuning of initial conditions to some extent.


title: Hunting light Higgses at the LHC in the context of the 2HDM Type-I

abstract: We show the reinterpretation of existing searches for exotic decays of the Standard Model (SM)-like Higgs, $H \to aa (hh)$, in various final states, in the framework of the 2-Higgs Doublet Model (2HDM) Type-I. We then explore a new search for such light Higgses, $a$ and $h$, at the Large Hadron Collider (LHC) Run 3 for an integrated luminosity of 300 $\text{fb}^{-1}$. After performing a scan over the model parameters, we found that the inverted scenario of Type-I offers a new promising signal in the form of the following cascade decays: $H \to Z^{*}a \to Z^{*}Z^{*}h \to b\overline{b} \mu^- \mu^+ jj$. We investigate then its significance through a full Monte Carlo (MC) simulation down to the detector level.


title: Junctions and superconducting symmetry in twisted bilayer graphene

abstract: Junctions provide a wealth of information on the symmetry of the order parameter of superconductors. We analyze junctions between a scanning tunneling microscope (STM) tip and superconducting twisted bilayer graphene (TBG) and TBG Josephson junctions (JJs). We compare superconducting phases that are even or odd under valley exchange (s- or f-wave). The critical current in mixed (s- and f-) JJs strongly depends on the angle between the junction and the lattice. In STM-TBG junctions, due to Andreev reflection, f-wave leads to a prominent peak in subgap conductance, as seen in experiments.


title: State Estimation for Hybrid Locomotion of Driving-Stepping Quadrupeds

abstract: Fast and versatile locomotion can be achieved with wheeled quadruped robots that drive quickly on flat terrain, but are also able to overcome challenging terrain by adapting their body pose and by making steps. In this paper, we present a state estimation approach for four-legged robots with non-steerable wheels that enables hybrid driving-stepping locomotion capabilities. We formulate a Kalman Filter (KF) for state estimation that integrates driven wheels into the filter equations and estimates the robot state (position and velocity) as well as the contribution of driving with wheels to the above state. Our estimation approach allows us to use the control framework of the Mini Cheetah quadruped robot with minor modifications. We tested our approach on this robot that we augmented with actively driven wheels in simulation and in the real world. The experimental results are available at https://www.ais.uni-bonn.de/%7Ehosseini/se-dsq .


title: Reinforcement Learning-Enhanced Control Barrier Functions for Robot Manipulators

abstract: In this paper we present the implementation of a Control Barrier Function (CBF) using a quadratic program (QP) formulation that provides obstacle avoidance for a robotic manipulator arm system. CBF is a control technique that has emerged and developed over the past decade and has been extensively explored in the literature on its mathematical foundations, proof of set invariance and potential applications for a variety of safety-critical control systems. In this work we will look at the design of CBF for the robotic manipulator obstacle avoidance, discuss the selection of the CBF parameters and present a Reinforcement Learning (RL) scheme to assist with finding parameters values that provide the most efficient trajectory to successfully avoid different sized obstacles. We then create a data-set across a range of scenarios used to train a Neural-Network (NN) model that can be used within the control scheme to allow the system to efficiently adapt to different obstacle scenarios. Computer simulations (based on Matlab/Simulink) demonstrate the effectiveness of the proposed algorithm.


title: A Neural Network-Based Distributional Constraint Learning Methodology for Mixed-Integer Stochastic Optimization

abstract: The use of machine learning methods helps to improve decision making in different fields. In particular, the idea of bridging predictions (machine learning models) and prescriptions (optimization problems) is gaining attention within the scientific community. One of the main ideas to address this trade-off is the so-called Constraint Learning (CL) methodology, where the structures of the machine learning model can be treated as a set of constraints to be embedded within the optimization problem, establishing the relationship between a direct decision variable $x$ and a response variable $y$. However, most CL approaches have focused on making point predictions for a certain variable, not taking into account the statistical and external uncertainty faced in the modeling process. In this paper, we extend the CL methodology to deal with uncertainty in the response variable $y$. The novel Distributional Constraint Learning (DCL) methodology makes use of a piece-wise linearizable neural network-based model to estimate the parameters of the conditional distribution of $y$ (dependent on decisions $x$ and contextual information), which can be embedded within mixed-integer optimization problems. In particular, we formulate a stochastic optimization problem by sampling random values from the estimated distribution by using a linear set of constraints. In this sense, DCL combines both the high predictive performance of the neural network method and the possibility of generating scenarios to account for uncertainty within a tractable optimization model. The behavior of the proposed methodology is tested in a real-world problem in the context of electricity systems, where a Virtual Power Plant seeks to optimize its operation, subject to different forms of uncertainty, and with price-responsive consumers.


title: TFormer: A throughout fusion transformer for multi-modal skin lesion diagnosis

abstract: Multi-modal skin lesion diagnosis (MSLD) has achieved remarkable success by modern computer-aided diagnosis (CAD) technology based on deep convolutions. However, the information aggregation across modalities in MSLD remains challenging due to severity unaligned spatial resolution (e.g., dermoscopic image and clinical image) and heterogeneous data (e.g., dermoscopic image and patients' meta-data). Limited by the intrinsic local attention, most recent MSLD pipelines using pure convolutions struggle to capture representative features in shallow layers, thus the fusion across different modalities is usually done at the end of the pipelines, even at the last layer, leading to an insufficient information aggregation. To tackle the issue, we introduce a pure transformer-based method, which we refer to as ``Throughout Fusion Transformer (TFormer)'', for sufficient information integration in MSLD. Different from the existing approaches with convolutions, the proposed network leverages transformer as feature extraction backbone, bringing more representative shallow features. We then carefully design a stack of dual-branch hierarchical multi-modal transformer (HMT) blocks to fuse information across different image modalities in a stage-by-stage way. With the aggregated information of image modalities, a multi-modal transformer post-fusion (MTP) block is designed to integrate features across image and non-image data. Such a strategy that information of the image modalities is firstly fused then the heterogeneous ones enables us to better divide and conquer the two major challenges while ensuring inter-modality dynamics are effectively modeled.


title: Learning Implicit Probability Distribution Functions for Symmetric Orientation Estimation from RGB Images Without Pose Labels

abstract: Object pose estimation is a necessary prerequisite for autonomous robotic manipulation, but the presence of symmetry increases the complexity of the pose estimation task. Existing methods for object pose estimation output a single 6D pose. Thus, they lack the ability to reason about symmetries. Lately, modeling object orientation as a non-parametric probability distribution on the SO(3) manifold by neural networks has shown impressive results. However, acquiring large-scale datasets to train pose estimation models remains a bottleneck. To address this limitation, we introduce an automatic pose labeling scheme. Given RGB-D images without object pose annotations and 3D object models, we design a two-stage pipeline consisting of point cloud registration and render-and-compare validation to generate multiple symmetrical pseudo-ground-truth pose labels for each image. Using the generated pose labels, we train an ImplicitPDF model to estimate the likelihood of an orientation hypothesis given an RGB image. An efficient hierarchical sampling of the SO(3) manifold enables tractable generation of the complete set of symmetries at multiple resolutions. During inference, the most likely orientation of the target object is estimated using gradient ascent. We evaluate the proposed automatic pose labeling scheme and the ImplicitPDF model on a photorealistic dataset and the T-Less dataset, demonstrating the advantages of the proposed method.


title: Prasad's Conjecture about dualizing involutions

abstract: Let $G$ be a connected reductive group defined over a finite field $\mathbb{F}_q$ with corresponding Frobenius $F$. Let $\iota_G$ denote the duality involution defined by D. Prasad under the hypothesis $2\mathrm{H}^1(F,Z(G))=0$, where $Z(G)$ denotes the center of $G$. We show that for each irreducible character $\rho$ of $G^F$, the involution $\iota_G$ takes $\rho$ to its dual $\rho^{\vee}$ if and only if for a suitable Jordan decomposition of characters, an associated unipotent character $u_\rho$ has Frobenius eigenvalues $\pm$ 1. As a corollary, we obtain that if $G$ has no exceptional factors and satisfies $2\mathrm{H}^1(F,Z(G))=0$, then the duality involution $\iota_G$ takes $\rho$ to its dual $\rho^{\vee}$ for each irreducible character $\rho$ of $G^F$. Our results resolve a finite group counterpart of a conjecture of D.~Prasad.


title: A Curriculum-Training-Based Strategy for Distributing Collocation Points during Physics-Informed Neural Network Training

abstract: Physics-informed Neural Networks (PINNs) often have, in their loss functions, terms based on physical equations and derivatives. In order to evaluate these terms, the output solution is sampled using a distribution of collocation points. However, density-based strategies, in which the number of collocation points over the domain increases throughout the training period, do not scale well to multiple spatial dimensions. To remedy this issue, we present here a curriculum-training-based method for lightweight collocation point distributions during network training. We apply this method to a PINN which recovers a full two-dimensional magnetohydrodynamic (MHD) solution from a partial sample taken from a baseline MHD simulation. We find that the curriculum collocation point strategy leads to a significant decrease in training time and simultaneously enhances the quality of the reconstructed solution.


title: Learning Low-Rank Representations for Model Compression

abstract: Vector Quantization (VQ) is an appealing model compression method to obtain a tiny model with less accuracy loss. While methods to obtain better codebooks and codes under fixed clustering dimensionality have been extensively studied, optimizations of the vectors in favour of clustering performance are not carefully considered, especially via the reduction of vector dimensionality. This paper reports our recent progress on the combination of dimensionality compression and vector quantization, proposing a Low-Rank Representation Vector Quantization ($\text{LR}^2\text{VQ}$) method that outperforms previous VQ algorithms in various tasks and architectures. $\text{LR}^2\text{VQ}$ joins low-rank representation with subvector clustering to construct a new kind of building block that is directly optimized through end-to-end training over the task loss. Our proposed design pattern introduces three hyper-parameters, the number of clusters $k$, the size of subvectors $m$ and the clustering dimensionality $\tilde{d}$. In our method, the compression ratio could be directly controlled by $m$, and the final accuracy is solely determined by $\tilde{d}$. We recognize $\tilde{d}$ as a trade-off between low-rank approximation error and clustering error and carry out both theoretical analysis and experimental observations that empower the estimation of the proper $\tilde{d}$ before fine-tunning. With a proper $\tilde{d}$, we evaluate $\text{LR}^2\text{VQ}$ with ResNet-18/ResNet-50 on ImageNet classification datasets, achieving 2.8\%/1.0\% top-1 accuracy improvements over the current state-of-the-art VQ-based compression algorithms with 43$\times$/31$\times$ compression factor.


title: Direct top quark mass measurements with the ATLAS and CMS detectors

abstract: This article presents a review of recent results on direct top quark mass measurements performed by the ATLAS and CMS collaborations on $pp$ collisions collected during Run 2 of the LHC at $\sqrt{s}=$13 TeV.


title: Three- and Four-Point Functions in CPT-Even Lorentz-Violating Scalar QED

abstract: The renormalization of quantum field theories usually assumes Lorentz and gauge symmetries, besides the general restrictions imposed by unitarity and causality. However, the set of renormalizable theories can be enlarged by relaxing some of these assumptions. In this work, we consider the particular case of a CPT-preserving but Lorentz-breaking extension of scalar QED. For this theory, we calculate the one-loop radiative corrections to the three- and four-point scalar-vector vertex functions, at the lowest order in the Lorentz violation parameters; and we explicitly verify that the resulting low-energy effective action is compatible with the usual gauge invariance requirements. With these results, we complete the one-loop renormalization of the model at the leading order in the Lorentz-violating parameters.


title: The Online Closure Principle

abstract: The closure principle is fundamental in multiple testing and has been used to derive many efficient procedures with familywise error rate control. However, it is often unsuitable for modern research, which involves flexible multiple testing settings where not all hypotheses are known at the beginning of the evaluation. In this paper, we focus on online multiple testing where a possibly infinite sequence of hypotheses is tested over time. At each step, it must be decided on the current hypothesis without having any information about the hypotheses that have not been tested yet. Our main contribution is a general and stringent mathematical definition of online multiple testing and a new online closure principle which ensures that the resulting closed procedure can be applied in the online setting. We prove that any familywise error rate controlling online procedure can be derived by this online closure principle and provide admissibility results. In addition, we demonstrate how short-cuts of these online closed procedures can be obtained under a suitable consonance property.


title: The hadronic running of the electroweak couplings from lattice QCD

abstract: The energy dependency (running) of the strength of electromagnetic interactions $\alpha$ plays an important role in precision tests of the Standard Model. The running of the former to the $Z$ pole is an input quantity for global electroweak fits, while the running of the mixing angle is susceptible to the effects of Beyond Standard Model physics, particularly at low energies. We present a computation of the hadronic vacuum polarization (HVP) contribution to the running of these electroweak couplings at the non-perturbative level in lattice QCD, in the space-like regime up to $Q^2$ momentum transfers of $7\,\mathrm{GeV}^2$. This quantity is also closely related to the HVP contribution to the muon $g-2$. We observe a tension of up to $3.5$ standard deviation between our lattice results for $\Delta\alpha^{(5)}_{\mathrm{had}}(-Q^2)$ and estimates based on the $R$-ratio for $Q^2$ in the $3$ to $7\,\mathrm{GeV}^2$ range. The tension is, however, strongly diminished when translating our result to the $Z$ pole, by employing the Euclidean split technique and perturbative QCD, which yields $\Delta\alpha^{(5)}_{\mathrm{had}}(M_Z^2)=0.027\,73(15)$. This value agrees with results based on the $R$-ratio within the quoted uncertainties, and can be used as an alternative to the latter in global electroweak fits.


title: An Implicit Parametric Morphable Dental Model

abstract: 3D Morphable models of the human body capture variations among subjects and are useful in reconstruction and editing applications. Current dental models use an explicit mesh scene representation and model only the teeth, ignoring the gum. In this work, we present the first parametric 3D morphable dental model for both teeth and gum. Our model uses an implicit scene representation and is learned from rigidly aligned scans. It is based on a component-wise representation for each tooth and the gum, together with a learnable latent code for each of such components. It also learns a template shape thus enabling several applications such as segmentation, interpolation, and tooth replacement. Our reconstruction quality is on par with the most advanced global implicit representations while enabling novel applications. Project page: https://vcai.mpi-inf.mpg.de/projects/DMM/


title: General time-reversal equivariant neural network potential for magnetic materials

abstract: This study introduces time-reversal E(3)-equivariant neural network and SpinGNN++ framework for constructing a comprehensive interatomic potential for magnetic systems, encompassing spin-orbit coupling and noncollinear magnetic moments. SpinGNN++ integrates multitask spin equivariant neural network with explicit spin-lattice terms, including Heisenberg, Dzyaloshinskii-Moriya, Kitaev, single-ion anisotropy, and biquadratic interactions, and employs time-reversal equivariant neural network to learn high-order spin-lattice interactions using time-reversal E(3)-equivariant convolutions. To validate SpinGNN++, a complex magnetic model dataset is introduced as a benchmark and employed to demonstrate its capabilities. SpinGNN++ provides accurate descriptions of the complex spin-lattice coupling in monolayer CrI$_3$ and CrTe$_2$, achieving sub-meV errors. Importantly, it facilitates large-scale parallel spin-lattice dynamics, thereby enabling the exploration of associated properties, including the magnetic ground state and phase transition. Remarkably, SpinGNN++ identifies a new ferrimagnetic state as the ground magnetic state for monolayer CrTe2, thereby enriching its phase diagram and providing deeper insights into the distinct magnetic signals observed in various experiments.


title: Approximating a Laplacian Prior for Joint State and Model Estimation within an UKF

abstract: A major challenge in state estimation with model-based observers are low-quality models that lack of relevant dynamics. We address this issue by simultaneously estimating the system's states and its model uncertainties by a square root UKF. Concretely, we extend the state by the parameter vector of a linear combination containing suitable functions that approximate the lacking dynamics. Presuming that only a few dynamical terms are relevant, the parameter vector is claimed to be sparse. In Bayesian setting, properties like sparsity are expressed by a prior distribution. One common choice for sparsity is a Laplace distribution. However, due to some disadvantages of a Laplacian prior, the regularized horseshoe distribution, a Gaussian that approximately features sparsity, is applied. Results exhibit small estimation errors with model improvements detected by an automated model reduction technique.


title: On a Hodge locus

abstract: There are many instances such that deformation space of the homology class of an algebraic cycle as a Hodge cycle is larger than its deformation space as algebraic cycle. This phenomena can occur for algebraic cycles inside hypersurfaces, however, we are only able to gather evidences for it by computer experiments. In this article we describe one example of this for cubic hypersurfaces. The verification of the mentioned phenomena in this case is proposed as the first GADEPs problem. The main goal is either to verify the (variational) Hodge conjecture in such a case or gather evidences that it might produce a counterexample to the Hodge conjecture.


title: Structural Optimization of Factor Graphs for Symbol Detection via Continuous Clustering and Machine Learning

abstract: We propose a novel method to optimize the structure of factor graphs for graph-based inference. As an example inference task, we consider symbol detection on linear inter-symbol interference channels. The factor graph framework has the potential to yield low-complexity symbol detectors. However, the sum-product algorithm on cyclic factor graphs is suboptimal and its performance is highly sensitive to the underlying graph. Therefore, we optimize the structure of the underlying factor graphs in an end-to-end manner using machine learning. For that purpose, we transform the structural optimization into a clustering problem of low-degree factor nodes that incorporates the known channel model into the optimization. Furthermore, we study the combination of this approach with neural belief propagation, yielding near-maximum a posteriori symbol detection performance for specific channels.


title: RAILD: Towards Leveraging Relation Features for Inductive Link Prediction In Knowledge Graphs

abstract: Due to the open world assumption, Knowledge Graphs (KGs) are never complete. In order to address this issue, various Link Prediction (LP) methods are proposed so far. Some of these methods are inductive LP models which are capable of learning representations for entities not seen during training. However, to the best of our knowledge, none of the existing inductive LP models focus on learning representations for unseen relations. In this work, a novel Relation Aware Inductive Link preDiction (RAILD) is proposed for KG completion which learns representations for both unseen entities and unseen relations. In addition to leveraging textual literals associated with both entities and relations by employing language models, RAILD also introduces a novel graph-based approach to generate features for relations. Experiments are conducted with different existing and newly created challenging benchmark datasets and the results indicate that RAILD leads to performance improvement over the state-of-the-art models. Moreover, since there are no existing inductive LP models which learn representations for unseen relations, we have created our own baselines and the results obtained with RAILD also outperform these baselines.


title: Peering into the Milky Way by FAST: IV. Identification of two new Galactic supernova remnants G203.1+6.6 and G206.7+5.9

abstract: A 5$^{\circ}$ $\times$ 7$^{\circ}$ sky area containing two large radio structures of G203.1+6.6 and G206.7+5.9 with a size of about 2.5$^{\circ}$ and 3.5$^{\circ}$ respectively is scanned by using the L-band 19-beam receiver of the Five-hundred-meter Aperture Spherical radio Telescope (FAST). The FAST L-band receiver covers a frequency range of 1.0-1.5 GHz. Commissioning of the receiving system, including the measurements of the half-power beam width, gain, and main-beam efficiency is made by observing the calibrators. The multi-channel spectroscopy backend mounted to the receiver allows an in-band spectral-index determination. The brightness-temperature spectral indices of both objects are measured to be $\beta$ $\sim$ $-$2.6 to $-$2.7. Polarized emission is detected from the archival Effelsberg $\lambda$11 cm data for all the shell structures of G203.1+6.6 and G206.7+5.9. These results clearly indicate a non-thermal synchrotron emitting nature, confirming that G203.1+6.6 and G206.7+5.9 are large shell-type supernova remnants (SNRs). Based on morphological correlation between the radio continuum emission of G206.7+5.9 and the HI structures, the kinematic distance to this new SNR is estimated to be about 440 pc, placing it in the Local Arm.


title: Cost-effective Simulation-based Test Selection in Self-driving Cars Software

abstract: Simulation environments are essential for the continuous development of complex cyber-physical systems such as self-driving cars (SDCs). Previous results on simulation-based testing for SDCs have shown that many automatically generated tests do not strongly contribute to identification of SDC faults, hence do not contribute towards increasing the quality of SDCs. Because running such "uninformative" tests generally leads to a waste of computational resources and a drastic increase in the testing cost of SDCs, testers should avoid them. However, identifying "uninformative" tests before running them remains an open challenge. Hence, this paper proposes SDCScissor, a framework that leverages Machine Learning (ML) to identify SDC tests that are unlikely to detect faults in the SDC software under test, thus enabling testers to skip their execution and drastically increase the cost-effectiveness of simulation-based testing of SDCs software. Our evaluation concerning the usage of six ML models on two large datasets characterized by 22'652 tests showed that SDC-Scissor achieved a classification F1-score up to 96%. Moreover, our results show that SDC-Scissor outperformed a randomized baseline in identifying more failing tests per time unit. Webpage & Video: https://github.com/ChristianBirchler/sdc-scissor


title: Treedepth vs circumference

abstract: The circumference of a graph $G$ is the length of a longest cycle in $G$, or $+\infty$ if $G$ has no cycle. Birmel\'e (2003) showed that the treewidth of a graph $G$ is at most its circumference minus $1$. We strengthen this result for $2$-connected graphs as follows: If $G$ is $2$-connected, then its treedepth is at most its circumference. The bound is best possible and improves on an earlier quadratic upper bound due to Marshall and Wood (2015).


title: Schur Multipliers of $C^*$-algebras, group-invariant compactification and applications to amenability and percolation

abstract: Let $\Gamma$ be a countable discrete group. Given any sequence $(f_n)_{n\geq 1}$ of $\ell^p$-normalized functions ($p\in [1,2)$), consider the associated positive definite matrix coefficients $\langle f_n, \rho(\cdot) f_n\rangle$ of the right regular representation $\rho$. We construct an orthogonal decomposition of the corresponding {\it Schur multipliers} on the reduced group $C^*$-algebra or the uniform Roe algebra of $\Gamma$. We identify this decomposition explicitly via the limit points of the orbits $(\widetilde f_n)_{n\geq 1}$ in the group-invariant compactification of the quotient space constructed by Varadhan and the first author in [14]. We apply this result and use positive-definiteness to provide two (quite different) characterizations of amenability of $\Gamma$ -- one via a variational approach and the other using group-invariant percolation on Cayley graphs constructed by Benjamini, Lyons, Peres and Schramm [1]. These results underline, from a new point of view to the best of our knowledge, the manner in which Schur multipliers capture geometric properties of the underlying group $\Gamma$.


title: Resource Allocation for Capacity Optimization in Joint Source-Channel Coding Systems

abstract: Benefited from the advances of deep learning (DL) techniques, deep joint source-channel coding (JSCC) has shown its great potential to improve the performance of wireless transmission. However, most of the existing works focus on the DL-based transceiver design of the JSCC model, while ignoring the resource allocation problem in wireless systems. In this paper, we consider a downlink resource allocation problem, where a base station (BS) jointly optimizes the compression ratio (CR) and power allocation as well as resource block (RB) assignment of each user according to the latency and performance constraints to maximize the number of users that successfully receive their requested content with desired quality. To solve this problem, we first decompose it into two subproblems without loss of optimality. The first subproblem is to minimize the required transmission power for each user under given RB allocation. We derive the closed-form expression of the optimal transmit power by searching the maximum feasible compression ratio. The second one aims at maximizing the number of supported users through optimal user-RB pairing, which we solve by utilizing bisection search as well as Karmarka' s algorithm. Simulation results validate the effectiveness of the proposed resource allocation method in terms of the number of satisfied users with given resources.


title: Correcting for probe wandering by precession path segmentation

abstract: Precession electron diffraction has in the past few decades become a powerful technique for structure solving, strain analysis, and orientation mapping, to name a few. One of the benefits of precessing the electron beam, is increased reciprocal space resolution, albeit at a loss of spatial resolution due to an effect referred to as 'probe wandering'. Here, a new methodology of precession path segmentation is presented to counteract this effect and increase the resolution in reconstructed virtual images from scanning precession electron diffraction data. By utilizing fast pixelated electron detector technology, multiple frames are recorded for each azimuthal rotation of the beam, allowing for the probe wandering to be corrected in post-acquisition processing. Not only is there an apparent increase in the resolution of the reconstructed images, but probe wandering due to instrument misalignment is reduced, potentially easing an already difficult alignment procedure.


title: Thoughts about the utility of perturbative QCD in the cores of neutron stars

abstract: In this contribution, I discuss the utility that perturbative QCD offers in studying the matter in the cores of neutron stars. I discuss the reasons why perturbative QCD can constrain the equation of state at densities far below the densities where we can perform controlled calculations. I discuss how perturbative QCD can inform nuclear modelling of neutron stars and how it influences equation-of-state inference. And finally, I discuss the implications to the QCD phase diagram and argue that interesting features in the equation of state revealed by the QCD input may be used to argue for the existence of quark-matter cores in most massive neutron stars.


title: Magneto-optical trapping in a near-surface borehole

abstract: Borehole gravity sensing can be used in a number of applications to measure features around a well including rock-type change mapping and determination of reservoir porosity. Quantum technology gravity sensors based on atom interferometry have the ability to offer increased survey speeds and reduced need for calibration. While surface sensors have been demonstrated in real world environments, significant improvements in robustness and reductions to radial size, weight, and power consumption are required for such devices to be deployed in boreholes. To realise the first step towards the deployment of cold atom-based sensors down boreholes, we demonstrate a borehole-deployable magneto-optical trap, the core package of many cold atom-based systems. The enclosure containing the magneto-optical trap itself had an outer radius of ($60\pm0.1$) mm at its widest point and a length of ($890\pm5$) mm. This system was used to generate atom clouds at 1 m intervals in a 14 cm wide, 50 m deep borehole, to simulate an in-borehole gravity surveys are performed. During the survey the system generated on average clouds of (3.0 $\pm 0.1) \times 10^{5}$ $^{87}$Rb atoms with the standard deviation in atom number across the survey observed to be as low as $9 \times 10^{4}$.


title: Fairing-PIA: Progressive iterative approximation for fairing curve and surface generation

abstract: The fairing curves and surfaces are used extensively in geometric design, modeling, and industrial manufacturing. However, the majority of conventional fairing approaches, which lack sufficient parameters to improve fairness, are based on energy minimization problems. In this study, we develop a novel progressive-iterative approximation method for fairing curve and surface generation (fairing-PIA). Fairing-PIA is an iteration method that can generate a series of curves (surfaces) by adjusting the control points of B-spline curves (surfaces). In fairing-PIA, each control point is endowed with an individual weight. Thus, the fairing-PIA has many parameters to optimize the shapes of curves and surfaces. Not only a fairing curve (surface) can be generated globally through fairing-PIA, but also the curve (surface) can be improved locally. Moreover, we prove the convergence of the developed fairing-PIA and show that the conventional energy minimization fairing model is a special case of fairing-PIA. Finally, numerical examples indicate that the proposed method is effective and efficient.


title: DyNCA: Real-time Dynamic Texture Synthesis Using Neural Cellular Automata

abstract: Current Dynamic Texture Synthesis (DyTS) models can synthesize realistic videos. However, they require a slow iterative optimization process to synthesize a single fixed-size short video, and they do not offer any post-training control over the synthesis process. We propose Dynamic Neural Cellular Automata (DyNCA), a framework for real-time and controllable dynamic texture synthesis. Our method is built upon the recently introduced NCA models and can synthesize infinitely long and arbitrary-sized realistic video textures in real time. We quantitatively and qualitatively evaluate our model and show that our synthesized videos appear more realistic than the existing results. We improve the SOTA DyTS performance by $2\sim 4$ orders of magnitude. Moreover, our model offers several real-time video controls including motion speed, motion direction, and an editing brush tool. We exhibit our trained models in an online interactive demo that runs on local hardware and is accessible on personal computers and smartphones.


title: L3Cube-HindBERT and DevBERT: Pre-Trained BERT Transformer models for Devanagari based Hindi and Marathi Languages

abstract: The monolingual Hindi BERT models currently available on the model hub do not perform better than the multi-lingual models on downstream tasks. We present L3Cube-HindBERT, a Hindi BERT model pre-trained on Hindi monolingual corpus. Further, since Indic languages, Hindi and Marathi share the Devanagari script, we train a single model for both languages. We release DevBERT, a Devanagari BERT model trained on both Marathi and Hindi monolingual datasets. We evaluate these models on downstream Hindi and Marathi text classification and named entity recognition tasks. The HindBERT and DevBERT-based models show significant improvements over multi-lingual MuRIL, IndicBERT, and XLM-R. Based on these observations we also release monolingual BERT models for other Indic languages Kannada, Telugu, Malayalam, Tamil, Gujarati, Assamese, Odia, Bengali, and Punjabi. These models are shared at https://huggingface.co/l3cube-pune .


title: SSCFormer: Push the Limit of Chunk-wise Conformer for Streaming ASR Using Sequentially Sampled Chunks and Chunked Causal Convolution

abstract: Currently, the chunk-wise schemes are often used to make Automatic Speech Recognition (ASR) models to support streaming deployment. However, existing approaches are unable to capture the global context, lack support for parallel training, or exhibit quadratic complexity for the computation of multi-head self-attention (MHSA). On the other side, the causal convolution, no future context used, has become the de facto module in streaming Conformer. In this paper, we propose SSCFormer to push the limit of chunk-wise Conformer for streaming ASR using the following two techniques: 1) A novel cross-chunks context generation method, named Sequential Sampling Chunk (SSC) scheme, to re-partition chunks from regular partitioned chunks to facilitate efficient long-term contextual interaction within local chunks. 2)The Chunked Causal Convolution (C2Conv) is designed to concurrently capture the left context and chunk-wise future context. Evaluations on AISHELL-1 show that an End-to-End (E2E) CER 5.33% can achieve, which even outperforms a strong time-restricted baseline U2. Moreover, the chunk-wise MHSA computation in our model enables it to train with a large batch size and perform inference with linear complexity.


title: General Effective Field Theory of Teleparallel Gravity

abstract: We construct the Effective Field Theory (EFT) of the teleparallel equivalent of general relativity (TEGR). Firstly, we present the necessary field redefinitions of the scalar field and the tetrads. Then we provide all the terms at next-to-leading-order, containing the torsion tensor and its derivatives, and derivatives of the scalar field, accompanied by generic scalar-field-dependent couplings, where all operators are suppressed by a scale $\Lambda$. Removing all redundant terms using the field redefinitions we result to the EFT of TEGR, which includes significantly more terms comparing to the EFT of General Relativity. Finally, we present an application in a cosmological framework. Interestingly enough, although GR and TEGR are completely equivalent at the level of classical equations, we find that their corresponding EFTs possess minor but non-zero differences. Hence, we do verify that at higher energies the excitation and the features of the extra degrees of freedom are slightly different in the two theories, thus making them theoretically distinguishable. Nevertheless, we mention that these differences are suppressed by the heavy mass scale $\Lambda$ and thus it is not guaranteed that they could be measured in future experiments and observations.


title: Diversity of dust properties in external galaxies confirmed by polarization signals from Type II supernovae

abstract: Investigating interstellar (IS) dust properties in external galaxies is important not only to infer the intrinsic properties of astronomical objects but also to understand the star/planet formation in the galaxies. From the non-Milky-Way-like extinction and interstellar polarization (ISP) observed in reddened Type Ia supernovae (SNe), it has been suggested that their host galaxies contain dust grains whose properties are substantially different from the Milky-Way (MW) dust. It is important to investigate the universality of such non-MW-like dust in the universe. Here we report spectropolarimetry of two highly-extinguished Type II SNe (SN 2022aau and SN 2022ame). SN 2022aau shows a polarization maximum at a shorter wavelength than MW stars, which is also observed in some Type Ia SNe. This is clear evidence for the existence of non-MW-like dust in its host galaxy (i.e., NGC 1672). This fact implies that such non-MW-like dust might be more common in some environments than expected, and thus it might affect the picture of the star/planet formation. On the other hand, SN 2022ame shows MW-like ISP, implying the presence of MW-like dust in its host galaxy (i.e., NGC 1255). Our findings confirm that dust properties of galaxies are diverse, either locally or globally. The present work demonstrates that further investigation of IS dust properties in external galaxies using polarimetry of highly-reddened SNe is promising, providing a great opportunity to study the universality of such non-MW-like dust grains in the universe.


title: Breakdown of the Meissner effect at the zero exceptional point in non-Hermitian two-band BCS model

abstract: The spontaneous symmetry breaking of a continuous symmetry in complex field theory at the exceptional point of the parameter space is known to exhibit interesting phenomena, such as the breakdown of a Higgs mechanism. In this work, we derive the complex Ginzburg-Landau model from a non-Hermitian two-band BCS model via path integral and investigate its spontaneous symmetry breaking. We find that analog to the Higgs mechanism, the Meissner effect of the complex Ginzburg-Landau model also breaks down at the exceptional point while the gap parameters stay finite.


title: Blur Interpolation Transformer for Real-World Motion from Blur

abstract: This paper studies the challenging problem of recovering motion from blur, also known as joint deblurring and interpolation or blur temporal super-resolution. The challenges are twofold: 1) the current methods still leave considerable room for improvement in terms of visual quality even on the synthetic dataset, and 2) poor generalization to real-world data. To this end, we propose a blur interpolation transformer (BiT) to effectively unravel the underlying temporal correlation encoded in blur. Based on multi-scale residual Swin transformer blocks, we introduce dual-end temporal supervision and temporally symmetric ensembling strategies to generate effective features for time-varying motion rendering. In addition, we design a hybrid camera system to collect the first real-world dataset of one-to-many blur-sharp video pairs. Experimental results show that BiT has a significant gain over the state-of-the-art methods on the public dataset Adobe240. Besides, the proposed real-world dataset effectively helps the model generalize well to real blurry scenarios. Code and data are available at https://github.com/zzh-tech/BiT.


title: Modeling Hierarchical Structural Distance for Unsupervised Domain Adaptation

abstract: Unsupervised domain adaptation (UDA) aims to estimate a transferable model for unlabeled target domains by exploiting labeled source data. Optimal Transport (OT) based methods have recently been proven to be a promising solution for UDA with a solid theoretical foundation and competitive performance. However, most of these methods solely focus on domain-level OT alignment by leveraging the geometry of domains for domain-invariant features based on the global embeddings of images. However, global representations of images may destroy image structure, leading to the loss of local details that offer category-discriminative information. This study proposes an end-to-end Deep Hierarchical Optimal Transport method (DeepHOT), which aims to learn both domain-invariant and category-discriminative representations by mining hierarchical structural relations among domains. The main idea is to incorporate a domain-level OT and image-level OT into a unified OT framework, hierarchical optimal transport, to model the underlying geometry in both domain space and image space. In DeepHOT framework, an image-level OT serves as the ground distance metric for the domain-level OT, leading to the hierarchical structural distance. Compared with the ground distance of the conventional domain-level OT, the image-level OT captures structural associations among local regions of images that are beneficial to classification. In this way, DeepHOT, a unified OT framework, not only aligns domains by domain-level OT, but also enhances the discriminative power through image-level OT. Moreover, to overcome the limitation of high computational complexity, we propose a robust and efficient implementation of DeepHOT by approximating origin OT with sliced Wasserstein distance in image-level OT and accomplishing the mini-batch unbalanced domain-level OT.


title: Data Leakage and Evaluation Issues in Micro-Expression Analysis

abstract: Micro-expressions have drawn increasing interest lately due to various potential applications. The task is, however, difficult as it incorporates many challenges from the fields of computer vision, machine learning and emotional sciences. Due to the spontaneous and subtle characteristics of micro-expressions, the available training and testing data are limited, which make evaluation complex. We show that data leakage and fragmented evaluation protocols are issues among the micro-expression literature. We find that fixing data leaks can drastically reduce model performance, in some cases even making the models perform similarly to a random classifier. To this end, we go through common pitfalls, propose a new standardized evaluation protocol using facial action units with over 2000 micro-expression samples, and provide an open source library that implements the evaluation protocols in a standardized manner. Code is publicly available in \url{https://github.com/tvaranka/meb}.


title: Revealing Hidden Context Bias in Segmentation and Object Detection through Concept-specific Explanations

abstract: Applying traditional post-hoc attribution methods to segmentation or object detection predictors offers only limited insights, as the obtained feature attribution maps at input level typically resemble the models' predicted segmentation mask or bounding box. In this work, we address the need for more informative explanations for these predictors by proposing the post-hoc eXplainable Artificial Intelligence method L-CRP to generate explanations that automatically identify and visualize relevant concepts learned, recognized and used by the model during inference as well as precisely locate them in input space. Our method therefore goes beyond singular input-level attribution maps and, as an approach based on the recently published Concept Relevance Propagation technique, is efficiently applicable to state-of-the-art black-box architectures in segmentation and object detection, such as DeepLabV3+ and YOLOv6, among others. We verify the faithfulness of our proposed technique by quantitatively comparing different concept attribution methods, and discuss the effect on explanation complexity on popular datasets such as CityScapes, Pascal VOC and MS COCO 2017. The ability to precisely locate and communicate concepts is used to reveal and verify the use of background features, thereby highlighting possible biases of the model.


title: Expectation-Maximization Contrastive Learning for Compact Video-and-Language Representations

abstract: Most video-and-language representation learning approaches employ contrastive learning, e.g., CLIP, to project the video and text features into a common latent space according to the semantic similarities of text-video pairs. However, such learned shared latent spaces are not often optimal, and the modality gap between visual and textual representation can not be fully eliminated. In this paper, we propose Expectation-Maximization Contrastive Learning (EMCL) to learn compact video-and-language representations. Specifically, we use the Expectation-Maximization algorithm to find a compact set of bases for the latent space, where the features could be concisely represented as the linear combinations of these bases. Such feature decomposition of video-and-language representations reduces the rank of the latent space, resulting in increased representing power for the semantics. Extensive experiments on three benchmark text-video retrieval datasets prove that our EMCL can learn more discriminative video-and-language representations than previous methods, and significantly outperform previous state-of-the-art methods across all metrics. More encouragingly, the proposed method can be applied to boost the performance of existing approaches either as a jointly training layer or an out-of-the-box inference module with no extra training, making it easy to be incorporated into any existing methods.