title: Explainable Artificial Intelligence for Improved Modeling of Processes

abstract: In modern business processes, the amount of data collected has increased substantially in recent years. Because this data can potentially yield valuable insights, automated knowledge extraction based on process mining has been proposed, among other techniques, to provide users with intuitive access to the information contained therein. At present, the majority of technologies aim to reconstruct explicit business process models. These are directly interpretable but limited concerning the integration of diverse and real-valued information sources. On the other hand, Machine Learning (ML) benefits from the vast amount of data available and can deal with high-dimensional sources, yet it has rarely been applied to being used in processes. In this contribution, we evaluate the capability of modern Transformer architectures as well as more classical ML technologies of modeling process regularities, as can be quantitatively evaluated by their prediction capability. In addition, we demonstrate the capability of attentional properties and feature relevance determination by highlighting features that are crucial to the processes' predictive abilities. We demonstrate the efficacy of our approach using five benchmark datasets and show that the ML models are capable of predicting critical outcomes and that the attention mechanisms or XAI components offer new insights into the underlying processes.


title: Clustering What Matters: Optimal Approximation for Clustering with Outliers

abstract: Clustering with outliers is one of the most fundamental problems in Computer Science. Given a set $X$ of $n$ points and two integers $k$ and $m$, the clustering with outliers aims to exclude $m$ points from $X$ and partition the remaining points into $k$ clusters that minimizes a certain cost function. In this paper, we give a general approach for solving clustering with outliers, which results in a fixed-parameter tractable (FPT) algorithm in $k$ and $m$, that almost matches the approximation ratio for its outlier-free counterpart. As a corollary, we obtain FPT approximation algorithms with optimal approximation ratios for $k$-Median and $k$-Means with outliers in general metrics. We also exhibit more applications of our approach to other variants of the problem that impose additional constraints on the clustering, such as fairness or matroid constraints.


title: Simultaneously Transmitting and Reflecting RIS-Aided Mobile Edge Computing: Computation Rate Maximization

abstract: In this paper, the novel simultaneously transmitting and reflecting (STAR) reconfigurable intelligent surface (RIS), which enables full-space coverage on users located on both sides of the surface, is investigated in the multi-user mobile edge computing (MEC) system. A computation rate maximization problem is formulated via the joint design of the STAR-RIS phase shifts, reflection and transmission amplitude coefficients, the receive beamforming vectors at the access point, and the users' energy partition strategies for local computing and offloading. Two operating protocols of STAR-RIS, namely energy splitting (ES) and mode switching (MS) are studied. Based on DC programming and semidefinite relaxation, an iterative algorithm is proposed for the ES protocol to solve the formulated non-convex problem. Furthermore, the proposed algorithm is extended to solve the non-convex, non-continuous MS problems with binary amplitude coefficients. Simulation results show that the resultant STAR-RIS-aided MEC system significantly improves the computation rate compared to the baseline scheme with conventional reflect-only/transmit-only RIS.


title: Long-time equilibration can determine transient thermality

abstract: When two initially thermal many-body systems start interacting strongly, their transient states quickly become non-Gibbsian, even if the systems eventually equilibrate. To see beyond this apparent lack of structure during the transient regime, we use a refined notion of thermality, which we call g-local. A system is g-locally thermal if the states of all its small subsystems are marginals of global thermal states. We numerically demonstrate for two harmonic lattices that whenever the total system equilibrates in the long run, each lattice remains g-locally thermal at all times, including the transient regime. This is true even when the lattices have long-range interactions within them. In all cases, we find that the equilibrium is described by the generalized Gibbs ensemble, with three-dimensional lattices requiring special treatment due to their extended set of conserved charges. We compare our findings with the well-known two-temperature model. While its standard form is not valid beyond weak coupling, we show that at strong coupling it can be partially salvaged by adopting the concept of a g-local temperature.


title: Game Implementation: What Are the Obstructions?

abstract: In many applications, we want to influence the decisions of independent agents by designing incentives for their actions. We revisit a fundamental problem in this area, called GAME IMPLEMENTATION: Given a game in standard form and a set of desired strategies, can we design a set of payment promises such that if the players take the payment promises into account, then all undominated strategies are desired? Furthermore, we aim to minimize the cost, that is, the worst-case amount of payments. We study the tractability of computing such payment promises and determine more closely what obstructions we may have to overcome in doing so. We show that GAME IMPLEMENTATION is NP-hard even for two players, solving in particular a long open question (Eidenbenz et al. 2011) and suggesting more restrictions are necessary to obtain tractability results. We thus study the regime in which players have only a small constant number of strategies and obtain the following. First, this case remains NP-hard even if each player's utility depends only on three others. Second, we repair a flawed efficient algorithm for the case of both small number of strategies and small number of players. Among further results, we characterize sets of desired strategies that can be implemented at zero cost as a kind of stable core of the game.


title: High Dimensional Binary Classification under Label Shift: Phase Transition and Regularization

abstract: Label Shift has been widely believed to be harmful to the generalization performance of machine learning models. Researchers have proposed many approaches to mitigate the impact of the label shift, e.g., balancing the training data. However, these methods often consider the underparametrized regime, where the sample size is much larger than the data dimension. The research under the overparametrized regime is very limited. To bridge this gap, we propose a new asymptotic analysis of the Fisher Linear Discriminant classifier for binary classification with label shift. Specifically, we prove that there exists a phase transition phenomenon: Under certain overparametrized regime, the classifier trained using imbalanced data outperforms the counterpart with reduced balanced data. Moreover, we investigate the impact of regularization to the label shift: The aforementioned phase transition vanishes as the regularization becomes strong.


title: Loop zero forcing and grundy domination in planar graphs and claw-free cubic graphs

abstract: Given a simple, finite graph with vertex set $V(G)$, we define a zero forcing set of $G$ as follows. Choose $S\subseteq V(G)$ and color all vertices of $S$ blue and all vertices in $V(G) - S$ white. The color change rule is if $w$ is the only white neighbor of blue vertex $v$, then we change the color of $w$ from white to blue. If after applying the color change rule as many times as possible eventually every vertex of $G$ is blue, we call $S$ a zero forcing set of $G$. $Z(G)$ denotes the minimum cardinality of a zero forcing set. Davila and Henning proved in \cite{zerocubic} that for any claw-free cubic graph $G$, $Z(G) \le \frac{1}{3}|V(G)| + 1$. We show that if $G$ is $2$-edge-connected, claw-free, and cubic, then $Z(G) \le \left\lceil\frac{5n(G)}{18}\right\rceil+1$. We also study a similar graph invariant known as the loop zero forcing number of a graph $G$ which happens to be the dual invariant to the Grundy domination number of $G$. Specifically, we study the loop zero forcing number in two particular types of planar graphs.


title: Bespoke Pulse Design for Robust Rapid Two-Qubit Gates with Trapped Ions

abstract: Two-qubit gate performance is vital for scaling up ion-trap quantum computing. Optimized quantum control is needed to achieve reductions in gate-time and gate error-rate. We describe two-qubit gates with addressed Raman beams within a linear trapped-ion chain by a quantum master equation (QME). The QME incorporates the single-ion two-photon effective Rabi frequency, Autler-Townes and vibrational Bloch-Siegert energy shifts, off-resonant transitions, Raman and Rayleigh scattering, laser-power fluctuations, motional heating, cross-Kerr phonon coupling, laser spillover, asymmetric addressing beams and an imperfect initial motional ground state, with no fitting parameters. Whereas state-of-the-art methods are oblivious to these effects in the gate design procedure. We employ global optimization to design pulse sequences for achieving a robust rapid two-qubit gate for seven trapped $^{171}$Yb$^{+}$ ions by optimizing over numerically integrated QME solutions. Here, robust means resilient against slow drift of motional frequencies, and rapid means gate execution where the effective Rabi frequency is comparable to the detuning of the laser from the ion's bare electronic transition. Our robust quantum control delivers rapid high-quality two-qubit gates in long ion chains, enabling scalable quantum computing with trapped ions.


abstract: Modern data collection in many data paradigms, including bioinformatics, often incorporates multiple traits derived from different data types (i.e. platforms). We call this data multi-block, multi-view, or multi-omics data. The emergent field of data integration develops and applies new methods for studying multi-block data and identifying how different data types relate and differ. One major frontier in contemporary data integration research is methodology that can identify partially-shared structure between sub-collections of data types. This work presents a new approach: Data Integration Via Analysis of Subspaces (DIVAS). DIVAS combines new insights in angular subspace perturbation theory with recent developments in matrix signal processing and convex-concave optimization into one algorithm for exploring partially-shared structure. Based on principal angles between subspaces, DIVAS provides built-in inference on the results of the analysis, and is effective even in high-dimension-low-sample-size (HDLSS) situations.


title: Tensor category $KL_k(\mathfrak{sl}_{2n})$ via minimal affine $W$-algebras at the non-admissible level $k =-\frac{2n+1}{2}$

abstract: We prove that $KL_k(\mathfrak{sl}_m)$ is a semi-simple, rigid braided tensor category for all even $m\ge 4$, and $k= -\frac{m+1}{2}$ which generalizes result from arXiv:2103.02985 obtained for $m=4$. Moreover, all modules in $KL_k(\mathfrak{sl}_m)$ are simple-currents and they appear in the decomposition of conformal embeddings $\mathfrak{gl}_m \hookrightarrow \mathfrak{sl}_{m+1} $ at level $ k= - \frac{m+1}{2}$ from arXiv:1509.06512. For this we inductively identify minimal affine $W$-algebra $ W_{k-1} (\mathfrak{sl}_{m+2}, \theta)$ as simple current extension of $L_{k}(\mathfrak{sl}_m) \otimes \mathcal H \otimes \mathcal M$, where $\mathcal H$ is the rank one Heisenberg vertex algebra, and $\mathcal M$ the singlet vertex algebra for $c=-2$. The proof uses previously obtained results for the tensor categories of singlet algebra from arXiv:2202.05496. We also classify all irreducible ordinary modules for $ W_{k-1} (\mathfrak{sl}_{m+2}, \theta)$. The semi-simple part of the category of $ W_{k-1} (\mathfrak{sl}_{m+2}, \theta)$-modules comes from $KL_{k-1}(\mathfrak{sl}_{m+2})$, using quantum Hamiltonian reduction, but this $W$-algebra also contains indecomposable ordinary modules.


title: Inertial evolution of non-linear viscoelastic solids in the face of (self-)collision

abstract: We study the time evolution of non-linear viscoelastic solids in the presence of inertia and (self-)contact. For this problem we prove the existence of weak solutions for arbitrary times and initial data, thereby solving an open problem in the field. Our construction directly includes the physically correct, measure-valued contact forces and thus obeys conservation of momentum and an energy balance. In particular, we prove an independently useful compactness result for contact forces.


title: Optimal Control in Stochastic Thermodynamics

abstract: We review recent progress in optimal control in stochastic thermodynamics. Theoretical advances provide in-depth insight into minimum-dissipation control with either full or limited (parametric) control, and spanning the limits from slow to fast driving and from weak to strong driving. Known exact solutions give a window into the properties of minimum-dissipation control, which are reproduced by approximate methods in the relevant limits. Connections between optimal-transport theory and minimum-dissipation protocols under full control give deep insight into the properties of optimal control and place bounds on the dissipation of thermodynamic processes. Since minimum-dissipation protocols are relatively well understood and advanced approximation methods and numerical techniques for estimating minimum-dissipation protocols have been developed, now is an opportune time for application to chemical and biological systems.


title: Emergent Symmetry in Quantum Phase Transitions: From Deconfined Quantum Critical Point to Gapless Quantum Spin Liquid

abstract: The emergence of exotic quantum phenomena in frustrated magnets is rapidly driving the development of quantum many-body physics, raising fundamental questions on the nature of quantum phase transitions. Here we unveil the behaviour of emergent symmetry involving two extraordinarily representative phenomena, i.e., the deconfined quantum critical point (DQCP) and the quantum spin liquid (QSL) state. Via large-scale tensor network simulations, we study a spatially anisotropic spin-1/2 square-lattice frustrated antiferromagnetic (AFM) model, namely the $J_{1x}$-$J_{1y}$-$J_2$ model, which contains anisotropic nearest-neighbor couplings $J_{1x}$, $J_{1y}$ and the next nearest neighbor coupling $J_2$. For small $J_{1y}/J_{1x}$, by tuning $J_2$, a direct continuous transition between the AFM and valence bond solid phase is observed.(Of course, the possibility of weakly first order transition can not be fully excluded.) With growing $J_{1y}/J_{1x}$, a gapless QSL phase gradually emerges between the AFM and VBS phases. We observe an emergent O(4) symmetry along the AFM--VBS transition line, which is consistent with the prediction of DQCP theory. Most surprisingly, we find that such an emergent O(4) symmetry holds for the whole QSL--VBS transition line as well. These findings reveal the intrinsic relationship between the QSL and DQCP from categorical symmetry point of view, and strongly constrain the quantum field theory description of the QSL phase. The phase diagram and critical exponents presented in this paper are of direct relevance to future experiments on frustrated magnets and cold atom systems.


title: The spectral form of the functional model for maximally dissipative operators: A Lagrange identity approach

abstract: The spectral and scattering properties of non-selfadjoint problems pose a mathematical challenge. Apart from exceptional cases, the well-developed methods used to examine the spectrum of selfadjoint problems are not applicable. One of the tools to attack non-selfadjoint problems are functional models. A drawback of many functional models is that their constructions require objects which may be difficult to describe explicitly, such as operator square roots, making it hard to apply the results to specific examples. We develop a functional model for the case when the non-selfadjointness arises both in additive terms and in the boundary conditions which is based on the Lagrange identity. The flexibility of the choice of the $\Gamma$-operators in the Lagrange identity means that these can be chosen so that expressions arising in the model are given explicitly in terms of physical parameters (coefficients, boundary conditions and Titchmarsh-Weyl $M$-function) of the maximally dissipative operator. The presentation of such explicit expressions for the spectral form of the functional model is arguably the main contribution of the present paper. In the spectral form of the functional model, the selfadjoint dilation is very simple, being the operator of multiplication by an independent variable in some auxiliary vector-valued function space. We also obtain an explicit expression for the completely non-selfadjoint part of the operator and an operator-analytic proof of the famous result by Sz.-Nagy-Foias on the pure absolute continuity of the spectrum of the minimal selfadjoint dilation. Finally, we consider an example of a limit circle Sturm-Liouville operator.


title: Emergent gravity from the IIB matrix model and cancellation of a cosmological constant

abstract: We review a cosmological model where the metric determinant plays a dynamical role and present new numerical results on the cancellation of the vacuum energy density including the contribution of a cosmological constant. The action of this model is only invariant under restricted coordinate transformations with unit Jacobian (the same restriction appears in the well-known unimodular-gravity approach to the cosmological constant problem). As to the possible origin of the nonstandard terms in the matter action of the model, we show that these terms can, in principle, arise from the emergent gravity in the IIB matrix model, a nonperturbative formulation of superstring theory.


title: Fully On-board Low-Power Localization with Multizone Time-of-Flight Sensors on Nano-UAVs

abstract: Nano-size unmanned aerial vehicles (UAVs) hold enormous potential to perform autonomous operations in complex environments, such as inspection, monitoring or data collection. Moreover, their small size allows safe operation close to humans and agile flight. An important part of autonomous flight is localization, which is a computationally intensive task especially on a nano-UAV that usually has strong constraints in sensing, processing and memory. This work presents a real-time localization approach with low element-count multizone range sensors for resource-constrained nano-UAVs. The proposed approach is based on a novel miniature 64-zone time-of-flight sensor from ST Microelectronics and a RISC-V-based parallel ultra low-power processor, to enable accurate and low latency Monte Carlo Localization on-board. Experimental evaluation using a nano-UAV open platform demonstrated that the proposed solution is capable of localizing on a 31.2m$\boldsymbol{^2}$ map with 0.15m accuracy and an above 95% success rate. The achieved accuracy is sufficient for localization in common indoor environments. We analyze tradeoffs in using full and half-precision floating point numbers as well as a quantized map and evaluate the accuracy and memory footprint across the design space. Experimental evaluation shows that parallelizing the execution for 8 RISC-V cores brings a 7x speedup and allows us to execute the algorithm on-board in real-time with a latency of 0.2-30ms (depending on the number of particles), while only increasing the overall drone power consumption by 3-7%. Finally, we provide an open-source implementation of our approach.


title: SMEFT truncation effects in Higgs boson pair production at NLO QCD

abstract: We present results for Higgs boson pair production in gluon fusion at next-to-leading order in QCD, including effects of anomalous couplings within Standard Model Effective Field Theory (SMEFT). In particular, we investigate truncation effects of the SMEFT series, comparing different ways to treat powers of dimension-six operators and double operator insertions.


title: Nonlinear and Machine Learning Analyses on High-Density EEG data of Math Experts and Novices

abstract: Current trend in neurosciences is to use naturalistic stimuli, such as cinema, class-room biology or video gaming, aiming to understand the brain functions during ecologically valid conditions. Naturalistic stimuli recruit complex and overlapping cognitive, emotional and sensory brain processes. Brain oscillations form underlying mechanisms for such processes, and further, these processes can be modified by expertise. Human cortical oscillations are often analyzed with linear methods despite brain as a biological system is highly nonlinear. This study applies a relatively robust nonlinear method, Higuchi fractal dimension (HFD), to classify cortical oscillations of math experts and novices when they solve long and complex math demonstrations in an EEG laboratory. Brain imaging data, which is collected over a long time span during naturalistic stimuli, enables the application of data-driven analyses. Therefore, we also explore the neural signature of math expertise with machine learning algorithms. There is a need for novel methodologies in analyzing naturalistic data because formulation of theories of the brain functions in the real world based on reductionist and simplified study designs is both challenging and questionable. Data-driven intelligent approaches may be helpful in developing and testing new theories on complex brain functions. Our results clarify the different neural signature, analyzed by HFD, of math experts and novices during complex math and suggest machine learning as a promising data-driven approach to understand the brain processes in expertise and mathematical cognition.


title: Analytic, Differentiable and Measurable Diagonalizations in Symmetric Lie Algebras

abstract: We generalize several important results from the perturbation theory of linear operators to the setting of semisimple orthogonal symmetric Lie algebras. These Lie algebras provide a unifying framework for various notions of matrix diagonalization, such as the eigenvalue decomposition of real symmetric or complex Hermitian matrices, and the real or complex singular value decomposition. Concretely, given a path of structured matrices with a certain smoothness, we study what kind of smoothness one can obtain for the corresponding diagonalization of the matrices.


title: A Graph Neural Networks based Framework for Topology-Aware Proactive SLA Management in a Latency Critical NFV Application Use-case

abstract: Recent advancements in the rollout of 5G and 6G have led to the emergence of a new range of latency-critical applications delivered via a Network Function Virtualization (NFV) enabled paradigm of flexible and softwarized communication networks. Evolving verticals like telecommunications, smart grid, virtual reality (VR), industry 4.0, automated vehicles, etc. are driven by the vision of low latency and high reliability, and there is a wide gap to efficiently bridge the Quality of Service (QoS) constraints for both the service providers and the end-user. In this work, we look to tackle the over-provisioning of latency-critical services by proposing a proactive SLA management framework leveraging Graph Neural Networks (GNN) and Deep Reinforcement Learning (DRL) to balance the trade-off between efficiency and reliability. To summarize our key contributions: 1) we compose a graph-based spatio-temporal multivariate time-series forecasting model with multiple time-step predictions in a multi-output scenario, delivering 74.62% improved performance over the established baseline state-of-art model on the use-case; and 2) we leverage realistic SLA definitions for the use-case to achieve a dynamic SLA-aware oversight for scaling policy management with DRL.


title: What do you MEME? Generating Explanations for Visual Semantic Role Labelling in Memes

abstract: Memes are powerful means for effective communication on social media. Their effortless amalgamation of viral visuals and compelling messages can have far-reaching implications with proper marketing. Previous research on memes has primarily focused on characterizing their affective spectrum and detecting whether the meme's message insinuates any intended harm, such as hate, offense, racism, etc. However, memes often use abstraction, which can be elusive. Here, we introduce a novel task - EXCLAIM, generating explanations for visual semantic role labeling in memes. To this end, we curate ExHVV, a novel dataset that offers natural language explanations of connotative roles for three types of entities - heroes, villains, and victims, encompassing 4,680 entities present in 3K memes. We also benchmark ExHVV with several strong unimodal and multimodal baselines. Moreover, we posit LUMEN, a novel multimodal, multi-task learning framework that endeavors to address EXCLAIM optimally by jointly learning to predict the correct semantic roles and correspondingly to generate suitable natural language explanations. LUMEN distinctly outperforms the best baseline across 18 standard natural language generation evaluation metrics. Our systematic evaluation and analyses demonstrate that characteristic multimodal cues required for adjudicating semantic roles are also helpful for generating suitable explanations.


title: Using Gradient to Boost the Generalization Performance of Deep Learning Models for Fluid Dynamics

abstract: Nowadays, Computational Fluid Dynamics (CFD) is a fundamental tool for industrial design. However, the computational cost of doing such simulations is expensive and can be detrimental for real-world use cases where many simulations are necessary, such as the task of shape optimization. Recently, Deep Learning (DL) has achieved a significant leap in a wide spectrum of applications and became a good candidate for physical systems, opening perspectives to CFD. To circumvent the computational bottleneck of CFD, DL models have been used to learn on Euclidean data, and more recently, on non-Euclidean data such as unstuctured grids and manifolds, allowing much faster and more efficient (memory, hardware) surrogate models. Nevertheless, DL presents the intrinsic limitation of extrapolating (generalizing) out of training data distribution (design space). In this study, we present a novel work to increase the generalization capabilities of Deep Learning. To do so, we incorporate the physical gradients (derivatives of the outputs w.r.t. the inputs) to the DL models. Our strategy has shown good results towards a better generalization of DL networks and our methodological/ theoretical study is corroborated with empirical validation, including an ablation study.


title: Excess shear force exerted on oscillating plate due to a nearby particle

abstract: In the present paper we theoretically study the shear force exerted on an infinite horizontal plane undergoing fast lateral oscillations in presence of a rigid particle suspended in the viscous liquid above the plate. The study is largely motivated by Quartz Crystal Microbalance (QCM-D) technique which relies on analyzing response (complex impedance) of fast oscillating (in MHz range) quartz crystal disk in the liquid medium due to small substances adsorbed at its surface. In fact, small substances suspended in the liquid medium in the vicinity of the oscillating crystal may also contribute to impedance, as they modify the local shear force the suspending liquid exerts on the quartz crystal. For a dilute suspension the contributions of individual particles are additive and, therefore, our analysis is restricted to the excess shear force due a single spherical particle located at arbitrary distance above the plane. Three distinct cases are considered: (i) limiting case of high solid inertia, whereas the heavy particle can be considered as stationary; (ii) a freely suspended particle of arbitrary mass, undergoing fluid-mediated time-periodic rotation and translation and (iii) an adsorbed particle moving with the plate as a whole without rotation. For small-amplitude plane oscillations the unsteady Stokes flow equations apply. We construct the series solution of these equations using the method of reflections, whereas its terms are written explicitly. Due to the exponential decay of the flow away from the oscillating plate, the truncated series containing only few low-order terms shows an excellent agreement with the rigorous numerical results for a wide range of particle sizes and separation distances. The present results support the notion that the hydrodynamic contribution of the suspended small substances to the measured impedance is non-negligible or even dominant.


title: Direct Numerical Simulation of Turbulent Open Channel Flow

abstract: Direct numerical simulations of turbulent open channel flow with friction Reynolds numbers of $Re_{\tau}=200,400,600$ are performed. Their results are compared with closed channel data in order to investigate the influence of the free surface on turbulent channel flows. The free surface affects fully developed turbulence statistics in so far that velocities and vorticities become highly anisotropic as they approach it. While the vorticity anisotropy layer scales in wall units, the velocity one is found to scale ith outer flow units and exhibits much larger extension. Furthermore the influence of the free surface on coherent very large-scale motions (VLSM) is discussed through spectral statistics. It is found that the spanwise extension increases by a factor of two compared to closed channel flows independent of the Reynolds number. Finally instantaneous realizations of the flow fields are investigated in order to elucidate the turbulent mechanisms, which are responsible for the behaviour of a free surface in channel flows.


title: ML framework for global river flood predictions based on the Caravan dataset

abstract: Reliable prediction of river floods in the first 72 hours can reduce harm because emergency agencies have sufficient time to prepare and deploy for help at the scene. Such river flood prediction models already exist and perform relatively well in most high-income countries. But, due to the limited availability of data, these models are lacking in low-income countries. Here, we offer the first global river flood prediction framework based on the newly published Caravan dataset. Our framework aims to serve as a benchmark for future global river flood prediction research. To support generalizability claims we include custom data evaluation splits. Further, we propose and evaluate a novel two-path LSTM architecture (2P-LSTM) against three baseline models. Finally, we evaluate the generated models on different locations in Africa and Asia that were not part of the Caravan dataset.


title: A Stable, Fast, and Fully Automatic Learning Algorithm for Predictive Coding Networks

abstract: Predictive coding networks are neuroscience-inspired models with roots in both Bayesian statistics and neuroscience. Training such models, however, is quite inefficient and unstable. In this work, we show how by simply changing the temporal scheduling of the update rule for the synaptic weights leads to an algorithm that is much more efficient and stable than the original one, and has theoretical guarantees in terms of convergence. The proposed algorithm, that we call incremental predictive coding (iPC) is also more biologically plausible than the original one, as it it fully automatic. In an extensive set of experiments, we show that iPC constantly performs better than the original formulation on a large number of benchmarks for image classification, as well as for the training of both conditional and masked language models, in terms of test accuracy, efficiency, and convergence with respect to a large set of hyperparameters.


title: High fusion computers: The IoTs, edges, data centers, and humans-in-the-loop as a computer

abstract: Emerging and future applications rely heavily upon systems consisting of Internet of Things (IoT), edges, data centers, and humans-in-the-loop. Significantly different from warehouse-scale computers that serve independent concurrent user requests, this new class of computer systems directly interacts with the physical world, considering humans an essential part and performing safety-critical and mission-critical operations; their computations have intertwined dependencies between not only adjacent execution loops but also actions or decisions triggered by IoTs, edge, datacenters, or humans-in-the-loop; the systems must first satisfy the accuracy metric in predicting, interpreting, or taking action before meeting the performance goal under different cases. This article argues we need a paradigm shift to reconstruct the IoTs, edges, data centers, and humans-in-the-loop as a computer rather than a distributed system. We coin a new term, high fusion computers (HFCs), to describe this class of systems. The fusion in the term has two implications: fusing IoTs, edges, data centers, and humans-in-the-loop as a computer, fusing the physical and digital worlds through HFC systems. HFC is a pivotal case of the open-source computer systems initiative. We laid out the challenges, plan, and call for uniting our community's wisdom and actions to address the HFC challenges. Everything, including the source code, will be publicly available from the project homepage: https://www.computercouncil.org/HFC/.


title: Universality of the Weinberg theorem using helicity constraints

abstract: The factorisation of scattering amplitude is described by the Weinberg theorem. In this talk, we will show the universality of the theorem at the next leading correction of the soft expansion. For that we will derive the soft operator by solving helicity constraint relations.


title: Target-centered Subject Transfer Framework for EEG Data Augmentation

abstract: Data augmentation approaches are widely explored for the enhancement of decoding electroencephalogram signals. In subject-independent brain-computer interface system, domain adaption and generalization are utilized to shift source subjects' data distribution to match the target subject as an augmentation. However, previous works either introduce noises (e.g., by noise addition or generation with random noises) or modify target data, thus, cannot well depict the target data distribution and hinder further analysis. In this paper, we propose a target-centered subject transfer framework as a data augmentation approach. A subset of source data is first constructed to maximize the source-target relevance. Then, the generative model is applied to transfer the data to target domain. The proposed framework enriches the explainability of target domain by adding extra real data, instead of noises. It shows superior performance compared with other data augmentation methods. Extensive experiments are conducted to verify the effectiveness and robustness of our approach as a prosperous tool for further research.


title: SWL-Adapt: An Unsupervised Domain Adaptation Model with Sample Weight Learning for Cross-User Wearable Human Activity Recognition

abstract: In practice, Wearable Human Activity Recognition (WHAR) models usually face performance degradation on the new user due to user variance. Unsupervised domain adaptation (UDA) becomes the natural solution to cross-user WHAR under annotation scarcity. Existing UDA models usually align samples across domains without differentiation, which ignores the difference among samples. In this paper, we propose an unsupervised domain adaptation model with sample weight learning (SWL-Adapt) for cross-user WHAR. SWL-Adapt calculates sample weights according to the classification loss and domain discrimination loss of each sample with a parameterized network. We introduce the meta-optimization based update rule to learn this network end-to-end, which is guided by meta-classification loss on the selected pseudo-labeled target samples. Therefore, this network can fit a weighting function according to the cross-user WHAR task at hand, which is superior to existing sample differentiation rules fixed for special scenarios. Extensive experiments on three public WHAR datasets demonstrate that SWL-Adapt achieves the state-of-the-art performance on the cross-user WHAR task, outperforming the best baseline by an average of 3.1% and 5.3% in accuracy and macro F1 score, respectively.


title: High Performance Computing and Computational Intelligence Applications with MultiChaos Perspective

abstract: The experience of the COVID-19 pandemic, which has accelerated many chaotic processes in modern society, has highlighted in a very serious and urgent way the need to understand complex processes in order to achieve the common well-being. Modern High performance computing technologies, Quantum Computing, Computational Intelligence are shown to be extremely efficient and useful in safeguarding the fate of mankind. These technologies are the state of the art of IT evolution and are fundamental to be competitive and efficient today. If a company is familiar with these techniques and technologies, will be able to deal with any unexpected and complicated scenario more efficiently and effectively. The main contribution of our work is a set of best practices and case studies that can help the researcher address computationally complex problems. We offer a range of software technologies, from high performance computing to machine learning and quantum computing, which represent today the state of the art to deal with extremely complex computational issues, driven by chaotic events and not easily predictable. In this chapter we analyse the different technologies and applications that will lead mankind to overcome this difficult moment, as well as to understand more and more deeply the profound aspects of very complex phenomena. In this environment of rising complexity, both in terms of technology, algorithms, and changing lifestyles, it is critical to emphasize the importance of achieving maximum efficiency and outcomes while protecting the integrity of everyone's personal data and respecting the human being as a whole.


title: Predicting Digital Asset Prices using Natural Language Processing: a survey

abstract: Blockchain technology has changed how people think about how they used to store and trade their assets, as it introduced us to a whole new way to transact: using digital currencies. One of the major innovations of blockchain technology is decentralization, meaning that traditional financial intermediaries, such as asset-backed security issuers and banks, are eliminated in the process. Even though blockchain technology has been utilized in a wide range of industries, its most prominent application is still cryptocurrencies, with Bitcoin being the first proposed. At its peak in 2021, the market cap for Bitcoin once surpassed 1 trillion US dollars. The open nature of the crypto market poses various challenges and concerns for both potential retail investors and institutional investors, as the price of the investment is highly volatile, and its fluctuations are unpredictable. The rise of Machine Learning, and Natural Language Processing, in particular, has shed some light on monitoring and predicting the price behaviors of cryptocurrencies. This paper aims to review and analyze the recent efforts in applying Machine Learning and Natural Language Processing methods to predict the prices and analyze the behaviors of digital assets such as Bitcoin and Ethereum.


title: Adversarial Artifact Detection in EEG-Based Brain-Computer Interfaces

abstract: Machine learning has achieved great success in electroencephalogram (EEG) based brain-computer interfaces (BCIs). Most existing BCI research focused on improving its accuracy, but few had considered its security. Recent studies, however, have shown that EEG-based BCIs are vulnerable to adversarial attacks, where small perturbations added to the input can cause misclassification. Detection of adversarial examples is crucial to both the understanding of this phenomenon and the defense. This paper, for the first time, explores adversarial detection in EEG-based BCIs. Experiments on two EEG datasets using three convolutional neural networks were performed to verify the performances of multiple detection approaches. We showed that both white-box and black-box attacks can be detected, and the former are easier to detect.


title: On the Effective Usage of Priors in RSS-based Localization

abstract: In this paper, we study the localization problem in dense urban settings. In such environments, Global Navigation Satellite Systems fail to provide good accuracy due to low likelihood of line-of-sight (LOS) links between the receiver (Rx) to be located and the satellites, due to the presence of obstacles like the buildings. Thus, one has to resort to other technologies, which can reliably operate under non-line-of-sight (NLOS) conditions. Recently, we proposed a Received Signal Strength (RSS) fingerprint and convolutional neural network-based algorithm, LocUNet, and demonstrated its state-of-the-art localization performance with respect to the widely adopted k-nearest neighbors (kNN) algorithm, and to state-of-the-art time of arrival (ToA) ranging-based methods. In the current work, we first recognize LocUNet's ability to learn the underlying prior distribution of the Rx position or Rx and transmitter (Tx) association preferences from the training data, and attribute its high performance to these. Conversely, we demonstrate that classical methods based on probabilistic approach, can greatly benefit from an appropriate incorporation of such prior information. Our studies also numerically prove LocUNet's close to optimal performance in many settings, by comparing it with the theoretically optimal formulations.


title: Edge Deep Learning Enabled Freezing of Gait Detection in Parkinson's Patients

abstract: This paper presents the design of a wireless sensor network for detecting and alerting the freezing of gait (FoG) symptoms in patients with Parkinson's disease. Three sensor nodes, each integrating a 3-axis accelerometer, can be placed on a patient at ankle, thigh, and truck. Each sensor node can independently detect FoG using an on-device deep learning (DL) model, featuring a squeeze and excitation convolutional neural network (CNN). In a validation using a public dataset, the prototype developed achieved a FoG detection sensitivity of 88.8% and an F1 score of 85.34%, using less than 20 k trainable parameters per sensor node. Once FoG is detected, an auditory signal will be generated to alert users, and the alarm signal will also be sent to mobile phones for further actions if needed. The sensor node can be easily recharged wirelessly by inductive coupling. The system is self-contained and processes all user data locally without streaming data to external devices or the cloud, thus eliminating the cybersecurity risks and power penalty associated with wireless data transmission. The developed methodology can be used in a wide range of applications.


title: Smart City Drivers and Challenges in Urban-Mobility, Health-Care, and Interdependent Infrastructure Systems

abstract: At the turn of the 21st century, urban development has experienced a paradigm shift so that the quest for smarter cities has become a priority agenda, with the direct participation of industry, policymakers, practitioners, and the scientific community alike. The 2008 financial crisis, the exodus from rural areas, and the densification of urban centers coupled with environmental and sustainability concerns have posed enormous challenges to municipalities all over the globe. The United Nations predicts that the world population will reach 9.8 billion by 2050, a growth of 2.1 billion from the 2018 level. Almost all of this population growth will occur in urban areas and, consequently, stress already overloaded transportation systems.


title: FuRPE: Learning Full-body Reconstruction from Part Experts

abstract: In the field of full-body reconstruction, the scarcity of annotated data often impedes the efficacy of prevailing methods. To address this issue, we introduce FuRPE, a novel framework that employs part-experts and an ingenious pseudo ground-truth selection scheme to derive high-quality pseudo labels. These labels, central to our approach, equip our network with the capability to efficiently learn from the available data. Integral to FuRPE is a unique exponential moving average training strategy and expert-derived feature distillation strategy. These novel elements of FuRPE not only serve to further refine the model but also to reduce potential biases that may arise from inaccuracies in pseudo labels, thereby optimizing the network's training process and enhancing the robustness of the model. We apply FuRPE to train both two-stage and fully convolutional single-stage full-body reconstruction networks. Our exhaustive experiments on numerous benchmark datasets illustrate a substantial performance boost over existing methods, underscoring FuRPE's potential to reshape the state-of-the-art in full-body reconstruction.


title: An improved synthetic signal injection routine for the Haloscope At Yale Sensitive To Axion Cold dark matter (HAYSTAC)

abstract: Microwave cavity haloscopes are among the most sensitive direct detection experiments searching for dark matter axions via their coupling to photons. When the power of the expected microwave signal due to axion-photon conversion is on the order of $10^{-24}$~W, having the ability to validate the detector response and analysis procedure by injecting realistic synthetic axion signals becomes helpful. Here we present a method based on frequency hopping spread spectrum for synthesizing axion signals in a microwave cavity haloscope experiment. It allows us to generate a narrow and asymmetric shape in frequency space that mimics an axion's spectral distribution, which is derived from a Maxwell-Boltzmann distribution. In addition, we show that the synthetic axion's power can be calibrated with reference to the system noise. Compared to the synthetic axion injection in HAYSTAC phase I, we demonstrated synthetic signal injection with a more realistic lineshape and calibrated power.


title: First Light: Switching on Stars at the Dawn of Time

abstract: The Era of the First Stars is one of the last unknown frontiers for exploration: a poorly understood billion years missing from our cosmological timeline. We have now developed several methods for finally filling in the lost billion years of the history of our Universe: stellar archaeology, detecting primordial hydrogen using 21 cm cosmological emission, and observing the earliest galaxies, most recently using the James Webb Space Telescope. This review will summarise why the first stars and galaxies are unique and worthy of observation, and the methods employed by the groundbreaking telescopes aiming to detect them.


title: Interaction-driven transport of dark excitons in 2D semiconductors with phonon-mediated optical readout

abstract: The growing field of quantum information technology requires propagation of information over long distances with efficient readout mechanisms. Excitonic quantum fluids have emerged as a powerful platform for this task due to their straightforward electro-optical conversion. In two-dimensional transition metal dichalcogenides, the coupling between spin and valley provides exciting opportunities for harnessing, manipulating and storing bits of information. However, the large inhomogeneity of single layers cannot be overcome by the properties of bright excitons, hindering spin-valley transport. Nonetheless, the rich band structure supports dark excitonic states with strong binding energy and longer lifetime, ideally suited for long-range transport. Here we show that dark excitons can diffuse over several micrometers and prove that this repulsion-driven propagation is robust across non-uniform samples. The long-range propagation of dark states with an optical readout mediated by chiral phonons provides a new concept of excitonic devices for applications in both classical and quantum information technology.


title: xTrimoABFold: De novo Antibody Structure Prediction without MSA

abstract: In the field of antibody engineering, an essential task is to design a novel antibody whose paratopes bind to a specific antigen with correct epitopes. Understanding antibody structure and its paratope can facilitate a mechanistic understanding of its function. Therefore, antibody structure prediction from its sequence alone has always been a highly valuable problem for de novo antibody design. AlphaFold2, a breakthrough in the field of structural biology, provides a solution to predict protein structure based on protein sequences and computationally expensive coevolutionary multiple sequence alignments (MSAs). However, the computational efficiency and undesirable prediction accuracy of antibodies, especially on the complementarity-determining regions (CDRs) of antibodies limit their applications in the industrially high-throughput drug design. To learn an informative representation of antibodies, we employed a deep antibody language model (ALM) on curated sequences from the observed antibody space database via a transformer model. We also developed a novel model named xTrimoABFold to predict antibody structure from antibody sequence based on the pretrained ALM as well as efficient evoformers and structural modules. The model was trained end-to-end on the antibody structures in PDB by minimizing the ensemble loss of domain-specific focal loss on CDR and the frame-aligned point loss. xTrimoABFold outperforms AlphaFold2 and other protein language model based SOTAs, e.g., OmegaFold, HelixFold-Single, and IgFold with a large significant margin (30+\% improvement on RMSD) while performing 151 times faster than AlphaFold2. To the best of our knowledge, xTrimoABFold achieved state-of-the-art antibody structure prediction. Its improvement in both accuracy and efficiency makes it a valuable tool for de novo antibody design and could make further improvements in immuno-theory.


title: An exponentially-growing family of universal quantum circuits

abstract: Quantum machine learning has become an area of growing interest but has certain theoretical and hardware-specific limitations. Notably, the problem of vanishing gradients, or barren plateaus, renders the training impossible for circuits with high qubit counts, imposing a limit on the number of qubits that data scientists can use for solving problems. Independently, angle-embedded supervised quantum neural networks were shown to produce truncated Fourier series with a degree directly dependent on two factors: the depth of the encoding and the number of parallel qubits the encoding applied to. The degree of the Fourier series limits the model expressivity. This work introduces two new architectures whose Fourier degrees grow exponentially: the sequential and parallel exponential quantum machine learning architectures. This is done by efficiently using the available Hilbert space when encoding, increasing the expressivity of the quantum encoding. Therefore, the exponential growth allows staying at the low-qubit limit to create highly expressive circuits avoiding barren plateaus. Practically, parallel exponential architecture was shown to outperform the existing linear architectures by reducing their final mean square error value by up to 44.7% in a one-dimensional test problem. Furthermore, the feasibility of this technique was also shown on a trapped ion quantum processing unit.


title: Probing Pseudo-Dirac Neutrinos with Astrophysical Sources at IceCube

abstract: The recent observation of NGC 1068 by the IceCube Neutrino Observatory has opened a new window to neutrino physics with astrophysical baselines. In this Letter, we propose a new method to probe the nature of neutrino masses using these observations. In particular, our method enables searching for signatures of pseudo-Dirac neutrinos with mass-squared differences that reach down to $\delta m^2 \gtrsim 10^{-21}~\text{eV}^2$, improving the reach of terrestrial experiments by more than a billion. Finally, we discuss how the discovery of a constellation of neutrino sources can further increase the sensitivity and cover a wider range of $\delta m^2$ values.


title: Reservoir Computing-based Multi-Symbol Equalization for PAM 4 Short-reach Transmission

abstract: We propose spectrum-sliced reservoir computer-based (RC) multi-symbol equalization for 32-GBd PAM4 transmission. RC with 17 symbols at the output achieves an order of magnitude reduction in multiplications/symbol versus single output case while maintaining simple training.


title: A New Catalog of orbits of 152 Globular Clusters from Gaia EDR3

abstract: This paper provides a new catalog of orbits and their parameters for a practically complete list of currently known galactic globular clusters (GCs), compiled by Vasiliev (2019) based on the most accurate modern measurements of their velocities and positions. The integration of the orbits of 152 globular clusters for 5 Gyr backward was performed using the new average proper motions obtained from the Gaia EDR3 catalog (Vasiliev and Baumgardt, 2021) and new average distances (Baumgardt and Vasiliev, 2021) in the axisymmetric three-component potential with spherical bulge, disk component, and spherical dark Navarro-Frank-White halo (Bajkova and Bobylev, 2016). The new orbital parameters are compared with the orbital parameters constructed by us earlier (Bajkova and Bobylev, 2021) in the same gravitational potential using proper motions obtained from the Gaia DR2 catalog (Vasiliev, 2019) and with the distances from the Harris catalog (2010).


title: Prioritizing Policies for Furthering Responsible Artificial Intelligence in the United States

abstract: Several policy options exist, or have been proposed, to further responsible artificial intelligence (AI) development and deployment. Institutions, including U.S. government agencies, states, professional societies, and private and public sector businesses, are well positioned to implement these policies. However, given limited resources, not all policies can or should be equally prioritized. We define and review nine suggested policies for furthering responsible AI, rank each policy on potential use and impact, and recommend prioritization relative to each institution type. We find that pre-deployment audits and assessments and post-deployment accountability are likely to have the highest impact but also the highest barriers to adoption. We recommend that U.S. government agencies and companies highly prioritize development of pre-deployment audits and assessments, while the U.S. national legislature should highly prioritize post-deployment accountability. We suggest that U.S. government agencies and professional societies should highly prioritize policies that support responsible AI research and that states should highly prioritize support of responsible AI education. We propose that companies can highly prioritize involving community stakeholders in development efforts and supporting diversity in AI development. We advise lower levels of prioritization across institutions for AI ethics statements and databases of AI technologies or incidents. We recognize that no one policy will lead to responsible AI and instead advocate for strategic policy implementation across institutions.


title: OpenApePose: a database of annotated ape photographs for pose estimation

abstract: Because of their close relationship with humans, non-human apes (chimpanzees, bonobos, gorillas, orangutans, and gibbons, including siamangs) are of great scientific interest. The goal of understanding their complex behavior would be greatly advanced by the ability to perform video-based pose tracking. Tracking, however, requires high-quality annotated datasets of ape photographs. Here we present OpenApePose, a new public dataset of 71,868 photographs, annotated with 16 body landmarks, of six ape species in naturalistic contexts. We show that a standard deep net (HRNet-W48) trained on ape photos can reliably track out-of-sample ape photos better than networks trained on monkeys (specifically, the OpenMonkeyPose dataset) and on humans (COCO) can. This trained network can track apes almost as well as the other networks can track their respective taxa, and models trained without one of the six ape species can track the held out species better than the monkey and human models can. Ultimately, the results of our analyses highlight the importance of large specialized databases for animal tracking systems and confirm the utility of our new ape database.


title: New Probabilistic-Dynamic Multi-Method Ensembles for Optimization based on the CRO-SL

abstract: In this paper we propose new probabilistic and dynamic (adaptive) strategies to create multi-method ensembles based on the Coral Reefs Optimization with Substrate Layers (CRO-SL) algorithm. The CRO-SL is an evolutionary-based ensemble approach, able to combine different search procedures within a single population. In this work we discuss two different probabilistic strategies to improve the algorithm. First, we defined the Probabilistic CRO-SL (PCRO-SL), which substitutes the substrates in the CRO-SL population by {\em tags} associated with each individual. Each tag represents a different operator which will modify the individual in the reproduction phase. In each generation of the algorithm, the tags are randomly assigned to the individuals with a similar probability, obtaining this way an ensemble with a more intense change in the application of different operators to a given individual than the original CRO-SL. The second strategy discussed in this paper is the Dynamical Probabilistic CRO-SL (DPCRO-SL), in which the probability of tag assignment is modified during the evolution of the algorithm, depending on the quality of the solutions generated in each substrate. Thus, the best substrates in the search process will be assigned with a higher probability that those which showed a worse performance during the search. We test the performance of the proposed probabilistic and dynamic ensembles in different optimization problems, including benchmark functions and a real application of wind turbines layout optimization, comparing the results obtained with that of existing algorithms in the literature.


title: Transformer-based Hand Gesture Recognition via High-Density EMG Signals: From Instantaneous Recognition to Fusion of Motor Unit Spike Trains

abstract: Designing efficient and labor-saving prosthetic hands requires powerful hand gesture recognition algorithms that can achieve high accuracy with limited complexity and latency. In this context, the paper proposes a compact deep learning framework referred to as the CT-HGR, which employs a vision transformer network to conduct hand gesture recognition using highdensity sEMG (HD-sEMG) signals. The attention mechanism in the proposed model identifies similarities among different data segments with a greater capacity for parallel computations and addresses the memory limitation problems while dealing with inputs of large sequence lengths. CT-HGR can be trained from scratch without any need for transfer learning and can simultaneously extract both temporal and spatial features of HD-sEMG data. Additionally, the CT-HGR framework can perform instantaneous recognition using sEMG image spatially composed from HD-sEMG signals. A variant of the CT-HGR is also designed to incorporate microscopic neural drive information in the form of Motor Unit Spike Trains (MUSTs) extracted from HD-sEMG signals using Blind Source Separation (BSS). This variant is combined with its baseline version via a hybrid architecture to evaluate potentials of fusing macroscopic and microscopic neural drive information. The utilized HD-sEMG dataset involves 128 electrodes that collect the signals related to 65 isometric hand gestures of 20 subjects. The proposed CT-HGR framework is applied to 31.25, 62.5, 125, 250 ms window sizes of the above-mentioned dataset utilizing 32, 64, 128 electrode channels. The average accuracy over all the participants using 32 electrodes and a window size of 31.25 ms is 86.23%, which gradually increases till reaching 91.98% for 128 electrodes and a window size of 250 ms. The CT-HGR achieves accuracy of 89.13% for instantaneous recognition based on a single frame of HD-sEMG image.


title: Improving astroBERT using Semantic Textual Similarity

abstract: The NASA Astrophysics Data System (ADS) is an essential tool for researchers that allows them to explore the astronomy and astrophysics scientific literature, but it has yet to exploit recent advances in natural language processing. At ADASS 2021, we introduced astroBERT, a machine learning language model tailored to the text used in astronomy papers in ADS. In this work we: - announce the first public release of the astroBERT language model; - show how astroBERT improves over existing public language models on astrophysics specific tasks; - and detail how ADS plans to harness the unique structure of scientific papers, the citation graph and citation context, to further improve astroBERT.


title: Multithreshold multipartite graphs with small parts

abstract: A graph is a $k$-threshold graph with thresholds $\theta_1, \theta_2, \dots, \theta_k$ if we can assign a real number $r_v$ to each vertex $v$ such that for any two distinct vertices $u$ and $v$, $uv$ is an edge if and only if the number of thresholds not exceeding $r_u+r_v$ is odd. The threshold number of a graph is the smallest $k$ for which it is a $k$-threshold graph. Multithreshold graphs were introduced by Jamison and Sprague as a generalization of classical threshold graphs. They asked for the exact threshold numbers of complete multipartite graphs. Recently, Chen and Hao solved the problem for complete multipartite graphs where each part is not too small, and they asked for the case when each part has size $3$. We determine the exact threshold numbers of $K_{3, 3, \dots, 3}$, $K_{4, 4, \dots, 4}$ and their complements $nK_3$, $nK_4$. This improves a result of Puleo.


title: Learning Transition Operators From Sparse Space-Time Samples

abstract: We consider the nonlinear inverse problem of learning a transition operator $\mathbf{A}$ from partial observations at different times, in particular from sparse observations of entries of its powers $\mathbf{A},\mathbf{A}^2,\cdots,\mathbf{A}^{T}$. This Spatio-Temporal Transition Operator Recovery problem is motivated by the recent interest in learning time-varying graph signals that are driven by graph operators depending on the underlying graph topology. We address the nonlinearity of the problem by embedding it into a higher-dimensional space of suitable block-Hankel matrices, where it becomes a low-rank matrix completion problem, even if $\mathbf{A}$ is of full rank. For both a uniform and an adaptive random space-time sampling model, we quantify the recoverability of the transition operator via suitable measures of incoherence of these block-Hankel embedding matrices. For graph transition operators these measures of incoherence depend on the interplay between the dynamics and the graph topology. We develop a suitable non-convex iterative reweighted least squares (IRLS) algorithm, establish its quadratic local convergence, and show that, in optimal scenarios, no more than $\mathcal{O}(rn \log(nT))$ space-time samples are sufficient to ensure accurate recovery of a rank-$r$ operator $\mathbf{A}$ of size $n \times n$. This establishes that spatial samples can be substituted by a comparable number of space-time samples. We provide an efficient implementation of the proposed IRLS algorithm with space complexity of order $O(r n T)$ and per-iteration time complexity linear in $n$. Numerical experiments for transition operators based on several graph models confirm that the theoretical findings accurately track empirical phase transitions, and illustrate the applicability and scalability of the proposed algorithm.


title: Quasi Normal Modes of Black Holes and Detection in Ringdown Process

abstract: Quasi-normal modes (QNMs) of a black hole (BH) are the eigen modes describing the dissipative oscillation of various fields in that spacetime, which can be intrinsically produced by the linear perturbation theory. With the discovery of the first gravitational waves (GWs) event, GW150914, a new window into the universe has been opened, allowing for the detection of QNMs associated to the ringdown process, which will enable more accurate measurements of the BHs parameters as well as further testing of general relativity. This article discusses the linear perturbation theory of BHs and provides review of several QNMs calculation methods including the newly developed methods. We will also focus on the connection between QNMs and the detection of GWs as well as some recent advancements in this area.


title: Matrix Extreme Points and Free extreme points of Free spectrahedra

abstract: A spectrahedron is a convex set defined by a linear matrix inequality, i.e., the set of all $x \in \mathbb{R}^g$ such that \[ L_A(x) = I + A_1 x_1 + A_2 x_2 + \dots + A_g x_g \succeq 0 \] for some symmetric matrices $A_1,\ldots,A_g$. This can be extended to matrix spaces by taking $X$ to be a tuple of real symmetric matrices of any size and using the Kronecker product $$L_A(X) = I_n \otimes I_d + A_1 \otimes X_1 + A_2 \otimes X_2 + \dots + A_g \otimes X_g.$$ The solution set of $L_A (X) \succeq 0$ is called a \textit{free spectrahedron}. Free spectrahedra are important in systems engineering, operator algebras, and the theory of matrix convex sets. Matrix and free extreme points of free spectrahedra are of particular interest. While many authors have studied matrix and free extreme points of free spectrahedra, it has until now been unknown if these two types of extreme points are actually different. The results of this paper fall into three categories: theoretical, algorithmic, and experimental. Firstly, we prove the existence of matrix extreme points of free spectrahedra that are not free extreme. This is done by producing exact examples of matrix extreme points that are not free extreme. We also show that if the $A_i$ are $2 \times 2$ matrices, then matrix and free extreme points coincide. Secondly, we detail methods for constructing matrix extreme points of free spectrahedra that are not free extreme, both exactly and numerically. We also show how a recent result due to Kriel (Complex Anal.~Oper.~Theory 2019) can be used to efficiently test whether a point is matrix extreme. Thirdly, we provide evidence that a substantial number of matrix extreme points of free spectrahedra are not free extreme. Numerical work in another direction shows how to effectively write a given tuple in a free spectrahedron as a matrix convex combination of its free extreme points.


title: Multimodal Query-guided Object Localization

abstract: Consider a scenario in one-shot query-guided object localization where neither an image of the object nor the object category name is available as a query. In such a scenario, a hand-drawn sketch of the object could be a choice for a query. However, hand-drawn crude sketches alone, when used as queries, might be ambiguous for object localization, e.g., a sketch of a laptop could be confused for a sofa. On the other hand, a linguistic definition of the category, e.g., a small portable computer small enough to use in your lap" along with the sketch query, gives better visual and semantic cues for object localization. In this work, we present a multimodal query-guided object localization approach under the challenging open-set setting. In particular, we use queries from two modalities, namely, hand-drawn sketch and description of the object (also known as gloss), to perform object localization. Multimodal query-guided object localization is a challenging task, especially when a large domain gap exists between the queries and the natural images, as well as due to the challenge of combining the complementary and minimal information present across the queries. For example, hand-drawn crude sketches contain abstract shape information of an object, while the text descriptions often capture partial semantic information about a given object category. To address the aforementioned challenges, we present a novel cross-modal attention scheme that guides the region proposal network to generate object proposals relevant to the input queries and a novel orthogonal projection-based proposal scoring technique that scores each proposal with respect to the queries, thereby yielding the final localization results. ...


title: On existence and stability results for normalized ground states of mass-subcritical biharmonic NLS on $\mathbb{R}^d\times\mathbb{T}^n$

abstract: We study the focusing mass-subcritical biharmonic nonlinear Schr\"odinger equation (BNLS) on the product space $\mathbb{R}_x^d\times\mathbb{T}_y^n$. Following the crucial scaling arguments introduced in \cite{TTVproduct2014} we establish existence and stability results for the normalized ground states of BNLS. Moreover, in the case where lower order dispersion is absent, we prove the existence of a critical mass number $c_0\in(0,\infty)$ that sharply determines the $y$-dependence of the deduced ground states. In the mixed dispersion case, we encounter a major challenge as the BNLS is no longer scale-invariant and the arguments from \cite{TTVproduct2014} for determining the sharp $y$-dependence of the ground states fail. The main novelty of the present paper is to address this difficult and interesting issue: Using a different scaling argument, we show that $y$-independence of ground states with small mass still holds in the case $\beta>0$ and $\alpha\in(0,4/(d+n))$. Additionally, we also prove that ground states with sufficiently large mass must possess non-trivial $y$-dependence by appealing to some novel construction of test functions. The latter particularly holds for all parameters lying in the full mass-subcritical regime.


title: P(Expression|Grammar): Probability of deriving an algebraic expression with a probabilistic context-free grammar

abstract: Probabilistic context-free grammars have a long-term record of use as generative models in machine learning and symbolic regression. When used for symbolic regression, they generate algebraic expressions. We define the latter as equivalence classes of strings derived by grammar and address the problem of calculating the probability of deriving a given expression with a given grammar. We show that the problem is undecidable in general. We then present specific grammars for generating linear, polynomial, and rational expressions, where algorithms for calculating the probability of a given expression exist. For those grammars, we design algorithms for calculating the exact probability and efficient approximation with arbitrary precision.


title: Evaluating CO2 Storage Potential of Offshore Reservoirs and Saline Formations in Central Gulf of Mexico by Employing Data-driven Models with SAS Viya

abstract: The SECARB offshore partnership project seeks to screen deep saline aquifers and hydrocarbon reservoirs in the central Gulf of Mexico (GOM) for CO2 sequestration and CO2-driven enhanced oil and gas recovery and estimate the corresponding CO2 storage resources for select reservoirs. To this end, three major objectives have been completed: managing geological data from different sources, building a reservoir screening platform for CO2 storage, and ranking the reservoirs based on the estimated storage potential. First, the major geological characteristics of both shelf and deep-water areas of the central GOM were examined and compared to define the appropriate reservoir screening criteria. Consequently, the CO2 storage resources of the screened reservoirs were calculated and reported at the BOEM field level to identify fields with the highest storage potential. In the project's current phase, the assessment is being expanded to saline formations. Correlations are being identified, tested, and developed for a broad range of rock and fluid properties, including thickness, porosity, permeability, fluid saturation, and fluid chemistry. These correlations are developed for interfacial tension and CO2 saturated brine viscosity to improve the storage estimates and consider the capillary trapping and solubility of CO2 in reservoir fluids. SAS Viya software is used to make visualizations of these properties of the offshore reservoir and make comparisons and draw similarities between the experimental and estimated correlated measures. Using interactive plots, different conditions could be screened, making the analysis more attractive from a user's point of view.


title: An hourglass-free formulation for total Lagrangian smoothed particle hydrodynamics

abstract: The total Lagrangian smoothed particle hydrodynamics (TL-SPH) for elastic solid dynamics suffers from hourglass modes which can grow and lead to the failure of simulation for problems with large deformation. To address this long-standing issue, we present an hourglass-free formulation based on volumetric-devioatric stress decomposition. Inspired by the fact that the artifact of nonphysical zigzag particle distribution induced by the hourglass modes is mainly characterized by shear deformation and the standard SPH discretization for the viscous term in the Navier-Stokes (NS) equation, the present formulation computes the action of shear stress directly through the Laplacian of displacement other than from the divergence of shear stress. A comprehensive set of challenging benchmark cases are simulated to demonstrate that, while improving accuracy and computational efficiency, the present formulation is able to eliminate the hourglass modes and achieves very good numerical stability with a single general effective parameter. In addition, the deformation of a practically relevant stent structure is simulated to demonstrate the potential of the present method in the field of biomechanics.


title: On scalar-type standing-wave solutions to systems of nonlinear Schr\"odinger equations

abstract: In this article, we study the standing-wave solutions to a class of systems of nonlinear Schr\"odinger equations. Our target is all the standard forms of the NLS systems, with two unknowns, that have a common linear part and cubic gauge-invariant nonlinearities and that yield a Hamiltonian with a coercive kinetic-energy part. We give a necessary and sufficient condition on the existence of the ground state. Further, we give a characterization of the shape of the ground state. It will turn out that the ground states are scalar-type, i.e., multiples of a constant vector and a scalar function. We further give a sufficient condition on the existence of excited states of the same form. The stability and the instability of the ground states are also studied. To this end, we introduce an abstract treatment on the study of scalar-type standing-wave solution that applies to a wide class of NLS systems with homogeneous energy-subcritical nonlinearity. By the argument, some previous results are reproduced.


title: New exact solutions for microscale gas flows

abstract: We present a number of exact solutions to the linearised Grad equations for non-equilibrium rarefied gas flows and heat flows. The solutions include the flow and pressure fields associated to a point force placed in a rarefied gas flow close to a no-slip boundary and the temperature field for a point heat source placed in a heat flow close to a temperature jump boundary. We also derive the solution of the unsteady Grad equations in one dimension with a time-dependent point heat source term and the Grad analogue of the rotlet, a well-known singularity of Stokes flow which corresponds to a point torque.


title: Mechanism Design Theory in Control Engineering: A Tutorial and Overview of Applications in Communication, Power Grid, Transportation, and Security Systems

abstract: This article provides an introduction to the theory of mechanism design and its application to engineering problems. Our aim is to provide the fundamental principles of the theory of mechanism design for control engineers and theorists along with the state-of-the-art methods in engineering applications. We start our exposition with a brief overview of game theory highlighting the key notions that are necessary to introduce mechanism design, and then we offer a comprehensive discussion of the principles in mechanism design. Finally, we explore four key applications of mechanism design in engineering, i.e., communication networks, power grids, transportation, and security systems.


title: Basics of factorization in a scalar Yukawa field theory

abstract: The factorization theorems of quantum chromodynamics (QCD) apply equally well to most simple quantum field theories that require renormalization but where direct calculations are much more straightforward. Working with these simpler theories is convenient for stress-testing the limits of the factorization program and for examining general properties of the parton density functions (pdfs) or other correlation functions that might be necessary for a factorized description of a process. With this view in mind, we review the steps of factorization in a real scalar Yukawa field theory for both deep inelastic scattering (DIS) and semi-inclusive deep inelastic scattering (SIDIS) cross sections. In the case of SIDIS, we illustrate how to separate the small transverse momentum region, where transverse momentum dependent (TMD) pdfs are needed, from a purely collinear large transverse momentum region, and we examine the influence of subleading power corrections. We also review the steps for formulating TMD factorization in transverse coordinate space, and we study the effect of transforming to the well-known $b_*$-scheme. Within the Yukawa theory, we investigate the consequences of switching to a generalized parton model (GPM) approach, and compare with a fully factorized approach. Our results highlight the need to address similar or analogous issues in QCD.


title: Polarization-Tuned Fano Resonances in All-Dielectric Short-Wave Infrared Metasurface

abstract: The short-wave infrared (SWIR) is an underexploited portion of the electromagnetic spectrum in metasurface-based nanophotonics despite its strategic importance in sensing and imaging applications. This is mainly attributed to the lack of material systems to tailor light-matter interactions in this range. Herein, we address this limitation and demonstrate an all-dielectric silicon-integrated metasurface enabling polarization-induced Fano resonance control at SWIR frequencies. The platform consists of a two-dimensional Si/GeSn core/shell nanowire array on a silicon wafer. By tuning the light polarization, we show that the metasurface reflectance can be efficiently engineered due to Fano resonances emerging from the electric and magnetic dipoles competition. The interference of optically induced dipoles in high-index nanowire arrays offers additional degrees of freedom to tailor the directional scattering and the flow of light while enabling sharp polarization-modulated resonances. This tunability is harnessed in nanosensors yielding an efficient detection of 10^{-2} changes in the refractive index of the surrounding medium.


title: High-dimensional density estimation with tensorizing flow

abstract: We propose the tensorizing flow method for estimating high-dimensional probability density functions from the observed data. The method is based on tensor-train and flow-based generative modeling. Our method first efficiently constructs an approximate density in the tensor-train form via solving the tensor cores from a linear system based on the kernel density estimators of low-dimensional marginals. We then train a continuous-time flow model from this tensor-train density to the observed empirical distribution by performing a maximum likelihood estimation. The proposed method combines the optimization-less feature of the tensor-train with the flexibility of the flow-based generative models. Numerical results are included to demonstrate the performance of the proposed method.

categories: cs.LG cs.NA math.NA physics.comp-ph stat.ML


title: Caching HTTP 404 Responses Eliminates Unnecessary Archival Replay Requests

abstract: Upon replay, JavaScript on archived web pages can generate recurring HTTP requests that lead to unnecessary traffic to the web archive. In one example, an archived page averaged more than 1000 requests per minute. These requests are not visible to the user, so if a user leaves such an archived page open in a browser tab, they would be unaware that their browser is continuing to generate traffic to the web archive. We found that web pages that require regular updates (e.g., radio playlists, updates for sports scores, image carousels) are more likely to make such recurring requests. If the resources requested by the web page are not archived, some web archives may attempt to patch the archive by requesting the resources from the live web. If the requested resources are unavailable on the live web, the resources cannot be archived, and the responses remain HTTP 404. Some archived pages continue to poll the server as frequently as they did on the live web, while some pages poll the server even more frequently if their requests return HTTP 404 responses, creating a high amount of unnecessary traffic. On a large scale, such web pages are effectively a denial of service attack on the web archive. Significant computational, network and storage resources are required for web archives to archive and then successfully replay pages as they were on the live web, and these resources should not be spent on unnecessary HTTP traffic. Our proposed solution is to optimize archival replay using Cache-Control HTTP response headers. We implemented this approach in a test environment and cached HTTP 404 responses that prevented the browser's requests from reaching the web archive server.


title: Quantum Circuit Cutting for Classical Shadows

abstract: Classical shadow tomography is a sample-efficient technique for characterizing quantum systems and predicting many of their properties. Circuit cutting is a technique for dividing large quantum circuits into smaller fragments that can be executed more robustly using fewer quantum resources. We introduce a divide-and-conquer circuit cutting method for estimating the expectation values of observables using classical shadows. We derive a general formula for making predictions using the classical shadows of circuit fragments from arbitrarily cut circuits, and provide the sample complexity analysis for the case when observables factorize across fragments. Then, we numerically show that our divide-and-conquer method outperforms traditional uncut shadow tomography when estimating high-weight observables that act non-trivially on many qubits, and discuss the mechanisms for this advantage.


title: AGN Feedback in SDSS-IV MaNGA: AGNs have Suppressed Central Star Formation Rates

abstract: Despite the importance of feedback from active galactic nuclei (AGNs) in models of galaxy evolution, observational constraints on the influence of AGN feedback on star formation remain weak. To this end, we have compared the star formation trends of 279 low-redshift AGN galaxies with 558 inactive control galaxies using integral field unit spectroscopy from the SDSS-IV MaNGA survey. With a Gaussian process-based methodology, we reconstruct nonparametric star formation histories in spatially resolved spaxels covering the face of each galaxy. Based on galaxy-wide star formation rates (SFRs) alone, we find no obvious signatures of AGN feedback. However, the AGN galaxies have significantly suppressed central (kiloparsec-scale) SFRs, lying up to a factor of $2$ below those of the control galaxies, providing direct observational evidence of AGN feedback suppressing star formation. The suppression of central SFRs in the AGN galaxies began in the central regions ${\sim} 6$ Gyr ago (redshift $z {\sim} 0.7$), taking place over a few gigayears. A small subset of the AGN galaxies were rapidly driven to quiescence shortly before being observed (in the last $500$ Myr), potentially indicating instances of AGN-driven feedback. More frequently, however, star formation continues in the AGN galaxies, with suppression primarily in the central regions. This is suggestive of a picture in which integrated (Gyr-timescale) AGN feedback can significantly affect central star formation, but may be inefficient in driving galaxy-wide quenching in low-redshift galaxies, instead leaving them in the green valley.


title: A Strong-QCD Regime Measurement of the Proton's Spin Structure

abstract: The theory of the strong force, Quantum Chromodynamics (QCD) remains one of the most important ways to understand the fundamental properties of ordinary matter. However, at low momentum transfer Q2, in the regime where the strong force becomes extremely strong, our understanding of QCD for ordinary nucleons becomes hazy. Several cutting edge theories such as Chiral Perturbation Theory and Lattice QCD have provided valuable predictions in this regime, but Lattice QCD has not yet extended predictions of many important quantities to this kinematic region, and Chiral Perturbation Theory has faced several important disagreements with experimental data for the neutron over the last several decades. It is therefore of extreme importance to have a benchmark of experimental data in the low energy regime for the proton's behavior, as a test of leading theories for the behavior of QCD in this regime. The E08-027 (g2p) experiment ran at Jefferson Lab in 2012 with the goal of collecting this valuable data. Full details of the g2p experiment and my experimental work at the University of New Hampshire are presented in this thesis, as well as a detailed description of the analysis process and the exciting benchmark results, which serve as a direct test of all current and future theories of QCD in the low-Q2 regime.

categories: nucl-ex nucl-th physics.acc-ph physics.atom-ph


title: On unitarity of the Coon amplitude

abstract: The Coon amplitude is a one-parameter deformation of the Veneziano amplitude. We explore the unitarity of the Coon amplitude through its partial wave expansion using tools from $q$-calculus. Our analysis establishes manifest positivity on the leading and sub-leading Regge trajectories in arbitrary spacetime dimensions $D$, while revealing a violation of unitarity in a certain region of $(q,D)$ parameter space starting at the sub-sub-leading Regge order. A combination of numerical studies and analytic arguments allows us to argue for the manifest positivity of the partial wave coefficients in fixed spin and Regge asymptotics.


title: Multi-collision internal shock lepto-hadronic models for energetic GRBs

abstract: For a sub-population of energetic Gamma-Ray Bursts (GRBs), a moderate baryonic loading may suffice to power Ultra-High-Energy Cosmic Rays (UHECRs). Motivated by this, we study the radiative signatures of cosmic-ray protons in the prompt phase of energetic GRBs. Our framework is the internal shock model with multi-collision descriptions of the relativistic ejecta (with different emission regions along the jet), plus time-dependent calculations of photon and neutrino spectra. Our GRB prototypes are motivated by {\em Fermi}-LAT detected GRBs (including GRB~221009A) for which further, owing to the large energy flux, neutrino non-observation of single events may pose a strong limit on the baryonic loading. We study the feedback of protons on electromagnetic spectra in synchrotron- and inverse Compton-dominated scenarios to identify the multi-wavelength signatures, to constrain the maximally allowed baryonic loading, and to point out the differences between hadronic and inverse Compton signatures. We find that hadronic signatures appear as correlated flux increases in the optical-UV to soft X-ray and GeV to TeV gamma-ray ranges in the synchrotron scenarios, whereas they are difficult to identify in inverse Compton-dominated scenarios. We demonstrate that baryonic loadings around 10, which satisfy the UHECR energetic requirements, do not distort the predicted photon spectra in the {\em Fermi}-GBM range and are consistent with constraints from neutrino data if the collision radii are large enough (i.e., the time variability is not too short). It therefore seems plausible that under the condition of large dissipation radii a population of energetic GRBs can be the origin of the UHECRs.


title: Multi-messenger model for the prompt emission from GRB 221009A

abstract: We present a multi-messenger model for the prompt emission from GRB 221009A within the internal shock scenario. We consider the time-dependent evolution of the outflow with its impact on the observed light curve from multiple collisions, and the self-consistent generation of the electromagnetic spectrum in synchrotron and inverse Compton-dominated scenarios. Our leptohadronic model includes UHE protons potentially accelerated in the outflow, and their feedback on spectral energy distribution and on the neutrino emission. We find that we can roughly reproduce the observed light curves with an engine with varying ejection velocity of ultra-relativistic material, which has an intermediate quiescent period of about 200 seconds and a variability timescale of $\sim1$~s. We consider baryonic loadings of 3 and 30 that are compatible with the hypothesis that the highest-energetic LHAASO photons might come from UHECR interactions with the extragalactic background light, and the paradigm that energetic GRBs may power the UHECR flux. For these values and the high dissipation radii considered we find consistency with the non-observation of neutrinos and no significant signatures on the electromagnetic spectrum. Inverse Compton-dominated scenarios from the prompt emission are demonstrated to lead to about an order of magnitude higher fluxes in the HE-range; this enhancement is testable by its spectral impact in the Fermi-GBM and LAT ranges.


title: Exploiting Proximity-Aware Tasks for Embodied Social Navigation

abstract: Learning how to navigate among humans in an occluded and spatially constrained indoor environment, is a key ability required to embodied agent to be integrated into our society. In this paper, we propose an end-to-end architecture that exploits Proximity-Aware Tasks (referred as to Risk and Proximity Compass) to inject into a reinforcement learning navigation policy the ability to infer common-sense social behaviors. To this end, our tasks exploit the notion of immediate and future dangers of collision. Furthermore, we propose an evaluation protocol specifically designed for the Social Navigation Task in simulated environments. This is done to capture fine-grained features and characteristics of the policy by analyzing the minimal unit of human-robot spatial interaction, called Encounter. We validate our approach on Gibson4+ and Habitat-Matterport3D datasets.


title: Simplifying and Understanding State Space Models with Diagonal Linear RNNs

abstract: Sequence models based on linear state spaces (SSMs) have recently emerged as a promising choice of architecture for modeling long range dependencies across various modalities. However, they invariably rely on discretization of a continuous state space, which complicates their presentation and understanding. In this work, we dispose of the discretization step, and propose a model based on vanilla Diagonal Linear RNNs ($\mathrm{DLR}$). We empirically show that, despite being conceptually much simpler, $\mathrm{DLR}$ is as performant as previously-proposed SSMs on a variety of tasks and benchmarks including Long Range Arena and raw speech classification. Moreover, we characterize the expressivity of SSMs (including $\mathrm{DLR}$) and attention-based models via a suite of $13$ synthetic sequence-to-sequence tasks involving interactions over tens of thousands of tokens, ranging from simple operations, such as shifting an input sequence, to detecting co-dependent visual features over long spatial ranges in flattened images. We find that while SSMs report near-perfect performance on tasks that can be modeled via $\textit{few}$ convolutional kernels, they struggle on tasks requiring $\textit{many}$ such kernels and especially when the desired sequence manipulation is $\textit{context-dependent}$. Despite these limitations, $\mathrm{DLR}$ reaches high performance on two higher-order reasoning tasks $\mathrm{ListOpsSubTrees}$ and $\mathrm{PathfinderSegmentation}\text{-}\mathrm{256}$ with input lengths $8K$ and $65K$ respectively, and gives encouraging performance on $\mathrm{PathfinderSegmentation}\text{-}\mathrm{512}$ with input length $262K$ for which attention is not a viable choice.


title: Antidirected subgraphs of oriented graphs

abstract: We show that for every $\eta>0$ every sufficiently large $n$-vertex oriented graph D of minimum semidegree exceeding $(1 + \eta) k/2$ contains every balanced antidirected tree with $k$ edges and bounded maximum degree, if $k \ge \eta n$. In particular, this asymptotically confirms a conjecture of the first author for long antidirected paths and dense digraphs. Further, we show that in the same setting, D contains every $k$-edge antidirected subdivision of a sufficiently small complete graph, if the paths of the subdivision that have length 1 or 2 span a forest. As a special case, we can find all antidirected cycles of length at most $k$. Finally, we address a conjecture of Addario-Berry, Havet, Linhares Sales, Reed and Thomass\'e for antidirected trees in digraphs. We show that this conjecture is asymptotically true in $n$-vertex oriented graphs for all balanced antidirected trees of bounded maximum degree and of size linear in $n$.


title: On Utilizing Relationships for Transferable Few-Shot Fine-Grained Object Detection

abstract: State-of-the-art object detectors are fast and accurate, but they require a large amount of well annotated training data to obtain good performance. However, obtaining a large amount of training annotations specific to a particular task, i.e., fine-grained annotations, is costly in practice. In contrast, obtaining common-sense relationships from text, e.g., "a table-lamp is a lamp that sits on top of a table", is much easier. Additionally, common-sense relationships like "on-top-of" are easy to annotate in a task-agnostic fashion. In this paper, we propose a probabilistic model that uses such relational knowledge to transform an off-the-shelf detector of coarse object categories (e.g., "table", "lamp") into a detector of fine-grained categories (e.g., "table-lamp"). We demonstrate that our method, RelDetect, achieves performance competitive to finetuning based state-of-the-art object detector baselines when an extremely low amount of fine-grained annotations is available ($0.2\%$ of entire dataset). We also demonstrate that RelDetect is able to utilize the inherent transferability of relationship information to obtain a better performance ($+5$ mAP points) than the above baselines on an unseen dataset (zero-shot transfer). In summary, we demonstrate the power of using relationships for object detection on datasets where fine-grained object categories can be linked to coarse-grained categories via suitable relationships.


title: Neural Representations Reveal Distinct Modes of Class Fitting in Residual Convolutional Networks

abstract: We leverage probabilistic models of neural representations to investigate how residual networks fit classes. To this end, we estimate class-conditional density models for representations learned by deep ResNets. We then use these models to characterize distributions of representations across learned classes. Surprisingly, we find that classes in the investigated models are not fitted in an uniform way. On the contrary: we uncover two groups of classes that are fitted with markedly different distributions of representations. These distinct modes of class-fitting are evident only in the deeper layers of the investigated models, indicating that they are not related to low-level image features. We show that the uncovered structure in neural representations correlate with memorization of training examples and adversarial robustness. Finally, we compare class-conditional distributions of neural representations between memorized and typical examples. This allows us to uncover where in the network structure class labels arise for memorized and standard inputs.


title: Margin-based sampling in high dimensions: When being active is less efficient than staying passive

abstract: It is widely believed that given the same labeling budget, active learning (AL) algorithms like margin-based active learning achieve better predictive performance than passive learning (PL), albeit at a higher computational cost. Recent empirical evidence suggests that this added cost might be in vain, as margin-based AL can sometimes perform even worse than PL. While existing works offer different explanations in the low-dimensional regime, this paper shows that the underlying mechanism is entirely different in high dimensions: we prove for logistic regression that PL outperforms margin-based AL even for noiseless data and when using the Bayes optimal decision boundary for sampling. Insights from our proof indicate that this high-dimensional phenomenon is exacerbated when the separation between the classes is small. We corroborate this intuition with experiments on 20 high-dimensional datasets spanning a diverse range of applications, from finance and histology to chemistry and computer vision.