title: FairGen: Fair Synthetic Data Generation

abstract: With the rising adoption of Machine Learning across the domains like banking, pharmaceutical, ed-tech, etc, it has become utmost important to adopt responsible AI methods to ensure models are not unfairly discriminating against any group. Given the lack of clean training data, generative adversarial techniques are preferred to generate synthetic data with several state-of-the-art architectures readily available across various domains from unstructured data such as text, images to structured datasets modelling fraud detection and many more. These techniques overcome several challenges such as class imbalance, limited training data, restricted access to data due to privacy issues. Existing work focusing on generating fair data either works for a certain GAN architecture or is very difficult to tune across the GANs. In this paper, we propose a pipeline to generate fairer synthetic data independent of the GAN architecture. The proposed paper utilizes a pre-processing algorithm to identify and remove bias inducing samples. In particular, we claim that while generating synthetic data most GANs amplify bias present in the training data but by removing these bias inducing samples, GANs essentially focuses more on real informative samples. Our experimental evaluation on two open-source datasets demonstrates how the proposed pipeline is generating fair data along with improved performance in some cases.


title: Investigating the detection of Tortured Phrases in Scientific Literature

abstract: With the help of online tools, unscrupulous authors can today generate a pseudo-scientific article and attempt to publish it. Some of these tools work by replacing or paraphrasing existing texts to produce new content, but they have a tendency to generate nonsensical expressions. A recent study introduced the concept of 'tortured phrase', an unexpected odd phrase that appears instead of the fixed expression. E.g. counterfeit consciousness instead of artificial intelligence. The present study aims at investigating how tortured phrases, that are not yet listed, can be detected automatically. We conducted several experiments, including non-neural binary classification, neural binary classification and cosine similarity comparison of the phrase tokens, yielding noticeable results.


title: On the Effectiveness of Automated Metrics for Text Generation Systems

abstract: A major challenge in the field of Text Generation is evaluation because we lack a sound theory that can be leveraged to extract guidelines for evaluation campaigns. In this work, we propose a first step towards such a theory that incorporates different sources of uncertainty, such as imperfect automated metrics and insufficiently sized test sets. The theory has practical applications, such as determining the number of samples needed to reliably distinguish the performance of a set of Text Generation systems in a given setting. We showcase the application of the theory on the WMT 21 and Spot-The-Bot evaluation data and outline how it can be leveraged to improve the evaluation protocol regarding the reliability, robustness, and significance of the evaluation outcome.


title: Ab-initio study of dibaryons with highest bottom number

abstract: We present the first lattice study of dibaryons with highest bottom number. Utilizing a set of state-of-the-art lattice QCD ensembles and methodologies, we determine the ground state of dibaryon composed of two $\Omega_{bbb}$ baryons. We extract the related scattering amplitude in the $^1S_0$ channel and find a sub-threshold pole, which signifies an unambiguous evidence for a deeply bound $\Omega_{bbb}-\Omega_{bbb}$ dibaryon. The binding energy of such a state as dictated by this pole singularity is found to be -81($^{+14}_{-16}$) MeV. We quantify various systematic uncertainties involved in this determination, including those related to the excited state contamination and Coulomb repulsion between the bottom quarks.


title: E-Valuating Classifier Two-Sample Tests

abstract: We introduce a powerful deep classifier two-sample test for high-dimensional data based on E-values, called E-value Classifier Two-Sample Test (E-C2ST). Our test combines ideas from existing work on split likelihood ratio tests and predictive independence tests. The resulting E-values are suitable for anytime-valid sequential two-sample tests. This feature allows for more effective use of data in constructing test statistics. Through simulations and real data applications, we empirically demonstrate that E-C2ST achieves enhanced statistical power by partitioning datasets into multiple batches beyond the conventional two-split (training and testing) approach of standard classifier two-sample tests. This strategy increases the power of the test while keeping the type I error well below the desired significance level.


title: Generalised Likelihood Ratio Testing Adversaries through the Differential Privacy Lens

abstract: Differential Privacy (DP) provides tight upper bounds on the capabilities of optimal adversaries, but such adversaries are rarely encountered in practice. Under the hypothesis testing/membership inference interpretation of DP, we examine the Gaussian mechanism and relax the usual assumption of a Neyman-Pearson-Optimal (NPO) adversary to a Generalized Likelihood Test (GLRT) adversary. This mild relaxation leads to improved privacy guarantees, which we express in the spirit of Gaussian DP and $(\varepsilon, \delta)$-DP, including composition and sub-sampling results. We evaluate our results numerically and find them to match the theoretical upper bounds.


title: Multilingual Auxiliary Tasks Training: Bridging the Gap between Languages for Zero-Shot Transfer of Hate Speech Detection Models

abstract: Zero-shot cross-lingual transfer learning has been shown to be highly challenging for tasks involving a lot of linguistic specificities or when a cultural gap is present between languages, such as in hate speech detection. In this paper, we highlight this limitation for hate speech detection in several domains and languages using strict experimental settings. Then, we propose to train on multilingual auxiliary tasks -- sentiment analysis, named entity recognition, and tasks relying on syntactic information -- to improve zero-shot transfer of hate speech detection models across languages. We show how hate speech detection models benefit from a cross-lingual knowledge proxy brought by auxiliary tasks fine-tuning and highlight these tasks' positive impact on bridging the hate speech linguistic and cultural gap between languages.


title: Self-supervised Rewiring of Pre-trained Speech Encoders: Towards Faster Fine-tuning with Less Labels in Speech Processing

abstract: Pre-trained speech Transformers have facilitated great success across various speech processing tasks. However, fine-tuning these encoders for downstream tasks require sufficiently large training data to converge or to achieve state-of-the-art. In text domain this has been partly attributed to sub-optimality of the representation space in pre-trained Transformers. In this work, we take a sober look into pre-trained speech encoders and rewire their representation space without requiring any task-specific labels. Our method utilises neutrally synthesised version of audio inputs along with frame masking to construct positive pairs for contrastive self-supervised learning. When used for augmenting the wav2vec 2 encoder, we observe consistent improvement of isotropy in the representation space. Our experiments on 6 speech processing tasks, exhibit a significant convergence speedup during task fine-tuning as well as consistent task improvement, specially in low-resource settings.


title: A geometry method for LED mapping

abstract: With inputs from RGB-D camera, industrial camera and wheel odometer, in this letter, we propose a geometry-based detecting method, by which the 3-D modulated LED map can be acquired with the aid of visual odometry algorithm from ORB-SLAM2 system when the decoding result of LED-ID is inaccurate. Subsequently, an enhanced cost function is proposed to optimize the mapping result of LEDs. The average 3-D mapping error (8.5cm) is evaluated with a real-world experiment. This work can be viewed as a preliminary work of visible light positioning systems, offering a way to prevent the labor-intensive manual site surveys of LEDs.


title: Hypothesis Test Procedures for Detecting Leakage Signals in Water Pipeline Channels

abstract: We design statistical hypothesis tests for performing leak detection in water pipeline channels. By applying an appropriate model for signal propagation, we show that the detection problem becomes one of distinguishing signal from noise, with the noise being described by a multivariate Gaussian distribution with unknown covariance matrix. We first design a test procedure based on the generalized likelihood ratio test, which we show through simulations to offer appreciable leak detection performance gain over conventional approaches designed in an analogous context (for radar detection). Our proposed method requires estimation of the noise covariance matrix, which can become inaccurate under high-dimensional settings, and when the measurement data is scarce. To deal with this, we present a second leak detection method, which employs a regularized covariance matrix estimate. The regularization parameter is optimized for the leak detection application by applying results from large dimensional random matrix theory. This second proposed approach is shown to yield improved performance in leak detection compared with the first approach, at the expense of requiring higher computational complexity.


title: A relation between the Mordell-Tornheim multiple Dirichlet series and the confluent hypergeometric function

abstract: We investigate a relation between the Mordell-Tornheim type of multiple Dirichlet series and a confluent hypergeometric function. We prove it by applying the Mellin-Barnes integral formula. Also, main results in this paper contain two kinds of functional equations for double $L$-functions as a special case.


title: Subspace Representations for Soft Set Operations and Sentence Similarities

abstract: In the field of natural language processing (NLP), continuous vector representations are crucial for capturing the semantic meanings of individual words. Yet, when it comes to the representations of sets of words, the conventional vector-based approaches often struggle with expressiveness and lack the essential set operations such as union, intersection, and complement. Inspired by quantum logic, we realize the representation of word sets and corresponding set operations within pre-trained word embedding spaces. By grounding our approach in the linear subspaces, we enable efficient computation of various set operations and facilitate the soft computation of membership functions within continuous spaces. Moreover, we allow for the computation of the F-score directly within word vectors, thereby establishing a direct link to the assessment of sentence similarity. In experiments with widely-used pre-trained embeddings and benchmarks, we show that our subspace-based set operations consistently outperform vector-based ones in both sentence similarity and set retrieval tasks.


title: Characterizations of derivations on spaces of smooth functions

abstract: We provide a list of equivalent conditions under which an additive operator acting on a space of smooth functions on a compact real interval is a multiple of the derivation.


title: Non-Crossing Shortest Paths are Covered with Exactly Four Forests

abstract: Given a set of paths $P$ we define the \emph{Path Covering with Forest Number} of $P$} (PCFN($P$)) as the minimum size of a set $F$ of forests satisfying that every path in $P$ is contained in at least one forest in $F$. We show that PCFN($P$) is treatable when $P$ is a set of non-crossing shortest paths in a plane graph or subclasses. We prove that if $P$ is a set of non-crossing shortest paths of a planar graph $G$ whose extremal vertices lie on the same face of $G$, then PCFN($P$)\leq 4$, and this bound is tight.


title: Total mean curvature and first Dirac eigenvalue

abstract: In this note, we prove an optimal upper bound for the first Dirac eigenvalue of some hypersurfaces in Euclidean space by combining a positive mass theorem and the construction of quasi-spherical metrics. As a direct consequence of this estimate, we obtain an asymptotic expansion for the first eigenvalue of the Dirac operator on large spheres in three dimensional asymptotically flat manifolds. We also study this expansion for small geodesic spheres in a three dimensional Riemannian manifold. We finally discuss how this method can be adapted to yield similar results in the hyperbolic space.


title: An invitation to rough dynamics: zipper maps

abstract: In the field of dynamical systems, it is not rare to meet irregular functions, which are typically H{\"o}lder but not Lipschitz (e.g. the Weierstrass functions). Our goal is to scratch the surface of the following question: what happens if we consider irregular maps and iterate them? We introduce the family of "zipper maps", which are irregular in the above sense, and study some of their dynamical properties. For a large set of parameters, the corresponding zipper map admits horseshoe of all orders; as an immediate consequence, every order on $k\ell$ points can be realized by $k$ orbits of length $\ell$ of the map.These maps have infinite topological entropy, and we refine this statement by showing that they have positive metric mean dimension with respect to the Euclidean metric, as well as by introducing other notions of higher complexity.Finally, we prove that every interval map (thus including zipper maps) have vanishing absolute metric mean dimension, proving a small case of the conjecture that the absolute metric mean dimension coincides with the topological mean dimension.


title: "Covid vaccine is against Covid but Oxford vaccine is made at Oxford!" Semantic Interpretation of Proper Noun Compounds

abstract: Proper noun compounds, e.g., "Covid vaccine", convey information in a succinct manner (a "Covid vaccine" is a "vaccine that immunizes against the Covid disease"). These are commonly used in short-form domains, such as news headlines, but are largely ignored in information-seeking applications. To address this limitation, we release a new manually annotated dataset, ProNCI, consisting of 22.5K proper noun compounds along with their free-form semantic interpretations. ProNCI is 60 times larger than prior noun compound datasets and also includes non-compositional examples, which have not been previously explored. We experiment with various neural models for automatically generating the semantic interpretations from proper noun compounds, ranging from few-shot prompting to supervised learning, with varying degrees of knowledge about the constituent nouns. We find that adding targeted knowledge, particularly about the common noun, results in performance gains of upto 2.8%. Finally, we integrate our model generated interpretations with an existing Open IE system and observe an 7.5% increase in yield at a precision of 85%. The dataset and code are available at https://github.com/dair-iitd/pronci.


title: Pontryagin's Minimum Principle and Forward-Backward Sweep Method for the System of HJB-FP Equations in Memory-Limited Partially Observable Stochastic Control

abstract: Memory-limited partially observable stochastic control (ML-POSC) is the stochastic optimal control problem under incomplete information and memory limitation. In order to obtain the optimal control function of ML-POSC, a system of the forward Fokker-Planck (FP) equation and the backward Hamilton-Jacobi-Bellman (HJB) equation needs to be solved. In this work, we firstly show that the system of HJB-FP equations can be interpreted via the Pontryagin's minimum principle on the probability density function space. Based on this interpretation, we then propose the forward-backward sweep method (FBSM) to ML-POSC, which has been used in the Pontryagin's minimum principle. FBSM is an algorithm to compute the forward FP equation and the backward HJB equation alternately. Although the convergence of FBSM is generally not guaranteed, it is guaranteed in ML-POSC because the coupling of HJB-FP equations is limited to the optimal control function in ML-POSC.


title: Learning Neural Radiance Fields from Multi-View Geometry

abstract: We present a framework, called MVG-NeRF, that combines classical Multi-View Geometry algorithms and Neural Radiance Fields (NeRF) for image-based 3D reconstruction. NeRF has revolutionized the field of implicit 3D representations, mainly due to a differentiable volumetric rendering formulation that enables high-quality and geometry-aware novel view synthesis. However, the underlying geometry of the scene is not explicitly constrained during training, thus leading to noisy and incorrect results when extracting a mesh with marching cubes. To this end, we propose to leverage pixelwise depths and normals from a classical 3D reconstruction pipeline as geometric priors to guide NeRF optimization. Such priors are used as pseudo-ground truth during training in order to improve the quality of the estimated underlying surface. Moreover, each pixel is weighted by a confidence value based on the forward-backward reprojection error for additional robustness. Experimental results on real-world data demonstrate the effectiveness of this approach in obtaining clean 3D meshes from images, while maintaining competitive performances in novel view synthesis.


title: The symplectic leaves for the elliptic Poisson bracket on projective space defined by Feigin-Odesskii and Polishchuk

abstract: This paper determines the symplectic leaves for a remarkable Poisson structure on $\mathbb{C}\mathbb{P}^{n-1}$ discovered by Feigin and Odesskii, and, independently, by Polishchuk. The Poisson bracket is determined by a holomorphic line bundle of degree $n \ge 3$ on a compact Riemann surface of genus one or, equivalently, by an elliptic normal curve $E\subseteq\mathbb{C}\mathbb{P}^{n-1}$. The symplectic leaves are described in terms of higher secant varieties to $E$.


title: Data-IQ: Characterizing subgroups with heterogeneous outcomes in tabular data

abstract: High model performance, on average, can hide that models may systematically underperform on subgroups of the data. We consider the tabular setting, which surfaces the unique issue of outcome heterogeneity - this is prevalent in areas such as healthcare, where patients with similar features can have different outcomes, thus making reliable predictions challenging. To tackle this, we propose Data-IQ, a framework to systematically stratify examples into subgroups with respect to their outcomes. We do this by analyzing the behavior of individual examples during training, based on their predictive confidence and, importantly, the aleatoric (data) uncertainty. Capturing the aleatoric uncertainty permits a principled characterization and then subsequent stratification of data examples into three distinct subgroups (Easy, Ambiguous, Hard). We experimentally demonstrate the benefits of Data-IQ on four real-world medical datasets. We show that Data-IQ's characterization of examples is most robust to variation across similarly performant (yet different) models, compared to baselines. Since Data-IQ can be used with any ML model (including neural networks, gradient boosting etc.), this property ensures consistency of data characterization, while allowing flexible model selection. Taking this a step further, we demonstrate that the subgroups enable us to construct new approaches to both feature acquisition and dataset selection. Furthermore, we highlight how the subgroups can inform reliable model usage, noting the significant impact of the Ambiguous subgroup on model generalization.


title: Stringent constraint on CPT violation with the synergy of T2K-II, NO$\nu$A extension, and JUNO

abstract: Neutrino oscillation experiments have measured precisely the mass-squared differences of three neutrino mass eigenstates, and three leptonic mixing angles by utilizing both neutrino and anti-neutrino oscillations. The possible CPT violation may manifest itself in the difference of neutrino and anti-neutrino oscillation parameters, making these experiments promising tools for testing CPT invariance. We investigate empirically the sensitivity of the CPT test via the difference in mass-squared splittings ($\Delta m^2_{31} - \Delta \overline{m}^2_{31}$) and in leptonic mixing angles ($\sin^2\theta_{23} - \sin^2\overline{\theta}_{23}$) with the synergy of T2K-II, NO$\nu$A extension, and JUNO experiments. If the CPT symmetry is found to be conserved, the joint analysis of the three experiments will be able to establish limits of $|\Delta m^2_{31} - \Delta \overline{m}^2_{31}|$ < $5.3\times 10^{-3} \text{eV}^2$ and $|\sin^2\theta_{23} - \sin^2\overline{\theta}_{23}|$ < $0.10$ at 3$\sigma$ C. L. on the possible CPT violation. We find that with ($\Delta m^2_{31} - \Delta \overline{m}^2_{31}$), the dependence of the statistical significance on the relevant parameters to exclude the CPT conservation is marginal, and that, if the difference in the best-fit values of $\Delta m^2_{31}$ and $\Delta \overline{m}^2_{31}$ measured by MINOS(+) and NO$\nu$A persists as the true, the combined analysis will rule out the CPT conservation at 4$\sigma$ C. L.. With the ($\sin^2\theta_{23} - \sin^2\overline{\theta}_{23}$), the statistical significance to exclude CPT invariance depends strongly on the true value of $\theta_{23}(\overline{\theta}_{23})$. In case of maximal mixing of $\theta_{23}$, the CPT conservation will be excluded at 3$\sigma$ C. L. or more if the difference in the best-fit values of $\theta_{23}$ and $\overline{\theta}_{23}$ remains as the true.


title: Quadratic forms and Genus Theory : a link with 2-descent and an application to non-trivial specializations of ideal classes

abstract: Genus Theory is a classical feature of integral binary quadratic forms. Using the author's generalization of the well-known correspondence between quadratic form classes and ideal classes of quadratic algebras, we extend it to the case when quadratic forms are twisted and have coefficients in any PID $R$. When ${R = \mathbb{K}[X]}$, we show that the Genus Theory map is the quadratic form version of the $2$-descent map on a certain hyperelliptic curve. As an application, we make a contribution to a question of Agboola and Pappas regarding a specialization problem of divisor classes on hyperelliptic curves. Under suitable assumptions, we prove that the set of non-trivial specializations has density $1$.


title: Pixel detector hybridisation with Anisotropic Conductive Films

abstract: Hybrid pixel detectors require a reliable and cost-effective interconnect technology adapted to the pitch and die sizes of the respective applications. During the ASIC and sensor R&D phase, and in general for small-scale applications, such interconnect technologies need to be suitable for the assembly of single-dies, typically available from Multi-Project-Wafer submissions. Within the CERN EP R&D programme and the AIDAinnova collaboration, innovative hybridisation concepts targeting vertex-detector applications at future colliders are under development. This contribution presents recent results of a newly developed in-house single-die interconnection process based on Anisotropic Conductive Film (ACF). The ACF interconnect technology replaces the solder bumps with conductive particles embedded in an adhesive film. The electro-mechanical connection between the sensor and the read-out chip is achieved via thermo-compression of the ACF using a flip-chip device bonder. A specific pad topology is required to enable the connection via conductive particles and create cavities into which excess epoxy can flow. This pixel-pad topology is achieved with an in-house Electroless Nickel Immersion Gold (ENIG) plating process that is also under development within the project. The ENIG and ACF processes are qualified with the Timepix3 ASIC and sensors, with 55 um pixel pitch and 14 um pad diameter. The ACF technology can also be used for ASIC-PCB/FPC integration, replacing wire bonding or large-pitch solder bumping techniques. This contribution introduces the ENIG plating and ACF processes and presents recent results on Timepix3 hybrid assemblies.


title: EXK-SC: A Semantic Communication Model Based on Information Framework Expansion and Knowledge Collision

abstract: Semantic communication is not focused on improving the accuracy of transmitted symbols, but is concerned with expressing the expected meaning that the symbol sequence exactly carries. However, the measurement of semantic messages and their corresponding codebook generation are still open issues. Expansion, which integrates simple things into a complex system and even generates intelligence, is truly consistent with the evolution of the human language system. We apply this idea to the semantic communication system, quantifying semantic transmission by symbol sequences and investigating the semantic information system in a similar way as Shannon's method for digital communication systems. This work is the first to discuss semantic expansion and knowledge collision in the semantic information framework. Some important theoretical results are presented, including the relationship between semantic expansion and the transmission information rate. We believe such a semantic information framework may provide a new paradigm for semantic communications, and semantic expansion and knowledge collision will be the cornerstone of semantic information theory.

categories: cs.IT cs.GT cs.LG eess.SP math.IT math.ST stat.TH


title: A Note on Cohen's d From a Partitioned Linear Regression Model

abstract: In this note we introduce a generalized formula for Cohen's $d$ under the presence of additional independent variables, providing a measure for the size of a possible effect concerning the location difference of a variable in two groups. This is done by employing the so-called Frisch-Waugh-Lovell theorem in a partitioned linear regression model. The generalization is motivated by demonstrating the relationship to appropriate $t$ and $F$ statistics. Our discussion is further illustrated by inference from a publicly available data set.


title: Breakdown of detailed balance for thermal radiation by synthetic fields

abstract: In recent times the possibility of non-reciprocity in heat transfer between two bodies has been extensively studied. In particular the role of strong magnetic fields has been investigated. A much simpler approach with considerable flexibility would be to consider heat transfer in synthetic electric and magnetic fields which are easily applied. We demonstrate the breakdown of detailed balance for the heat transfer function $\mathcal{T} ({\omega})$, i.e. the spectrum of heat transfer between two objects due to the presence of synthetic electric and magnetic fields. The spectral measurements carry lot more physical information and were the reason for the quantum theory of radiation. We demonstrate explicitly the synthetic field induced non-reciprocity in the heat transfer transmission function between two graphene flakes and for the Casimir coupling between two objects. Unlike many other cases of heat transfer, the latter case has interesting features of the strong coupling. Further the presence of synthetic fields affects the mean occupation numbers of two membranes and propose this system for the experimental verification of the breakdown of detailed balance.


title: Structural generalization is hard for sequence-to-sequence models

abstract: Sequence-to-sequence (seq2seq) models have been successful across many NLP tasks, including ones that require predicting linguistic structure. However, recent work on compositional generalization has shown that seq2seq models achieve very low accuracy in generalizing to linguistic structures that were not seen in training. We present new evidence that this is a general limitation of seq2seq models that is present not just in semantic parsing, but also in syntactic parsing and in text-to-text tasks, and that this limitation can often be overcome by neurosymbolic models that have linguistic knowledge built in. We further report on some experiments that give initial answers on the reasons for these limitations.


title: Understanding thermal induced escape mechanism of optically levitated sphere in vacuum

abstract: The escape phenomenon, mainly caused by thermal effects, is known as an obstacle to the further practical application of optical levitation system in vacuum. Irregular photophoresis induced by thermal effects can act as an amplifier of Brownian motion. Studies on this topic provide interpretation for particle escaping phenomenon during the pressure decreasing process, as well as valuable insights into the micro- and nanoscale thermal effects in optical trap in vacuum. In this paper, we derive and test a dynamic model for the motion of an optically levitated particle in a non-equilibrium state and demonstrate the escaping mechanism of heated particles. The result of theoretical investigations is consistent with experimental escape at 0.1mbar. This work reveals and provides a theoretical basis for the stable operation of laser levitated oscillator in high vacuum and pave the way for the practicability of ultra-sensitive sensing devices.


title: A delayed 400 GeV photon from GRB 221009A and implication on the intergalactic magnetic field

abstract: Large High Altitude Air Shower Observatory has detected $0.2-13$ TeV emission of GRB 221009A within 2000 s since the trigger. Here we report the detection of a 400 GeV photon, without accompanying prominent low-energy emission, by Fermi Large Area Telescope in this direction with a 0.4 days' delay. Given an intergalactic magnetic field strength of about $4 \times 10^{-17}$ G, which is comparable to limits from TeV blazars, the delayed 400 GeV photon can be explained as the cascade emission of about 10 TeV gamma rays. We estimate the probabilities of the cascade emission that can result in one detectable photon beyond 100 GeV by Fermi Large Area Telescope within $0.3-1$ days is about 2$\%$ whereas it is about 20.5$\%$ within $0.3-250$ days. Our results show that Synchrotron Self-Compton explanation is less favored with probabilities lower by a factor of about $3-30$ than the cascade scenario.


title: Foreground Guidance and Multi-Layer Feature Fusion for Unsupervised Object Discovery with Transformers

abstract: Unsupervised object discovery (UOD) has recently shown encouraging progress with the adoption of pre-trained Transformer features. However, current methods based on Transformers mainly focus on designing the localization head (e.g., seed selection-expansion and normalized cut) and overlook the importance of improving Transformer features. In this work, we handle UOD task from the perspective of feature enhancement and propose FOReground guidance and MUlti-LAyer feature fusion for unsupervised object discovery, dubbed FORMULA. Firstly, we present a foreground guidance strategy with an off-the-shelf UOD detector to highlight the foreground regions on the feature maps and then refine object locations in an iterative fashion. Moreover, to solve the scale variation issues in object detection, we design a multi-layer feature fusion module that aggregates features responding to objects at different scales. The experiments on VOC07, VOC12, and COCO 20k show that the proposed FORMULA achieves new state-of-the-art results on unsupervised object discovery. The code will be released at https://github.com/VDIGPKU/FORMULA.


title: PARAFAC2-based Coupled Matrix and Tensor Factorizations

abstract: Coupled matrix and tensor factorizations (CMTF) have emerged as an effective data fusion tool to jointly analyze data sets in the form of matrices and higher-order tensors. The PARAFAC2 model has shown to be a promising alternative to the CANDECOMP/PARAFAC (CP) tensor model due to its flexibility and capability to handle irregular/ragged tensors. While fusion models based on a PARAFAC2 model coupled with matrix/tensor decompositions have been recently studied, they are limited in terms of possible regularizations and/or types of coupling between data sets. In this paper, we propose an algorithmic framework for fitting PARAFAC2-based CMTF models with the possibility of imposing various constraints on all modes and linear couplings, using Alternating Optimization (AO) and the Alternating Direction Method of Multipliers (ADMM). Through numerical experiments, we demonstrate that the proposed algorithmic approach accurately recovers the underlying patterns using various constraints and linear couplings.


title: A Unified Framework for Pun Generation with Humor Principles

abstract: We propose a unified framework to generate both homophonic and homographic puns to resolve the split-up in existing works. Specifically, we incorporate three linguistic attributes of puns to the language models: ambiguity, distinctiveness, and surprise. Our framework consists of three parts: 1) a context words/phrases selector to promote the aforementioned attributes, 2) a generation model trained on non-pun sentences to incorporate the context words/phrases into the generation output, and 3) a label predictor that learns the structure of puns which is used to steer the generation model at inference time. Evaluation results on both pun types demonstrate the efficacy of our model over strong baselines.


title: Donoho-Logan large sieve principles for the wavelet transform

abstract: In this paper we formulate Donoho and Logan's large sieve principle for the wavelet transform on the Hardy space, adapting the concept of maximum Nyquist density to the hyperbolic geometry of the underlying space. The results provide deterministic guarantees for $L_{1}$-minimization methods and hold for a class of mother wavelets which constitute an orthonormal basis of the Hardy space and can be associated with higher hyperbolic Landau levels. Explicit calculations of the basis functions reveal a connection with the Zernike polynomials. We prove a novel local reproducing formula for the spaces in consideration and use it to derive concentration estimates of the large sieve type for the corresponding wavelet transforms. We conclude with a discussion of optimality of localization in the analytic case by building on recent results of Kulikov, Ramos and Tilli based on the groundbreaking methods of Nicola and Tilli. This leads to a sharp uncertainty principle and a local Lieb inequality for the wavelet transform.


title: Certifying Induced Subgraphs in Large Graphs

abstract: We introduce I/O-optimal certifying algorithms for bipartite graphs, as well as for the classes of split, threshold, bipartite chain, and trivially perfect graphs. When the input graph is a class member, the certifying algorithm returns a certificate that characterizes this class. Otherwise, it returns a forbidden induced subgraph as a certificate for non-membership. On a graph with $n$ vertices and $m$ edges, our algorithms take optimal $O(\text{sort}(n + m))$ I/Os in the worst case or with high probability for bipartite chain graphs, and the certificates are returned in optimal I/Os. We give implementations for split and threshold graphs and provide an experimental evaluation.


title: Study of $e^+e^-\to\gamma\phi J/\psi$ from $\sqrt{s}=4.600$ to $4.951$ GeV

abstract: Using data samples with an integrated luminosity of $6.4$~fb$^{-1}$ collected by the BESIII detector operating at the BEPCII storage ring, the process of $e^+e^-\to\gamma\phi J/\psi$ is studied. The processes of $e^+e^-\to\phi\chi_{c1,c2}$, $\chi_{c1,c2}\to\gamma J/\psi$ are observed with a significance of more than $10\sigma$. The $\sqrt{s}$-dependent cross section of $e^+e^- \to \phi\chi_{c1,c2}$ is measured between 4.600 and 4.951~GeV, and evidence of a resonance structure is found for the first time in the $\phi\chi_{c2}$ process. We also search for the processes of $e^+e^-\to\gamma X(4140)$, $\gamma X(4274)$ and $\gamma X(4500)$ via the $\gamma\phi J/\psi$ final state, but no obvious structures are found. The upper limits on the production cross section times the branching fraction for these processes at the 90% confidence level are reported.


title: Radiative Symmetry breaking, Cosmic Strings and Observable Gravity Waves in $U(1)_R$ symmetric $SU(5) \times U(1)_{\chi}$

abstract: We implement shifted hybrid inflation in the framework of supersymmetric $SU(5) \times U(1)_{\chi}$ GUT model which provides a natural solution to the monopole problem appearing in the spontaneous symmetry breaking of $SU(5)$. The $U(1)_{\chi}$ symmetry is radiatevely broken after the end of inflation at an intermediate scale, yielding topologically stable cosmic strings. The Planck's bound on the gravitational interaction strength of these strings, characterized by $G_N \mu_s$ are easily satisfied with the $U(1)_{\chi}$ symmetry breaking scale which depends on the initial boundary conditions at the GUT scale. The dimension-5 proton lifetime for the decay $p \rightarrow K^+ \bar{\nu}$, mediated by color-triplet Higgsinos is found to satisfy current Super-Kamiokande bounds for SUSY breaking scale $M_{\text{SUSY}} \gtrsim 12.5$ TeV. We show that with minimal K\"ahler potential, the soft supersymmetry breaking terms play a vital role in bringing the scalar spectral index $n_s$ within the Planck's latest bounds, although with small tensor modes $r \lesssim 2.5 \times 10^{-6}$ and $SU(5)$ gauge symmetry breaking scale in the range ($2 \times 10^{15} \lesssim M_{\alpha} \lesssim 2 \times 10^{16}$) GeV. By employing non-minimal terms in the K\"ahler potential, the tensor-to-scalar ratio approaches observable values ($r \lesssim 10^{-3}$) with the $SU(5)$ symmetry breaking scale $M_{\alpha} \simeq 2 \times 10^{16}$ GeV.


title: Is the Envelope Beneficial to Non-Orthogonal Multiple Access?

abstract: Non-orthogonal multiple access (NOMA) is capable of serving different numbers of users in the same time-frequency resource element, and this feature can be leveraged to carry additional information. In the orthogonal frequency division multiplexing (OFDM) system, we propose a novel enhanced NOMA scheme, called NOMA with informative envelope (NOMA-IE), to explore the flexibility of the envelope of NOMA signals. In this scheme, data bits are conveyed by the quantified signal envelope in addition to classic signal constellations. The subcarrier activation patterns of different users are jointly decided by the envelope former. At the receiver, successive interference cancellation (SIC) is employed, and we also introduce the envelope detection coefficient to eliminate the error floor. Theoretical expressions of spectral efficiency and energy efficiency are provided for the NOMA-IE. Then, considering the binary phase shift keying modulation, we derive the asymptotic bit error rate for the two-subcarrier OFDM subblock. Afterwards, the expressions are extended to the four-subcarrier case. The analytical results reveal that the imperfect SIC and the index error are the main factors degrading the error performance. The numerical results demonstrate the superiority of the NOMA-IE over the OFDM and OFDM-NOMA, especially in the high signal-to-noise ratio (SNR) regime.


title: Ab-initio calculation of the Hubbard $U$ and Hund exchange $J$ in local moment magnets: The case of Mn-based full Heusler compounds

abstract: Mn-based full Heusler compounds possess well-defined local atomic Mn moments, and thus the correlation effects between localized d electrons are expected to play an important role in determining the electronic and magnetic properties of these materials. Employing ab-initio calculations in conjunction with the constrained random-phase approximation (cRPA) method, we calculate the strength of the effective on-site Coulomb interaction parameters (Hubbard U and Hund exchange J) in the case of X2MnZ full Heusler compounds with X being one of Ni, Pd or Cu, and Z being one of In, Sn, Sb or Te. We show that the Z element (or sp element) in Heusler compounds significantly reduces the strength of the Hubbard U parameter for Mn 3d electrons compared to the elementary bulk Mn. On the contrary, the effect of the sp-atom on the strength of the U parameter of Ni, Cu or Pd valence d electrons is not so substantial with respect to the elementary bulk values. The U values for all transition metal atoms decrease with increasing sp electron number in the In-Sn-Sb-Te sequence. Our cRPA calculations reveal that despite their well-defined local magnetic moments, the Mn-based full Heusler alloys fall into the category of the weakly correlated materials.


title: A partial order view of message-passing communication models

abstract: There is a wide variety of message-passing communication models, ranging from synchronous ''rendez-vous'' communications to fully asynchronous/out-of-order communications. For large-scale distributed systems, the communication model is determined by the transport layer of the network, and a few classes of orders of message delivery (FIFO, causally ordered) have been identified in the early days of distributed computing. For local-scale message-passing applications, e.g., running on a single machine, the communication model may be determined by the actual implementation of message buffers and by how FIFO queues are used. While large-scale communication models, such as causal ordering, are defined by logical axioms, local-scale models are often defined by an operational semantics. In this work, we connect these two approaches, and we present a unified hierarchy of communication models encompassing both large-scale and local-scale models, based on their concurrent behaviors. We also show that all the communication models we consider can be axiomatized in the monadic second order logic, and may therefore benefit from several bounded verification techniques based on bounded special treewidth.


title: Scalable Program Clone Search Through Spectral Analysis

abstract: We consider the problem of program clone search, i.e. given a target program and a repository of known programs (all in executable format), the goal is to find the program in the repository most similar to the target program - with potential applications in terms of reverse engineering, program clustering, malware lineage and software theft detection. Recent years have witnessed a blooming in code similarity techniques, yet most of them focus on function-level similarity and function clone search, while we are interested in program-level similarity and program clone search. Actually, our study shows that prior similarity approaches are either too slow to handle large program repositories, or not precise enough, or yet not robust against slight variations introduced by compilers, source code versions or light obfuscations. We propose a novel spectral analysis method for program-level similarity and program clone search called Programs Spectral Similarity (PSS). In a nutshell, PSS one-time spectral feature extraction is tailored for large repositories, making it a perfect fit for program clone search. We have compared the different approaches with extensive benchmarks, showing that PSS reaches a sweet spot in terms of precision, speed and robustness.


title: How Bad is Selfish Driving? Bounding the Inefficiency of Equilibria in Urban Driving Games

abstract: We consider the interaction among agents engaging in a driving task and we model it as general-sum game. This class of games exhibits a plurality of different equilibria posing the issue of equilibrium selection. While selecting the most efficient equilibrium (in term of social cost) is often impractical from a computational standpoint, in this work we study the (in)efficiency of any equilibrium players might agree to play. More specifically, we bound the equilibrium inefficiency by modeling driving games as particular type of congestion games over spatio-temporal resources. We obtain novel guarantees that refine existing bounds on the Price of Anarchy (PoA) as a function of problem-dependent game parameters. For instance, the relative trade-off between proximity costs and personal objectives such as comfort and progress. Although the obtained guarantees concern open-loop trajectories, we observe efficient equilibria even when agents employ closed-loop policies trained via decentralized multi-agent reinforcement learning.


title: Proportional marginal effects for global sensitivity analysis

abstract: Performing (variance-based) global sensitivity analysis (GSA) with dependent inputs has recently benefited from cooperative game theory concepts.By using this theory, despite the potential correlation between the inputs, meaningful sensitivity indices can be defined via allocation shares of the model output's variance to each input. The ``Shapley effects'', i.e., the Shapley values transposed to variance-based GSA problems, allowed for this suitable solution. However, these indices exhibit a particular behavior that can be undesirable: an exogenous input (i.e., which is not explicitly included in the structural equations of the model) can be associated with a strictly positive index when it is correlated to endogenous inputs. In the present work, the use of a different allocation, called the ``proportional values'' is investigated. A first contribution is to propose an extension of this allocation, suitable for variance-based GSA. Novel GSA indices are then proposed, called the ``proportional marginal effects'' (PME). The notion of exogeneity is formally defined in the context of variance-based GSA, and it is shown that the PME allow the distinction of exogenous variables, even when they are correlated to endogenous inputs. Moreover, their behavior is compared to the Shapley effects on analytical toy-cases and more realistic use-cases.


title: DaXBench: Benchmarking Deformable Object Manipulation with Differentiable Physics

abstract: Deformable Object Manipulation (DOM) is of significant importance to both daily and industrial applications. Recent successes in differentiable physics simulators allow learning algorithms to train a policy with analytic gradients through environment dynamics, which significantly facilitates the development of DOM algorithms. However, existing DOM benchmarks are either single-object-based or non-differentiable. This leaves the questions of 1) how a task-specific algorithm performs on other tasks and 2) how a differentiable-physics-based algorithm compares with the non-differentiable ones in general. In this work, we present DaXBench, a differentiable DOM benchmark with a wide object and task coverage. DaXBench includes 9 challenging high-fidelity simulated tasks, covering rope, cloth, and liquid manipulation with various difficulty levels. To better understand the performance of general algorithms on different DOM tasks, we conduct comprehensive experiments over representative DOM methods, ranging from planning to imitation learning and reinforcement learning. In addition, we provide careful empirical studies of existing decision-making algorithms based on differentiable physics, and discuss their limitations, as well as potential future directions.


title: 10 hours data is all you need

abstract: We propose a novel procedure to generate pseudo mandarin speech data named as CAMP (character audio mix up), which aims at generating audio from a character scale. We also raise a method for building a mandarin character scale audio database adaptive to CAMP named as META-AUDIO, which makes full use of audio data and can greatly increase the data diversity of the database. Experiments show that our CAMP method is simple and quite effective. For example, we train models with 10 hours of audio data in AISHELL-1 and pseudo audio data generated by CAMP, and achieve a competitive 11.07 character error rate (CER). Besides, we also perform training with only 10 hours of audio data in AIDATATANG dataset and pseudo audio data generated by CAMP, which again achieves a competitive 8.26 CER.


title: Coron's problem for the critical Lane-Emden system

abstract: In this paper, we address the solvability of the critical Lane-Emden system \[\begin{cases} -\Delta u=|v|^{p-1}v &\mbox{in } \Omega_\epsilon,\\ -\Delta v=|u|^{q-1}u &\mbox{in } \Omega_\epsilon,\\ u=v=0 &\mbox{on } \partial \Omega_\epsilon, \end{cases}\] where $N \ge 4$, $p \in (1,\frac{N-1}{N-2})$, $\frac{1}{p+1} + \frac{1}{q+1}=\frac{N-2}{N}$, and $\Omega_\epsilon$ is a smooth bounded domain with a small hole of radius $\epsilon > 0$. We prove that the system admits a family of positive solutions that concentrate around the center of the hole as $\epsilon \to 0$, obtaining a concrete qualitative description of the solutions as well. To the best of our knowledge, this is the first existence result for the critical Lane-Emden system on a bounded domain, while the non-existence result on star-shaped bounded domains has been known since the early 1990s due to Mitidieri (1993) [30] and van der Vorst (1991) [36].


title: Factorized structure of the long-range two-electron integrals tensor and its application in quantum chemistry

abstract: We introduce two new approximation methods for the numerical evaluation of the long-range Coulomb potential and the approximation of the resulting high dimensional Two-Electron Integrals tensor (TEI) with long-range interactions arising in molecular simulations. The first method exploits the tensorized structure of the compressed two-electron integrals obtained through two-dimensional Chebyshev interpolation combined with Gaussian quadrature. The second method is based on the Fast Multipole Method (FMM). Numerical experiments for different medium size molecules on high quality basis sets outline the efficiency of the two methods. Detailed algorithmic is provided in this paper as well as numerical comparison of the introduced approaches.


title: Perception of the Environment

abstract: This chapter discusses the intricacies of cybersecurity agents' perception. It addresses the complexity of perception and illuminates how perception shapes and influences the decision-making process. It then explores the necessary considerations when crafting the world representation and discusses the power and bandwidth constraints of perception and the underlying issues of AICA's trust in perception. On these foundations, it provides the reader with a guide to developing perception models for AICA, discussing the trade-offs of each objective state approximation. The guide is written in the context of the CYST cybersecurity simulation engine, which aims to closely model cybersecurity interactions and can be used as a basis for developing AICA. Because CYST is freely available, the reader is welcome to try implementing and evaluating the proposed methods for themselves.


title: Normal split submanifolds of rational homogeneous spaces

abstract: Let $M \subset X$ be a submanifold of a rational homogeneous space $X$ such that the normal sequence splits. We prove that $M$ is also rational homogeneous.


title: Demystifying the characterization of SDP matrices in mathematical programming

abstract: This manuscript was written because I found no other introduction to SDP programming that targets the same audience. A first difference compared to other existing introductions to SDP is that this work comes out of a mind that was itself struggling to understand. This may seem to be only a weakness, but, paradoxically, it is both a weakness and a strength. First, I did not try to overpower the reader, but I tried to minimize the distance between the author and the reader as much as possible, even hoping to achieve a small level of mutual empathy. This enabled me avoid a quite common pitfall: many long-acknowledged experts tend to forget the difficulties of beginners. Other experts try to make all proofs as short as possible and to dismiss as unimportant certain key results they have seen thousands of time in their career. I also avoided this, even if I did shorten a few proofs when I revised this manuscript two years after it was first written. However, I also kept certain proofs that seem longer than necessary because I feel they offer more insight; an important goal is to capture the "spirit" of each proven result instead of reducing it to a flow of formulae. The very first key step towards mastering SDP programming is to get full insight into the eigen-decomposition of real symmetric matrices. It is enough to see the way many other introductions to SDP programming address this eigen-decomposition to understand that their target audience is different from mine. They often list the eigen-decomposition without proof, while I give two proofs to really familiarize the reader with it.


title: Simulation of conduction cooling of a 650MHz 5-cell cavity

abstract: The research note presents results of coupled RF and thermal simulation of a cryocooler conduction cooled 650 MHz SRF cavity made of bulk niobium and coated with Nb3Sn on the RF surface. The cavity is part of a particle accelerator design capable of producing 10 MeV, 1000 kW electron beam for application in wastewater treatment. More details of the accelerator design are presented in R.C. Dhuley et al. (2022) Phys. Rev. Accel. Beams 25, 041601.


title: Radiation of ionization electrons: the key role of their 2-pt function of velocities

abstract: Several attempts to detect extensive air showers (EAS) induced by ultra-high energy cosmic rays have been conducted in the last decade based on the molecular Bremsstrahlung radiation (MBR) at GHz frequencies from quasi-elastic collisions of ionisation electrons left in the atmosphere after the passage of the cascade of particles. These attempts have led to the detection of a handful of signals only, all of them forward-directed along the shower axis and hence suggestive of originating from geomagnetic and Askaryan emissions extending into GHz frequencies close to the Cherenkov angle. In this contribution to ARENA2022, the lack of detection of events is explained by the coherent suppression of the MBR in frequency ranges below the collision rate due to the destructive interference impacting the emission amplitude of photons between the successive collisions of the electrons. The spectral intensity at the ground level is shown to be several orders of magnitude below the sensitivity of experimental setups. Consequently the MBR cannot be seen as the basis of a new detection technique of EAS for the next decades. The formalism developed to get at this conclusion allowed the key role of the two-point correlation function of the ionisation electron velocities to be highlighted. This can serve to study the intensity of the re-radiation of these ionization electrons subject to the passage of an incoming coherent wave from a radar transmitter. Some hints on this will be presented.


title: Hardness in Markov Decision Processes: Theory and Practice

abstract: Meticulously analysing the empirical strengths and weaknesses of reinforcement learning methods in hard (challenging) environments is essential to inspire innovations and assess progress in the field. In tabular reinforcement learning, there is no well-established standard selection of environments to conduct such analysis, which is partially due to the lack of a widespread understanding of the rich theory of hardness of environments. The goal of this paper is to unlock the practical usefulness of this theory through four main contributions. First, we present a systematic survey of the theory of hardness, which also identifies promising research directions. Second, we introduce Colosseum, a pioneering package that enables empirical hardness analysis and implements a principled benchmark composed of environments that are diverse with respect to different measures of hardness. Third, we present an empirical analysis that provides new insights into computable measures. Finally, we benchmark five tabular agents in our newly proposed benchmark. While advancing the theoretical understanding of hardness in non-tabular reinforcement learning remains essential, our contributions in the tabular setting are intended as solid steps towards a principled non-tabular benchmark. Accordingly, we benchmark four agents in non-tabular versions of Colosseum environments, obtaining results that demonstrate the generality of tabular hardness measures.


title: Towards Unifying Reference Expression Generation and Comprehension

abstract: Reference Expression Generation (REG) and Comprehension (REC) are two highly correlated tasks. Modeling REG and REC simultaneously for utilizing the relation between them is a promising way to improve both. However, the problem of distinct inputs, as well as building connections between them in a single model, brings challenges to the design and training of the joint model. To address the problems, we propose a unified model for REG and REC, named UniRef. It unifies these two tasks with the carefully-designed Image-Region-Text Fusion layer (IRTF), which fuses the image, region and text via the image cross-attention and region cross-attention. Additionally, IRTF could generate pseudo input regions for the REC task to enable a uniform way for sharing the identical representation space across the REC and REG. We further propose Vision-conditioned Masked Language Modeling (VMLM) and Text-Conditioned Region Prediction (TRP) to pre-train UniRef model on multi-granular corpora. The VMLM and TRP are directly related to REG and REC, respectively, but could help each other. We conduct extensive experiments on three benchmark datasets, RefCOCO, RefCOCO+ and RefCOCOg. Experimental results show that our model outperforms previous state-of-the-art methods on both REG and REC.


title: EpipolarNVS: leveraging on Epipolar geometry for single-image Novel View Synthesis

abstract: Novel-view synthesis (NVS) can be tackled through different approaches, depending on the general setting: a single source image to a short video sequence, exact or noisy camera pose information, 3D-based information such as point clouds etc. The most challenging scenario, the one where we stand in this work, only considers a unique source image to generate a novel one from another viewpoint. However, in such a tricky situation, the latest learning-based solutions often struggle to integrate the camera viewpoint transformation. Indeed, the extrinsic information is often passed as-is, through a low-dimensional vector. It might even occur that such a camera pose, when parametrized as Euler angles, is quantized through a one-hot representation. This vanilla encoding choice prevents the learnt architecture from inferring novel views on a continuous basis (from a camera pose perspective). We claim it exists an elegant way to better encode relative camera pose, by leveraging 3D-related concepts such as the epipolar constraint. We, therefore, introduce an innovative method that encodes the viewpoint transformation as a 2D feature image. Such a camera encoding strategy gives meaningful insights to the network regarding how the camera has moved in space between the two views. By encoding the camera pose information as a finite number of coloured epipolar lines, we demonstrate through our experiments that our strategy outperforms vanilla encoding.


title: Study of a division-like property

abstract: We introduce a weak division-like property for noncommutative rings: a nontrivial ring is fadelian if for all nonzero $a,x$ there exist $b,c$ such that $x=ab+ca$. We prove properties of fadelian rings, and construct examples of such rings which are not division rings, as well as non-Noetherian and non-Ore examples. We have also formalized some of these results in the Lean proof assistant.


title: mm-Wave Radar Hand Shape Classification Using Deformable Transformers

abstract: A novel, real-time, mm-Wave radar-based static hand shape classification algorithm and implementation are proposed. The method finds several applications in low cost and privacy sensitive touchless control technology using 60 Ghz radar as the sensor input. As opposed to prior Range-Doppler image based 2D classification solutions, our method converts raw radar data to 3D sparse cartesian point clouds.The demonstrated 3D radar neural network model using deformable transformers significantly surpasses the performance results set by prior methods which either utilize custom signal processing or apply generic convolutional techniques on Range-Doppler FFT images. Experiments are performed on an internally collected dataset using an off-the-shelf radar sensor.


title: Primitive recursive reverse mathematics

abstract: We use a second-order analogy $\mathsf{PRA}^2$ of $\mathsf{PRA}$ to investigate the proof-theoretic strength of theorems in countable algebra, analysis, and infinite combinatorics. We compare our results with similar results in the fast-developing field of primitive recursive (\lq punctual\rq) algebra and analysis, and with results from \lq online\rq\ combinatorics. We argue that $\mathsf{PRA}^2$ is sufficiently robust to serve as an alternative base system below $\mathsf{RCA}_0$ to study the proof-theoretic content of theorems in ordinary mathematics. (The most popular alternative is perhaps $\mathsf{RCA}_0^*$.) We discover that many theorems that are known to be true in $\mathsf{RCA}_0$ either hold in $\mathsf{PRA}^2$ or are equivalent to $\mathsf{RCA}_0$ or its weaker (but natural) analogy $2^N-\mathsf{RCA}_0$ over $\mathsf{PRA}^2$. However, we also discover that some standard mathematical and combinatorial facts are incomparable with these natural subsystems.


title: Shifted Convolution Sums for $GL(3)\times GL(2)$ Averaged over weighted sets

abstract: Let $A(1,m)$ be the Fourier coefficients of a $SL(3,\mathbb{Z})$ Hecke-Maass cusp form $\pi_1$ and $\lambda(m)$ be those of a $SL(2,\mathbb{Z})$ Hecke holomorphic or Hecke-Mass cusp form $\pi_2$. Let $\mathcal{H}\subset[\![ -X^{1-\varepsilon},X^{1+\varepsilon}]\!]$ and $\{a(h)\}_{h\in\mathcal{H}}\subset\mathbb{C}$ be a sequence. We show that if $\mathcal{H}\subset \ell+[\![ 0,X^{1/2+\varepsilon}]\!] $ for some $\ell\geq0$, \begin{align*} D_{a,\mathcal{H}}(X):=\frac{1}{|\mathcal{H}|}\sum_{h\in\mathcal{H}}a(h)\sum_{m=1}^\infty A(1,m)\lambda(rm+h)V\left(\frac{m}{X}\right)\ll_{\pi_1,\pi_2,\varepsilon} \frac{X^{1+\varepsilon}}{|\mathcal{H}|}\|a\|_2 \end{align*} for any $\varepsilon>0$, and a similar bound when $|\mathcal{H}|$ is big. This improves Sun's bound and generalizes it to an average with arbitrary weights. Moreover, we demonstrate how one can recover the factorizable moduli structure given by the Jutila's circle method via studying a shifted sum with weighted average. This allows us to recover Munshi's bound on the shifted sum with a fixed shift without using the Jutila's circle method.


title: Are Deep Sequence Classifiers Good at Non-Trivial Generalization?

abstract: Recent advances in deep learning models for sequence classification have greatly improved their classification accuracy, specially when large training sets are available. However, several works have suggested that under some settings the predictions made by these models are poorly calibrated. In this work we study binary sequence classification problems and we look at model calibration from a different perspective by asking the question: Are deep learning models capable of learning the underlying target class distribution? We focus on sparse sequence classification, that is problems in which the target class is rare and compare three deep learning sequence classification models. We develop an evaluation that measures how well a classifier is learning the target class distribution. In addition, our evaluation disentangles good performance achieved by mere compression of the training sequences versus performance achieved by proper model generalization. Our results suggest that in this binary setting the deep-learning models are indeed able to learn the underlying class distribution in a non-trivial manner, i.e. by proper generalization beyond data compression.


title: Scalable Representation Learning in Linear Contextual Bandits with Constant Regret Guarantees

abstract: We study the problem of representation learning in stochastic contextual linear bandits. While the primary concern in this domain is usually to find realizable representations (i.e., those that allow predicting the reward function at any context-action pair exactly), it has been recently shown that representations with certain spectral properties (called HLS) may be more effective for the exploration-exploitation task, enabling LinUCB to achieve constant (i.e., horizon-independent) regret. In this paper, we propose BanditSRL, a representation learning algorithm that combines a novel constrained optimization problem to learn a realizable representation with good spectral properties with a generalized likelihood ratio test to exploit the recovered representation and avoid excessive exploration. We prove that BanditSRL can be paired with any no-regret algorithm and achieve constant regret whenever an HLS representation is available. Furthermore, BanditSRL can be easily combined with deep neural networks and we show how regularizing towards HLS representations is beneficial in standard benchmarks.


title: Full-Text Argumentation Mining on Scientific Publications

abstract: Scholarly Argumentation Mining (SAM) has recently gained attention due to its potential to help scholars with the rapid growth of published scientific literature. It comprises two subtasks: argumentative discourse unit recognition (ADUR) and argumentative relation extraction (ARE), both of which are challenging since they require e.g. the integration of domain knowledge, the detection of implicit statements, and the disambiguation of argument structure. While previous work focused on dataset construction and baseline methods for specific document sections, such as abstract or results, full-text scholarly argumentation mining has seen little progress. In this work, we introduce a sequential pipeline model combining ADUR and ARE for full-text SAM, and provide a first analysis of the performance of pretrained language models (PLMs) on both subtasks. We establish a new SotA for ADUR on the Sci-Arg corpus, outperforming the previous best reported result by a large margin (+7% F1). We also present the first results for ARE, and thus for the full AM pipeline, on this benchmark dataset. Our detailed error analysis reveals that non-contiguous ADUs as well as the interpretation of discourse connectors pose major challenges and that data annotation needs to be more consistent.


title: Mass spectra of double-bottom baryons

abstract: Based on the relativistic quark model and the infinitesimally shifted Gaussian basis function method, we investigate the mass spectra of double bottom baryons systematically. In the $\rho$-mode which appears lower in energy than the other excited modes, we obtain the allowed quantum states and perform a systematic study of the mass spectra of the $\Xi_{bb}$ and $\Omega_{bb}$ families. We analyze the root mean square radii and quark radial probability density distributions to deeply understand the structure of the heavy baryons. Meanwhile, the mass spectra allow us to successfully construct the Regge trajectories in the $(J,M^{2})$ plane. We also predict the masses of the ground states of double bottom baryons and discuss the differences between the structures of our spectra and those from other theoretical methods. At last, the shell structure of the double bottom baryon spectra is shown, from which one could get a bird's-eye view of the mass spectra.


title: Legal-Tech Open Diaries: Lesson learned on how to develop and deploy light-weight models in the era of humongous Language Models

abstract: In the era of billion-parameter-sized Language Models (LMs), start-ups have to follow trends and adapt their technology accordingly. Nonetheless, there are open challenges since the development and deployment of large models comes with a need for high computational resources and has economical consequences. In this work, we follow the steps of the R&D group of a modern legal-tech start-up and present important insights on model development and deployment. We start from ground zero by pre-training multiple domain-specific multi-lingual LMs which are a better fit to contractual and regulatory text compared to the available alternatives (XLM-R). We present benchmark results of such models in a half-public half-private legal benchmark comprising 5 downstream tasks showing the impact of larger model size. Lastly, we examine the impact of a full-scale pipeline for model compression which includes: a) Parameter Pruning, b) Knowledge Distillation, and c) Quantization: The resulting models are much more efficient without sacrificing performance at large.


title: Green laser powder bed fusion based fabrication and rate-dependent mechanical properties of copper lattices

abstract: Lattice structures composed of periodic solid frames and pores can be utilized in energy absorption applications due to their high specific strength and large deformation. However, these structures typically suffer from post-yield softenings originating from the limited plasticity of available material choices. This study aims to resolve such an issue by fabricating lattice structures made of ductile pure copper (Cu). For the first time, Cu lattice structures are fabricated through laser-powder bed fusion (L-PBF) with green laser ({\lambda} = 515 nm). Structural and microstructural analysis confirm that the lattice structures consist of well-defined unit cells and show dense microstructure. The deformation behavior is investigated under a wide range of strain rates from ~0.001 /s to ~1000 /s. The stress-strain curves exhibit a smooth and continuous deformation without any post-yield softening, which can be attributed to the intrinsic mechanical properties of Cu. Correlated with post-mortem microscopy examination, the rate-dependent deformation behavior of pure Cu lattice structures is investigated and rationalized. The current work suggests that the complex Cu architectures can be fabricated by L-PBF with green laser and the lattice structures made of ductile metal are suitable for dynamic loading applications.


title: Your Router is My Prober: Measuring IPv6 Networks via ICMP Rate Limiting Side Channels

abstract: Active Internet measurements face challenges when some measurements require many remote vantage points. In this paper, we propose a novel technique for measuring remote IPv6 networks via side channels in ICMP rate limiting, a required function for IPv6 nodes to limit the rate at which ICMP error messages are generated. This technique, iVantage, can to some extent use 1.1M remote routers distributed in 9.5k autonomous systems and 182 countries as our "vantage points". We apply iVantage to two different, but both challenging measurement tasks: 1) measuring the deployment of inbound source address validation (ISAV) and 2) measuring reachability between arbitrary Internet nodes. We accomplish these two tasks from only one local vantage point without controlling the targets or relying on other services within the target networks. Our large-scale ISAV measurements cover ~50% of all IPv6 autonomous systems and find ~79% of them are vulnerable to spoofing, which is the most large-scale measurement study of IPv6 ISAV to date. Our method for reachability measurements achieves over 80% precision and recall in our evaluation. Finally, we perform an Internet-wide measurement of the ICMP rate limiting implementations, present a detailed discussion on ICMP rate limiting, particularly the potential security and privacy risks in the mechanism of ICMP rate limiting, and provide possible mitigation measures. We make our code available to the community.


title: An agent-based epidemics simulation to compare and explain screening and vaccination prioritisation strategies

abstract: This paper describes an agent-based model of epidemics dynamics. This model is willingly simplified, as its goal is not to predict the evolution of the epidemics, but to explain the underlying mechanisms in an interactive way. This model allows to compare screening prioritisation strategies, as well as vaccination priority strategies, on a virtual population. The model is implemented in Netlogo in different simulators, published online to let people experiment with them. This paper reports on the model design, implementation, and experimentations. In particular we have compared screening strategies to evaluate the epidemics vs control it by quarantining infectious people; and we have compared vaccinating older people with more risk factors, vs younger people with more social contacts.


title: Evolution of topological end states in the one-dimensional Kondo-Heisenberg model with site modulation

abstract: We investigate the interplay of the topological and Kondo effects in a one-dimensional Kondo-Heisenberg model with nontrivial conduction band using the density matrix renormalization group method. By analyzing the density profile, the local hybridization, and the spin/charge gap, we find that the Kondo effect can be destructed at the edges of the chain by the topological end state below a finite critical Kondo coupling $J_{K}^{c}$. We construct a phase diagram characterizing the transition of the end states.


title: On the dust of tailless Oort-cloud comet C/2020 T2 (Palomar)

abstract: We report our new analysis of Oort-cloud comet C/2020 T2 (Palomar) (T2) observed at 2.06 au from the Sun (phase angle of 28.5 deg) about two weeks before perihelion. T2 lacks a significant dust tail in scattered light, showing a strong central condensation of the coma throughout the apparition, reminiscent of so-called Manx comets. Its spectral slope of polarized light increases and decreases in the J (1.25 um) and H (1.65 um) bands, respectively, resulting in an overall negative (blue) slope (-0.31+/-0.14 % um^-1) in contrast to the red polarimetric color of active comets observed at similar geometries. The average polarization degree of T2 is 2.86+/-0.17 % for the J and 2.75+/-0.16 % for the H bands. Given that near-infrared wavelengths are sensitive to the intermediate-scale structure of cometary dust (i.e., dust aggregates), our light-scattering modeling of ballistic aggregates with different porosities and compositions shows that polarimetric properties of T2 are compatible with low-porosity (~66 %), absorbing dust aggregates with negligible ice contents on a scale of 10--100 um (density of ~652 kg m^-3). This is supported by the coma morphology of T2 which has a viable beta (the relative importance of solar radiation pressure on dust) range of <~10^-4. Secular evolution of the r-band activity of T2 from archival data reveals that the increase in its brightness accelerates around 2.4 au pre-perihelion, with its overall dust production rate ~100 times smaller than those of active Oort-cloud comets. We also found an apparent concentration of T2 and Manx comets toward ecliptic orbits. This paper underlines the heterogeneous nature of Oort-cloud comets which can be investigated in the near future with dedicated studies of their dust characteristics.


title: Exploring electric field sensing for solid-state nanopores

abstract: Solid-state nanopores have received substantial attention in the past years owing to their simplicity and potential applications expected in genomics, sensing, archival information storage, and computing. The underlying sensing technique of nanopore technology is the analysis of modulations in the ionic current while molecules are electrophoretically driven through the nanopore. This current blockade-based sensing is presently well recognized and commercially used for applications such as DNA sequencing. However, this ionic currentbased method has limitations and increased complexity for futuristic applications such as single molecular protein sequencing, where diverse charges and shape distributions are involved. A high throughput readout method that can be used in extreme environments and has improved sensitivity to the mixed charge profiles and shape of the analytes is required. In this work, we present an exploratory finite element simulation study on the feasibility of using electric-field modulations instead of ionic current blockades for nanopore translocation measurements. This electric field sensing technique has further advantages over ionic current blockade measurements. For instance, Electric field sensing is capable of size and charge discretion with lesser noise and does not mandate the presence of an electrolyte solution. This technique can be used in extreme environments and developed for defense and space applications such as detecting air-born particles and future mars, moon, and Europa missions. We hope this work will be a starting point for developing electric field sensing for nanopore applications and opening the field of nanopore electrometry.


title: On Uhlmann's proof of the Monotonicity of the Relative Entropy

abstract: This article presents in a self-contained way A. Uhlmann's celebrated Theorem of monotonicity of the relative entropy under completely positive and trace preserving maps. The Theorem is presented in its more general form and meaningful examples are given.


title: DNA tile self-assembly for 3D-surfaces: Towards genus identification

abstract: We introduce a new DNA tile self-assembly model: the Surface Flexible Tile Assembly Model (SFTAM), where 2D tiles are placed on host 3D surfaces made of axis-parallel unit cubes glued together by their faces, called polycubes. The bonds are flexible, so that the assembly can bind on the edges of the polycube. We are interested in the study of SFTAM self-assemblies on 3D surfaces which are not always embeddable in the Euclidean plane, in order to compare their different behaviors and to compute the topological properties of the host surfaces. We focus on a family of polycubes called cuboids. Order-0 cuboids are polycubes that have six rectangular faces, and order-1 cuboids are made from two order-0 cuboids by substracting one from the other. Thus, order-1 cuboids can be of genus 0 or of genus 1 (then they contain a tunnel). We are interested in the genus of these structures, and we present a SFTAM tile assembly system that determines the genus of a given order-1 cuboid. The SFTAM tile assembly system which we design, contains a specific set $Y$ of tile types with the following properties. If the assembly is made on a host order-1 cuboid $C$ of genus 0, no tile of $Y$ appears in any producible assembly, but if $C$ has genus 1, every terminal assembly contains at least one tile of $Y$. Thus, we are able to distinguish the host surfaces according to their genus, by the tiles used in the assembly. This system is specific to order-1 cuboids but the techniques we use should be generalizable to other families of shapes.


title: The GRAVITY Young Stellar Object survey -- IX. Spatially resolved kinematics of hot hydrogen gas in the star/disk interaction region of T Tauri stars

abstract: Aims: We aim to spatially and spectrally resolve the Br-gamma hydrogen emission line with the methods of interferometry in order to examine the kinematics of the hydrogen gas emission region in the inner accretion disk of a sample of solar-like young stellar objects. The goal is to identify trends and categories among the sources of our sample and to discuss whether or not they can be tied to different origin mechanisms associated with Br-gamma emission in T Tauri stars, chiefly and most prominently magnetospheric accretion. Methods: We observed a sample of seven T Tauri stars for the first time with VLTI GRAVITY, recording spectra and spectrally dispersed interferometric quantities across the Br-gamma line in the NIR K-band. We use them to extract the size of the Br-gamma emission region and the photocenter shifts. To assist in the interpretation, we also make use of radiative transfer models of magnetospheric accretion to establish a baseline of expected interferometric signatures if accretion is the primary driver of Br-gamma emission. Results: From among our sample, we find that five of the seven T~Tauri stars show an emission region with a half-flux radius in the range broadly expected for magnetospheric truncation. Two of the five objects also show Br-gamma emission primarily originating from within the corotation radius, while two other objects exhibit extended emission on a scale beyond 10 R$_*$, one of them even beyond the K~band continuum half-flux radius of 11.3 R$_*$. Conclusions: We find strong evidence to suggest that for the two weakest accretors in the sample, magnetospheric accretion is the primary driver of Br-gamma radiation. The results for the remaining sources imply either partial or strong contributions coming from spatially extended emission components in the form of outflows, such as stellar or disk winds.


title: Long-range multiparticle interactions induced by neutrino exchange in neutron-star matter

abstract: Forces with a large radius of interaction can have a significant impact on the equation of state of matter. Low-mass neutrinos generate a long-range potential due to the exchange of neutrino pairs. We discuss a possible relationship between the neutrino masses, which determine the interaction radius of the neutrino-pair exchange potential, and the equation of state of neutron matter. Contrary to previous statements, the thermodynamic potential, when decomposed into the number of neutrino interactions, vanishes in any decomposition order, except for the interaction of two neutrons. In the one-loop approximation, long-range multiparticle neutrino interactions are stable in the infrared region for all neutrino masses and do not affect the equation of state of neutron matter or the stability of neutron stars.


title: Locality-Preserving Minimal Perfect Hashing of k-mers

abstract: Minimal perfect hashing is the problem of mapping a static set of $n$ distinct keys into the address space $\{1,\ldots,n\}$ bijectively. It is well-known that $n\log_2(e)$ bits are necessary to specify a minimal perfect hash function (MPHF) $f$, when no additional knowledge of the input keys is to be used. However, it is often the case in practice that the input keys have intrinsic relationships that we can exploit to lower the bit complexity of $f$. For example, consider a string and the set of all its distinct $k$-mers as input keys: since two consecutive $k$-mers share an overlap of $k-1$ symbols, it seems possible to beat the classic $\log_2(e)$ bits/key barrier in this case. Moreover, we would like $f$ to map consecutive $k$-mers to consecutive addresses, as to also preserve as much as possible their relationship in the codomain. This is a useful feature in practice as it guarantees a certain degree of locality of reference for $f$, resulting in a better evaluation time when querying consecutive $k$-mers. Motivated by these premises, we initiate the study of a new type of locality-preserving MPHF designed for $k$-mers extracted consecutively from a collection of strings. We design a construction whose space usage decreases for growing $k$ and discuss experiments with a practical implementation of the method: in practice, the functions built with our method can be several times smaller and even faster to query than the most efficient MPHFs in the literature.


title: Twin stau as a self-interacting dark matter

abstract: Supersymmetric Twin Higgs models allow for reducing the fine-tuning with respect to Minimal Supersymmetric Standard Model by protecting the mass of the Higgs boson by additional, accidental global symmetry. This class of models introduce numerous new states, some of which might be candidates for dark matter. Since those reside in twin sector, they are not charged under Standard Model gauge group. We proposed twin stau as a candidate for dark matter. Even though twin stau is charged under twin electromagnetism, since supersymmetric partners obtain large masses from supersymmetry breaking they can easily escape bounds for self-interacting dark matter. The mass of twin stau which reproduces correct relic abundance is usually between 300 and 500 GeV. This scenario can be probed by future direct detection experiments such as Lux-Zepelin.


title: Characterization of the transient response of diamond sensors to collimated, sub-ps, 1 GeV electron bunches

abstract: Diamond sensors (DS) are widely used as solid-state particle detectors, beam loss monitors, and dosimeters in high-radiation environments, e.g., particle colliders. We have calibrated our DS with steady $\beta$- and X-radiation, spanning a dose rate in the range 0.1-100 mGy/s. Here, we report the first systematic characterization of transient responses of DS to collimated, sub-picosecond, 1 GeV electron bunches. These bunches, possessing a charge ranging from tens to hundreds of pC and a size from tens of microns to millimeters, are suitably provided by the FERMI electron linac in Trieste, Italy. The high density of charge carriers generated by ionization in the diamond bulk causes a transient modification of electrical properties of DS (e.g., resistance), which in turn affects the signal shape. We have modeled a two-step numerical approach, simulating the effects on the signal of both the evolution of charge carrier density in the diamond bulk and the changes in the circuit parameters. This approach interprets features observed in our experimental results to a great extent.


title: Optimal Decision Rules for the Discursive Dilemma

abstract: We study the classical discursive dilemma from the point of view of finding the best decision rule according to a quantitative criterion, under very mild restrictions on the set of admissible rules. The members of the deciding committee are assumed to have a certain probability to assess correctly the truth or falsity of the premisses, and the best rule is the one that minimises a combination of the probabilities of false positives and false negatives on the conclusion.


title: Towards an efficient Iris Recognition System on Embedded Devices

abstract: Iris Recognition (IR) is one of the market's most reliable and accurate biometric systems. Today, it is challenging to build NIR-capturing devices under the premise of hardware price reduction. Commercial NIR sensors are protected from modification. The process of building a new device is not trivial because it is required to start from scratch with the process of capturing images with quality, calibrating operational distances, and building lightweight software such as eyes/iris detectors and segmentation sub-systems. In light of such challenges, this work aims to develop and implement iris recognition software in an embedding system and calibrate NIR in a contactless binocular setup. We evaluate and contrast speed versus performance obtained with two embedded computers and infrared cameras. Further, a lightweight segmenter sub-system called "Unet_xxs" is proposed, which can be used for iris semantic segmentation under restricted memory resources.


title: Non-P\'olya Fields with Large P\'olya Groups Arising from Lehmer Quintics

abstract: In this article we construct a new family of quintic non-P\'olya fields with large P\'olya groups. We study the upper bound of P\'olya numbers of such fields and show that the P\'olya numbers never exceed five times the size of its P\'olya group. Finally we show that such non-P\'olya fields are non-monogenic fields of field index one.


title: Deep Grey-Box Modeling With Adaptive Data-Driven Models Toward Trustworthy Estimation of Theory-Driven Models

abstract: The combination of deep neural nets and theory-driven models, which we call deep grey-box modeling, can be inherently interpretable to some extent thanks to the theory backbone. Deep grey-box models are usually learned with a regularized risk minimization to prevent a theory-driven part from being overwritten and ignored by a deep neural net. However, an estimation of the theory-driven part obtained by uncritically optimizing a regularizer can hardly be trustworthy when we are not sure what regularizer is suitable for the given data, which may harm the interpretability. Toward a trustworthy estimation of the theory-driven part, we should analyze regularizers' behavior to compare different candidates and to justify a specific choice. In this paper, we present a framework that enables us to analyze a regularizer's behavior empirically with a slight change in the neural net's architecture and the training objective.


title: A Multi-Wavelength Study of Multiple Spectral Component Jets in AGN: Testing the IC/CMB Model for the Large-Scale-Jet X-ray Emission

abstract: Over 150 resolved, kpc-scale X-ray jets hosted by active galactic nuclei have been discovered with the Chandra X-ray Observatory. A significant fraction of these jets have an X-ray spectrum either too high in flux or too hard to be consistent with the high-energy extension of the radio-to-optical synchrotron spectrum, a subtype we identify as Multiple Spectral Component (MSC) X-ray jets. A leading hypothesis for the origin of the X-rays is the inverse-Compton scattering of the cosmic microwave background by the same electron population producing the radio-to-optical synchrotron spectrum (known as the IC/CMB model). In this work, we test the IC/CMB model in 45 extragalactic X-ray jets using observations from the Fermi Large Area Telescope to look for the expected high level of gamma-ray emission, utilizing observations from the Atacama Large Millimeter/submillimeter Array (ALMA) and the Hubble Space Telescope (HST) when possible to best constrain the predicted gamma-ray flux. Including this and previous works, we now find the IC/CMB model to be ruled out in a total of 24/45 MSC X-ray jets due to its overprediction for the observed MeV-to-GeV gamma-ray flux. We present additional evidence against the IC/CMB model, including the relative X-ray-to-radio relativistic beaming in these sources, and the general mismatch between radio and X-ray spectral indexes. Finally, we present upper limits on the large scale bulk-flow Lorentz factors for all jets based on the Fermi upper limits, which suggest that these jets are at most mildly relativistic.


title: Arithmetic Gan-Gross-Prasad conjecture for RSZ unitary Shimura curves

abstract: Xue proved an equational refinement of the unitary Shimura curve case of the arithmetic Gan-Gross-Prasad conjecture via the Gross-Zagier formula for quaternionic Shimura curves. On the other hand, Rapoport, Smithling and Zhang posed a variant of the conjecture, using modified PEL type Shimura varieties, which we call RSZ Shimura varieties. We reinterpret the result of Xue in terms of the modified Shimura curves. We then use the reinterpretation to prove a case of the variant of the conjecture. Our result combined with the work of Xue establishes a connection between the variant and the Gross-Zagier formula.


title: Quantum walks on simplexes and multiple perfect state transfer

abstract: In this paper, we study quantum walks on the extension of association schemes. Various state transfers can be achieved on these graphs, such as multiple state transfer among extreme points of a simplex, fractional revival on subsimplexes. Since only few examples of multiple (perfect) state transfer are known, we aim to make some additions in this collection.


title: An Analytical Estimation of Spiking Neural Networks Energy Efficiency

abstract: Spiking Neural Networks are a type of neural networks where neurons communicate using only spikes. They are often presented as a low-power alternative to classical neural networks, but few works have proven these claims to be true. In this work, we present a metric to estimate the energy consumption of SNNs independently of a specific hardware. We then apply this metric on SNNs processing three different data types (static, dynamic and event-based) representative of real-world applications. As a result, all of our SNNs are 6 to 8 times more efficient than their FNN counterparts.


title: Heat Demand Forecasting with Multi-Resolutional Representation of Heterogeneous Temporal Ensemble

abstract: One of the primal challenges faced by utility companies is ensuring efficient supply with minimal greenhouse gas emissions. The advent of smart meters and smart grids provide an unprecedented advantage in realizing an optimised supply of thermal energies through proactive techniques such as load forecasting. In this paper, we propose a forecasting framework for heat demand based on neural networks where the time series are encoded as scalograms equipped with the capacity of embedding exogenous variables such as weather, and holiday/non-holiday. Subsequently, CNNs are utilized to predict the heat load multi-step ahead. Finally, the proposed framework is compared with other state-of-the-art methods, such as SARIMAX and LSTM. The quantitative results from retrospective experiments show that the proposed framework consistently outperforms the state-of-the-art baseline method with real-world data acquired from Denmark. A minimal mean error of 7.54% for MAPE and 417kW for RMSE is achieved with the proposed framework in comparison to all other methods.


title: WDA-Net: Weakly-Supervised Domain Adaptive Segmentation of Electron Microscopy

abstract: Accurate segmentation of organelle instances, e.g., mitochondria, is essential for electron microscopy analysis. Despite the outstanding performance of fully supervised methods, they highly rely on sufficient per-pixel annotated data and are sensitive to domain shift. Aiming to develop a highly annotation-efficient approach with competitive performance, we focus on weakly-supervised domain adaptation (WDA) with a type of extremely sparse and weak annotation demanding minimal annotation efforts, i.e., sparse point annotations on only a small subset of object instances. To reduce performance degradation arising from domain shift, we explore multi-level transferable knowledge through conducting three complementary tasks, i.e., counting, detection, and segmentation, constituting a task pyramid with different levels of domain invariance. The intuition behind this is that after investigating a related source domain, it is much easier to spot similar objects in the target domain than to delineate their fine boundaries. Specifically, we enforce counting estimation as a global constraint to the detection with sparse supervision, which further guides the segmentation. A cross-position cut-and-paste augmentation is introduced to further compensate for the annotation sparsity. Extensive validations show that our model with only 15% point annotations can achieve comparable performance as supervised models and shows robustness to annotation selection.


title: On DoS Resiliency Analysis of Networked Control Systems: Trade-Off Between Jamming Actions and Network Delays

abstract: This letter deals with the problem of quantifying resiliency of Networked Control Systems (NCSs) to Denial-of-Service (DoS) attacks and variable network delays. Internal exponential stability and $\mathcal{L}_2$ external stability are studied. The closed-loop system is augmented with an auxiliary timer variable and analyzed in a hybrid system framework. Lyapunov-like conditions are given to ensure $0$-input global exponential stability and $\mathcal{L}_2$ external stability. A computationally affordable algorithm based on linear matrix inequalities is devised to provide trade-off curves between maximum length of DoS attacks and largest network delays. Finally, the effectiveness of the proposed approach is shown in a numerical example.


title: Federated Learning and Meta Learning: Approaches, Applications, and Directions

abstract: Over the past few years, significant advancements have been made in the field of machine learning (ML) to address resource management, interference management, autonomy, and decision-making in wireless networks. Traditional ML approaches rely on centralized methods, where data is collected at a central server for training. However, this approach poses a challenge in terms of preserving the data privacy of devices. To address this issue, federated learning (FL) has emerged as an effective solution that allows edge devices to collaboratively train ML models without compromising data privacy. In FL, local datasets are not shared, and the focus is on learning a global model for a specific task involving all devices. However, FL has limitations when it comes to adapting the model to devices with different data distributions. In such cases, meta learning is considered, as it enables the adaptation of learning models to different data distributions using only a few data samples. In this tutorial, we present a comprehensive review of FL, meta learning, and federated meta learning (FedMeta). Unlike other tutorial papers, our objective is to explore how FL, meta learning, and FedMeta methodologies can be designed, optimized, and evolved, and their applications over wireless networks. We also analyze the relationships among these learning algorithms and examine their advantages and disadvantages in real-world applications.


title: Optimization-based Motion Planning for Autonomous Parking Considering Dynamic Obstacle: A Hierarchical Framework

abstract: This paper introduces a hierarchical framework that integrates graph search algorithms and model predictive control to facilitate efficient parking maneuvers for Autonomous Vehicles (AVs) in constrained environments. In the high-level planning phase, the framework incorporates scenario-based hybrid A* (SHA*), an optimized variant of traditional Hybrid A*, to generate an initial path while considering static obstacles. This global path serves as an initial guess for the low-level NLP problem. In the low-level optimizing phase, a nonlinear model predictive control (NMPC)-based framework is deployed to circumvent dynamic obstacles. The performance of SHA* is empirically validated through 148 simulation scenarios, and the efficacy of the proposed hierarchical framework is demonstrated via a real-time parallel parking simulation.