title: Federated Boosted Decision Trees with Differential Privacy

abstract: There is great demand for scalable, secure, and efficient privacy-preserving machine learning models that can be trained over distributed data. While deep learning models typically achieve the best results in a centralized non-secure setting, different models can excel when privacy and communication constraints are imposed. Instead, tree-based approaches such as XGBoost have attracted much attention for their high performance and ease of use; in particular, they often achieve state-of-the-art results on tabular data. Consequently, several recent works have focused on translating Gradient Boosted Decision Tree (GBDT) models like XGBoost into federated settings, via cryptographic mechanisms such as Homomorphic Encryption (HE) and Secure Multi-Party Computation (MPC). However, these do not always provide formal privacy guarantees, or consider the full range of hyperparameters and implementation settings. In this work, we implement the GBDT model under Differential Privacy (DP). We propose a general framework that captures and extends existing approaches for differentially private decision trees. Our framework of methods is tailored to the federated setting, and we show that with a careful choice of techniques it is possible to achieve very high utility while maintaining strong levels of privacy.


title: Principal fundamental system of solutions, The Hartman-Wintner problem and correct solvability of the general Sturm-Liouville equation

abstract: We study the problem of correct solvability in the space $L_p(\mathbb R),$ $p\in[1,\infty)$ of the equation $$ -(r(x) y'(x))'+q(x)y(x)=f(x),\quad x\in \mathbb R $$ under the conditions $$r>0,\quad q\ge 0,\quad \frac{1}{r}\in L_1(\mathbb R),\quad q\in L_1(\mathbb R).$$


title: CANIFE: Crafting Canaries for Empirical Privacy Measurement in Federated Learning

abstract: Federated Learning (FL) is a setting for training machine learning models in distributed environments where the clients do not share their raw data but instead send model updates to a server. However, model updates can be subject to attacks and leak private information. Differential Privacy (DP) is a leading mitigation strategy which involves adding noise to clipped model updates, trading off performance for strong theoretical privacy guarantees. Previous work has shown that the threat model of DP is conservative and that the obtained guarantees may be vacuous or may overestimate information leakage in practice. In this paper, we aim to achieve a tighter measurement of the model exposure by considering a realistic threat model. We propose a novel method, CANIFE, that uses canaries - carefully crafted samples by a strong adversary to evaluate the empirical privacy of a training round. We apply this attack to vision models trained on CIFAR-10 and CelebA and to language models trained on Sent140 and Shakespeare. In particular, in realistic FL scenarios, we demonstrate that the empirical per-round epsilon obtained with CANIFE is 4-5x lower than the theoretical bound.


title: Biological neurons act as generalization filters in reservoir computing

abstract: Reservoir computing is a machine learning paradigm that transforms the transient dynamics of high-dimensional nonlinear systems for processing time-series data. Although reservoir computing was initially proposed to model information processing in the mammalian cortex, it remains unclear how the non-random network architecture, such as the modular architecture, in the cortex integrates with the biophysics of living neurons to characterize the function of biological neuronal networks (BNNs). Here, we used optogenetics and fluorescent calcium imaging to record the multicellular responses of cultured BNNs and employed the reservoir computing framework to decode their computational capabilities. Micropatterned substrates were used to embed the modular architecture in the BNNs. We first show that modular BNNs can be used to classify static input patterns with a linear decoder and that the modularity of the BNNs positively correlates with the classification accuracy. We then used a timer task to verify that BNNs possess a short-term memory of ~1 s and finally show that this property can be exploited for spoken digit classification. Interestingly, BNN-based reservoirs allow transfer learning, wherein a network trained on one dataset can be used to classify separate datasets of the same category. Such classification was not possible when the input patterns were directly decoded by a linear decoder, suggesting that BNNs act as a generalization filter to improve reservoir computing performance. Our findings pave the way toward a mechanistic understanding of information processing within BNNs and, simultaneously, build future expectations toward the realization of physical reservoir computing systems based on BNNs.


title: Generative Entity Typing with Curriculum Learning

abstract: Entity typing aims to assign types to the entity mentions in given texts. The traditional classification-based entity typing paradigm has two unignorable drawbacks: 1) it fails to assign an entity to the types beyond the predefined type set, and 2) it can hardly handle few-shot and zero-shot situations where many long-tail types only have few or even no training instances. To overcome these drawbacks, we propose a novel generative entity typing (GET) paradigm: given a text with an entity mention, the multiple types for the role that the entity plays in the text are generated with a pre-trained language model (PLM). However, PLMs tend to generate coarse-grained types after fine-tuning upon the entity typing dataset. Besides, we only have heterogeneous training data consisting of a small portion of human-annotated data and a large portion of auto-generated but low-quality data. To tackle these problems, we employ curriculum learning (CL) to train our GET model upon the heterogeneous data, where the curriculum could be self-adjusted with the self-paced learning according to its comprehension of the type granularity and data heterogeneity. Our extensive experiments upon the datasets of different languages and downstream tasks justify the superiority of our GET model over the state-of-the-art entity typing models. The code has been released on https://github.com/siyuyuan/GET.


title: Superconductivity from electronic interactions and spin-orbit enhancement in bilayer and trilayer graphene

abstract: We discuss a Kohn-Luttinger-like mechanism for superconductivity in Bernal bilayer graphene and rhombohedral trilayer graphene. Working within the continuum model description, we find that the screened long-range Coulomb interaction alone gives rise to superconductivity with critical temperatures that agree with experiments. We observe that the order parameter changes sign between valleys, which implies that both materials are valley-singlet, spin-triplet superconductors. Adding Ising spin-orbit coupling leads to a significant enhancement in the critical temperature, also in line with experiment, and the superconducting order parameter shows locking between the spin and valley degrees of freedom.


title: Current-induced perpendicular effective magnetic field in magnetic heterostructures

abstract: Generation of perpendicular effective magnetic field or perpendicular spins ({\sigma}z) is central for the development of energy-efficient, scalable, and external-magnetic-field-free spintronic memory and computing technologies. Here, we report the first identification and the profound impacts of a significant effective perpendicular magnetic field that can arise from asymmetric current spreading within magnetic microstrips and Hall bars. This effective perpendicular magnetic field can exhibit all the three characteristics that have been widely assumed in the literature to "signify" the presence of a flow of {\sigma}z, i.e., external-magnetic-field-free current switching of uniform perpendicular magnetization, a sin2{\phi}-dependent contribution in spin-torque ferromagnetic resonance signal of in-plane magnetization ({\phi} is the angle of the external magnetic field with respect to the current, and a {\phi}-independent but field-dependent contribution in the second harmonic Hall voltage of in-plane magnetization. This finding suggests that it is critical to include current spreading effects in the analyses of various spin polarizations and spin-orbit torques in magnetic heterostructure. Technologically, our results provide perpendicular effective magnetic field induced by asymmetric current spreading as a novel, universally accessible mechanism for efficient, scalable, and external-magnetic-field-free magnetization switching in memory and computing technologies.


title: Electrically-detected single-spin resonance with Quantum Spin Hall edge states

abstract: Detection is most often the main impediment to reduce the number of spins in paramagnetic resonance experiments. Here we propose a new route to carry out electrically-detected spin resonance of an individual spin, placed at the edge of a quantum spin Hall insulator (QSHI). The edges of a QSHI host a one dimensional electron gas with perfect spin-momentum locking. Therefore, the spin relaxation induced by emission of an electron-hole pair at the edge state of the QSHI can generate current. Here we demonstrate that driving the system with an $AC$ signal, a nonequilibrium occupation can be induced in the absence of applied bias voltage, resulting in a $DC$ measurable current. We compute the $DC$ current as a function of the Rabi frequency $\Omega$, the spin relaxation and decoherence times, $T_1$ and we discuss the feasibility of this experiment with state-of-the-art instrumentation.


title: On a Steklov-Robin eigenvalue problem

abstract: In this paper we study a Steklov-Robin eigenvalue problem for the Laplacian in annular domains. More precisely, we consider $\Omega=\Omega_0 \setminus \overline{B}_{r}$, where $B_{r}$ is the ball centered at the origin with radius $r>0$ and $\Omega_0\subset\mathbb{R}^n$, $n\geq 2$, is an open, bounded set with Lipschitz boundary, such that $\overline{B}_{r}\subset \Omega_0$. We impose a Steklov condition on the outer boundary and a Robin condition involving a positive $L^{\infty}$-function $\beta(x)$ on the inner boundary. Then, we study the first eigenvalue $\sigma_{\beta}(\Omega)$ and its main properties. In particular, we investigate the behaviour of $\sigma_{\beta}(\Omega)$ when we let vary the $L^1$-norm of $\beta$ and the radius of the inner ball. Furthermore, we study the asymptotic behaviour of the corresponding eigenfunctions when $\beta$ is a positive parameter that goes to infinity.


title: Distributed Resource Allocation over Multiple Interacting Coalitions: A Game-Theoretic Approach

abstract: Despite many distributed resource allocation (DRA) algorithms have been reported in literature, it is still unknown how to allocate the resource optimally over multiple interacting coalitions. One major challenge in solving such a problem is that, the relevance of the decision on resource allocation in a coalition to the benefit of others may lead to conflicts of interest among these coalitions. Under this context, a new type of multi-coalition game is formulated in this paper, termed as resource allocation game, where each coalition contains multiple agents that cooperate to maximize the coalition-level benefit while subject to the resource constraint described by a coupled equality. Inspired by techniques such as variable replacement, gradient tracking and leader-following consensus, two new kinds of DRA algorithms are developed respectively for the scenarios where the individual benefit of each agent explicitly depends on the states of itself and some agents in other coalitions, and on the states of all the game participants. It is shown that the proposed algorithms can converge linearly to the Nash equilibrium (NE) of the multi-coalition game while satisfying the resource constraint during the whole NE-seeking process. Finally, the validity of the present allocation algorithms is verified by numerical simulations.


title: Eternal solutions in exponential self-similar form for a quasilinear reaction-diffusion equation with critical singular potential

abstract: We prove existence and uniqueness of self-similar solutions with exponential form $$ u(x,t)=e^{\alpha t}f(|x|e^{-\beta t}), \qquad \alpha, \ \beta>0 $$ to the following quasilinear reaction-diffusion equation $$ \partial_tu=\Delta u^m+|x|^{\sigma}u^p, $$ posed for $(x,t)\in\real^N\times(0,T)$, with $m>1$, $1<p<m$ and $\sigma=-2(p-1)/(m-1)$ and in dimension $N\geq2$, the same results holding true in dimension $N=1$ under the extra assumption $1<p<(m+1)/2$. Such self-similar solutions are usually known in literature as \emph{eternal solutions} since they exist for any $t\in(-\infty,\infty)$. As an application of the existence of these eternal solutions, we show existence of \emph{global in time weak solutions} with any initial condition $u_0\in L^{\infty}(\real^N)$, and in particular that these weak solutions remain compactly supported at any time $t>0$ if $u_0$ is compactly supported.


title: Spin-Orbit Interactions of Light: Fundamentals and Emergent Applications

abstract: We present a comprehensive review of recent developments in Spin Orbit Interactions (SOIs) of light in photonic materials. In particular, we highlight progress on detection of Spin Hall Effect (SHE) of light in hyperbolic metamaterials and metasurfaces. Moreover, we outline some fascinating future directions for emergent applications of SOIs of light in photonic devices of the upcoming generation.


title: Stacking order and interlayer coupling tuning the properties of charge density waves in layered 1T-NbSe_2

abstract: Layered transition metal dichalcogenide 1T-NbSe_2 is a good candidate to explore the charge density wave (CDW) and Mott physics. However, the effects of stacking orders and interlayer coupling in CDW 1T-NbSe_2 are still less explored and understood. Using density functional theory calculations, we present a systematic study of the electronic and magnetic properties of monolayer and layered CDW 1T-NbSe_2. Our results indicate that monolayer CDW 1T-NbSe_2 is a magnetic insulator with \sqrt13\times\sqrt13 periodic lattice modulation. Nevertheless, the magnetic properties of bilayer CDWs 1T-NbSe_2 are found stacking orders dependence. The mechanism is understood by the changes of local magnetic moments in each layer due to spin charge transfer between interlayers. Furthermore, the bulk CDW 1T-NbSe_2 opens a band gap with 0.02 eV in 1\times 1 \times 2 supercell due to the interlayer spin coupling. We also discover that the electronic structures of layered 1T-NbSe_2 show a strong dependence on stacking configurations and dimensionality.


title: Evaluation of stationarity regions in measured non-WSSUS 60 GHz mmWave V2V channels

abstract: Due to high mobility in multipath propagation environments, vehicle-to-vehicle (V2V) channels are generally time and frequency variant. Therefore, the criteria for wide-sense stationarity (WSS) and uncorrelated scattering (US) are just satisfied over very limited intervals in the time and frequency domains, respectively. We test the validity of these criteria in measured vehicular 60 GHz millimeter wave (mmWave) channels, by estimating the local scattering functions (LSFs) from the measured data. Based on the variation of the LSFs, we define time-frequency stationarity regions, over which the WSSUS assumption is assumed to be fulfilled approximately. We analyze and compare both line-of-sight (LOS) and non-LOS (NLOS) V2V communication conditions. We observe large stationarity regions for channels with a dominant LOS connection, without relative movement between the transmitting and receiving vehicle. In the same measured urban driving scenario, modified by eliminating the LOS component in the post-processing, the channel is dominated by specular components reflected from an overpassing vehicle with a relative velocity of 56 km/h. Here, we observe a stationarity bandwidth of 270 MHz. Furthermore, the NLOS channel, dominated by a single strong specular component, shows a relatively large average stationarity time of 16 ms, while the stationarity time for the channel with a rich multipath profile is much shorter, in the order of 5 ms.


title: Integrating curved Yang-Mills gauge theories

abstract: We construct a gauge theory based on principal bundles $\mathcal{P}$ equipped with a right $\mathcal{G}$-action, where $\mathcal{G}$ is a Lie group bundle. Due to the fact that a $\mathcal{G}$-action acts fibre by fibre, pushforwards of tangent vectors via a right-translation act now only on the vertical structure of $\mathcal{P}$. Thus, we generalize pushforwards using sections of $\mathcal{G}$, and in order to provide a definition independent of the choice of section we fix a connection on $\mathcal{G}$, which will modify the pushforward by subtracting the fundamental vector field generated by a generalized Darboux derivative of the chosen section. A horizontal distribution on $\mathcal{P}$ invariant under such a modified pushforward leads to a parallel transport on $\mathcal{P}$ which is a homomorphism w.r.t. the $\mathcal{G}$-action and the parallel transport on $\mathcal{G}$. For achieving gauge invariance we impose conditions on the connection 1-form $\mu$ on $\mathcal{G}$: $\mu$ has to be a multiplicative form, (i.e.) closed w.r.t. a certain simplicial differential $\delta$ on $\mathcal{G}$, and the curvature $R_\mu$ of $\mu$ has to be $\delta$-exact with primitive $\zeta$; $\mu$ will be the generalization of the Maurer-Cartan form of the classical gauge theory, while the $\delta$-exactness of $R_\mu$ will generalize the role of the Maurer-Cartan equation. For allowing curved connections on $\mathcal{G}$ we will need to generalize the typical definition of the curvature/field strength $F$ on $\mathcal{P}$, that is, we add $\zeta$ to $F$. This leads to a generalized gauge theory with many similar, but generalized, statements, including Bianchi identity, gauge transformations and Darboux derivatives. An example for a gauge theory with a curved Maurer-Cartan form $\mu$ will be provided by the inner group bundle of the Hopf fibration $\mathbb{S}^7 \to \mathbb{S}^4$.


title: Yet another proof of Parikh's Theorem

abstract: Parikh's Theorem says that the Parikh image of a context-free language is semilinear. We give a short proof of Parikh's Theorem using the formulation of Verma, Seidl, and Schwentick in terms of Presburger arithmetic. The proof relies on an Eulerian property of derivation trees of context-free languages and was inspired by Hierholzer's algorithm; it does not use the Chomsky normal form.


title: Formats of 6 x 6 skew matrices of linear forms with vanishing Pfaffian

abstract: We show that every skew-symmetric 6 x 6 matrix of linear forms with vanishing Pfaffian is congruent to one of finitely many types of matrices, each of which is characterised by a specific pattern of zeroes (and some other linear relations) among its entries. Such matrices are for example important for compactifying moduli spaces of stable rank 2 vector bundles with Chern classes c_1=0, c_2=2 on cubic threefolds.


title: An Energy Balance Cluster Network Framework Based on SWIPT

abstract: Wireless NanoSensor Network (WNSN) is a brand-new type of sensor network with broad application prospects. In view of the limited energy of nano-nodes and unstable links in WNSNs, we propose an energy balance cluster network framework (EBCNF) based on Simultaneous Wireless Information and Power Transfer (SWIPT). The EBCNF framework extends the network lifetime of nanonodes and uses a clustering algorithm called EBACC (an energy balance algorithm for intra-cluster and inter-cluster nodes) to make the energy consumption of nodes more uniform. Simulation shows that the EBCNF framework can make the network energy consumption more uniform, reduce the error rate of data transmission and the average network throughput, and can be used as an effective routing framework for WNSNs.


title: MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text

abstract: While language Models store a massive amount of world knowledge implicitly in their parameters, even very large models often fail to encode information about rare entities and events, while incurring huge computational costs. Recently, retrieval-augmented models, such as REALM, RAG, and RETRO, have incorporated world knowledge into language generation by leveraging an external non-parametric index and have demonstrated impressive performance with constrained model sizes. However, these methods are restricted to retrieving only textual knowledge, neglecting the ubiquitous amount of knowledge in other modalities like images -- much of which contains information not covered by any text. To address this limitation, we propose the first Multimodal Retrieval-Augmented Transformer (MuRAG), which accesses an external non-parametric multimodal memory to augment language generation. MuRAG is pre-trained with a mixture of large-scale image-text and text-only corpora using a joint contrastive and generative loss. We perform experiments on two different datasets that require retrieving and reasoning over both images and text to answer a given query: WebQA, and MultimodalQA. Our results show that MuRAG achieves state-of-the-art accuracy, outperforming existing models by 10-20\% absolute on both datasets and under both distractor and full-wiki settings.


title: Hadronic resonance production with ALICE at the LHC

abstract: We present recent results on short-lived hadronic resonances obtained by the ALICE experiment at LHC energies. Results include system-size and collision-energy evolution of transverse momentum spectra, yields and ratios of resonance yields to those of longer lived particles, and nuclear modification factors. The results are compared with model predictions and measurements at lower energies.


title: Data-Driven Meets Navigation: Concepts, Models, and Experimental Validation

abstract: The purpose of navigation is to determine the position, velocity, and orientation of manned and autonomous platforms, humans, and animals. Obtaining accurate navigation commonly requires fusion between several sensors, such as inertial sensors and global navigation satellite systems, in a model-based, nonlinear estimation framework. Recently, data-driven approaches applied in various fields show state-of-the-art performance, compared to model-based methods. In this paper we review multidisciplinary, data-driven based navigation algorithms developed and experimentally proven at the Autonomous Navigation and Sensor Fusion Lab (ANSFL) including algorithms suitable for human and animal applications, varied autonomous platforms, and multi-purpose navigation and fusion approaches


title: Selfsimilarity relations for torsional oscillations of neutron stars

abstract: Selfsimilarity relations for torsional oscillation frequencies of neutron star crust are discussed. For any neutron star model, the frequencies of fundamental torsional oscillations (with no nodes of radial wave function, i.e. at n=0, and at all possible angular wave numbers l >= 2) is determined by a single constant. Frequencies of ordinary torsional oscillations (at any n>0 with l >= 2) are determined by two constants. These constants are easily calculated through radial integrals over the neutron star crust, giving the simplest method to determine full oscillation spectrum. All constants for a star of fixed mass can be accurately interpolated for stars of various masses (but the same equation of state). In addition, the torsional oscillations can be accurately studied in the flat space-time approximation within the crust. The results can be useful for investigating magneto-elastic oscillations of magnetars which are thought to be observed as quasi-periodic oscillations after flares of soft-gamma repeaters.


title: Hardy Spaces Associated with Some Anisotropic Mixed-Norm Herz Spaces and Their Applications

abstract: In this paper, we introduce anisotropic mixed-norm Herz spaces $\dot K_{\vec{q}, \vec{a}}^{\alpha, p}(\mathbb R^n)$ and $K_{\vec{q}, \vec{a}}^{\alpha, p}(\mathbb R^n)$ and investigate some basic properties of those spaces. Furthermore, establishing the Rubio de Francia extrapolation theory, which resolves the boundedness problems of Calder\'on-Zygmund operators and fractional integral operator and their commutators, on the space $\dot K_{\vec{q}, \vec{a}}^{\alpha, p}(\mathbb R^n)$ and the space $K_{\vec{q}, \vec{a}}^{\alpha, p}(\mathbb R^n)$. Especially, the Littlewood-Paley characterizations of anisotropic mixed-norm Herz spaces also are gained. As the generalization of anisotropic mixed-norm Herz spaces, we introduce anisotropic mixed-norm Herz-Hardy spaces $H\dot K_{\vec{q}, \vec{a}}^{\alpha, p}(\mathbb R^n)$ and $HK_{\vec{q}, \vec{a}}^{\alpha, p}(\mathbb R^n)$, on which atomic decomposition and molecular decomposition are obtained. Moreover, we gain the boundedness of classical Calder\'on-Zygmund operators.


title: Grape: Knowledge Graph Enhanced Passage Reader for Open-domain Question Answering

abstract: A common thread of open-domain question answering (QA) models employs a retriever-reader pipeline that first retrieves a handful of relevant passages from Wikipedia and then peruses the passages to produce an answer. However, even state-of-the-art readers fail to capture the complex relationships between entities appearing in questions and retrieved passages, leading to answers that contradict the facts. In light of this, we propose a novel knowledge Graph enhanced passage reader, namely Grape, to improve the reader performance for open-domain QA. Specifically, for each pair of question and retrieved passage, we first construct a localized bipartite graph, attributed to entity embeddings extracted from the intermediate layer of the reader model. Then, a graph neural network learns relational knowledge while fusing graph and contextual representations into the hidden states of the reader model. Experiments on three open-domain QA benchmarks show Grape can improve the state-of-the-art performance by up to 2.2 exact match score with a negligible overhead increase, with the same retriever and retrieved passages. Our code is publicly available at https://github.com/jumxglhf/GRAPE.


title: Large population limits of Markov processes on random networks

abstract: We consider time-continuous Markovian discrete-state dynamics on random networks of interacting agents and study the large population limit. The dynamics are projected onto low-dimensional collective variables given by the shares of each discrete state in the system, or in certain subsystems, and general conditions for the convergence of the collective variable dynamics to a mean-field ordinary differential equation are proved. We discuss the convergence to this mean-field limit for a continuous-time noisy version of the so-called ``voter model'' on Erd\H{o}s-R\'enyi random graphs, on the stochastic block model, and on random regular graphs. Moreover, a heterogeneous population of agents is studied.


title: A Review of Uncertainty Calibration in Pretrained Object Detectors

abstract: In the field of deep learning based computer vision, the development of deep object detection has led to unique paradigms (e.g., two-stage or set-based) and architectures (e.g., Faster-RCNN or DETR) which enable outstanding performance on challenging benchmark datasets. Despite this, the trained object detectors typically do not reliably assess uncertainty regarding their own knowledge, and the quality of their probabilistic predictions is usually poor. As these are often used to make subsequent decisions, such inaccurate probabilistic predictions must be avoided. In this work, we investigate the uncertainty calibration properties of different pretrained object detection architectures in a multi-class setting. We propose a framework to ensure a fair, unbiased, and repeatable evaluation and conduct detailed analyses assessing the calibration under distributional changes (e.g., distributional shift and application to out-of-distribution data). Furthermore, by investigating the influence of different detector paradigms, post-processing steps, and suitable choices of metrics, we deliver novel insights into why poor detector calibration emerges. Based on these insights, we are able to improve the calibration of a detector by simply finetuning its last layer.


title: Functional building blocks for scalable multipartite entanglement in optical lattices

abstract: Featuring excellent coherence and operated parallelly, ultracold atoms in optical lattices form a competitive candidate for quantum computation. For this, a massive number of parallel entangled atom pairs have been realized in superlattices. However, the more formidable challenge is to scale-up and detect multipartite entanglement due to the lack of manipulations over local atomic spins in retro-reflected bichromatic superlattices. Here we developed a new architecture based on a cross-angle spin-dependent superlattice for implementing layers of quantum gates over moderately-separated atoms incorporated with a quantum gas microscope for single-atom manipulation. We created and verified functional building blocks for scalable multipartite entanglement by connecting Bell pairs to one-dimensional 10-atom chains and two-dimensional plaquettes of $2\times4$ atoms. This offers a new platform towards scalable quantum computation and simulation.


title: Study of path-length dependent energy loss of jets in p--Pb and Pb--Pb collisions with ALICE

abstract: Jet quenching, a standard signature of quark--gluon plasma (QGP) formation in which jets lose energy by traversing the medium, comprises a well-studied set of observables in heavy-ion collisions. Significant questions remain, however, concerning the mechanisms driving this phenomenon. Theoretical work that attempts to address these open questions offers the path-length dependence of jet energy loss as one way to better understand the underlying mechanisms of jet quenching. It has proven challenging, however, to derive explicit values for the path-length dependence from experimental data. These proceedings discuss recent results from ALICE that attempt to contribute to our understanding of this phenomenon, including results of event-shape engineered jet spectra, the jet-particle $v_{2}$, and correlation studies between hard triggers and hadrons.


title: Debiasing isn't enough! -- On the Effectiveness of Debiasing MLMs and their Social Biases in Downstream Tasks

abstract: We study the relationship between task-agnostic intrinsic and task-specific extrinsic social bias evaluation measures for Masked Language Models (MLMs), and find that there exists only a weak correlation between these two types of evaluation measures. Moreover, we find that MLMs debiased using different methods still re-learn social biases during fine-tuning on downstream tasks. We identify the social biases in both training instances as well as their assigned labels as reasons for the discrepancy between intrinsic and extrinsic bias evaluation measurements. Overall, our findings highlight the limitations of existing MLM bias evaluation measures and raise concerns on the deployment of MLMs in downstream applications using those measures.


title: Fault-tolerant Coding for Entanglement-Assisted Communication

abstract: Channel capacities quantify the optimal rates of sending information reliably over noisy channels. Usually, the study of capacities assumes that the circuits which sender and receiver use for encoding and decoding consist of perfectly noiseless gates. In the case of communication over quantum channels, however, this assumption is widely believed to be unrealistic, even in the long-term, due to the fragility of quantum information, which is affected by the process of decoherence. Christandl and M\"uller-Hermes have therefore initiated the study of fault-tolerant channel coding for quantum channels, i.e. coding schemes where encoder and decoder circuits are affected by noise, and have used techniques from fault-tolerant quantum computing to establish coding theorems for sending classical and quantum information in this scenario. Here, we extend these methods to the case of entanglement-assisted communication, in particular proving that the fault-tolerant capacity approaches the usual capacity when the gate error approaches zero. A main tool, which might be of independent interest, is the introduction of fault-tolerant entanglement distillation. We furthermore focus on the modularity of the techniques used, so that they can be easily adopted in other fault-tolerant communication scenarios.


title: Communication-Efficient and Drift-Robust Federated Learning via Elastic Net

abstract: Federated learning (FL) is a distributed method to train a global model over a set of local clients while keeping data localized. It reduces the risks of privacy and security but faces important challenges including expensive communication costs and client drift issues. To address these issues, we propose FedElasticNet, a communication-efficient and drift-robust FL framework leveraging the elastic net. It repurposes two types of the elastic net regularizers (i.e., $\ell_1$ and $\ell_2$ penalties on the local model updates): (1) the $\ell_1$-norm regularizer sparsifies the local updates to reduce the communication costs and (2) the $\ell_2$-norm regularizer resolves the client drift problem by limiting the impact of drifting local updates due to data heterogeneity. FedElasticNet is a general framework for FL; hence, without additional costs, it can be integrated into prior FL techniques, e.g., FedAvg, FedProx, SCAFFOLD, and FedDyn. We show that our framework effectively resolves the communication cost and client drift problems simultaneously.


title: BootAug: Boosting Text Augmentation via Hybrid Instance Filtering Framework

abstract: Text augmentation is an effective technique for addressing the problem of insufficient data in natural language processing. However, existing text augmentation methods tend to focus on few-shot scenarios and usually perform poorly on large public datasets. Our research indicates that existing augmentation methods often generate instances with shifted feature spaces, which leads to a drop in performance on the augmented data (for example, EDA generally loses $\approx 2\%$ in aspect-based sentiment classification). To address this problem, we propose a hybrid instance-filtering framework (BootAug) based on pre-trained language models that can maintain a similar feature space with natural datasets. BootAug is transferable to existing text augmentation methods (such as synonym substitution and back translation) and significantly improves the augmentation performance by $\approx 2-3\%$ in classification accuracy. Our experimental results on three classification tasks and nine public datasets show that BootAug addresses the performance drop problem and outperforms state-of-the-art text augmentation methods. Additionally, we release the code to help improve existing augmentation methods on large datasets.


title: The Local Isometric Embedding of Two-Metrics of Low Differentiability in Euclidean Three Space

abstract: We prove that the isometric embedding of any metric of differentiability class C1 in E3 exists. We use simplified notation for the given metric, namely geodesic parameters, and level parameters for the embedded surface in E3. Central to our discussion will be solutions of initial value problems for two first order non-linear partial differential equations. We also make use of the classical theory of linear algebraic systems. We will prove local isometric embedding. An example is given for which the Gaussian curvature of the metric is equal to one but the embedded surface is non-analytic.


title: On Explaining Confounding Bias

abstract: When analyzing large datasets, analysts are often interested in the explanations for surprising or unexpected results produced by their queries. In this work, we focus on aggregate SQL queries that expose correlations in the data. A major challenge that hinders the interpretation of such queries is confounding bias, which can lead to an unexpected correlation. We generate explanations in terms of a set of confounding variables that explain the unexpected correlation observed in a query. We propose to mine candidate confounding variables from external sources since, in many real-life scenarios, the explanations are not solely contained in the input data. We present an efficient algorithm that finds the optimal subset of attributes (mined from external sources and the input dataset) that explain the unexpected correlation. This algorithm is embodied in a system called MESA. We demonstrate experimentally over multiple real-life datasets and through a user study that our approach generates insightful explanations, outperforming existing methods that search for explanations only in the input data. We further demonstrate the robustness of our system to missing data and the ability of MESA to handle input datasets containing millions of tuples and an extensive search space of candidate confounding attributes.


title: Effect of geometrically thin discs on precessing, thick flows: Relevance to type-C QPOs

abstract: Type-C quasi-periodic oscillations (QPOs) are the low-frequency QPOs most commonly observed during the hard spectral state of X-ray binary systems. The leading model for these QPOs is the Lense-Thirring precession of a hot, geometrically thick accretion flow that is misaligned with respect to the black hole spin axis. However, none of the work done to date has accounted for the effects of a surrounding, geometrically thin disc on this precession, as would be the case in the truncated disc picture of the hard state. To address this, we perform a set of GRMHD simulations of truncated discs misaligned with the spin axes of their central black holes. Our results confirm that the inner-hot flow still undergoes precession, though at a rate that is only 5 percent of what is predicted for an isolated, precessing torus. We find that the exchange of angular momentum between the outer, thin and the inner, thick disc causes this slow-down in the precession rate and discuss its relevance to type-C QPOs.


title: On the optimal pivot path of simplex method for linear programming based on reinforcement learning

abstract: Based on the existing pivot rules, the simplex method for linear programming is not polynomial in the worst case. Therefore the optimal pivot of the simplex method is crucial. This study proposes the optimal rule to find all shortest pivot paths of the simplex method for linear programming problems based on Monte Carlo tree search (MCTS). Specifically, we first propose the SimplexPseudoTree to transfer the simplex method into tree search mode while avoiding repeated basis variables. Secondly, we propose four reinforcement learning (RL) models with two actions and two rewards to make the Monte Carlo tree search suitable for the simplex method. Thirdly, we set a new action selection criterion to ameliorate the inaccurate evaluation in the initial exploration. It is proved that when the number of vertices in the feasible region is $C_n^m$, our method can generate all the shortest pivot paths, which is the polynomial of the number of variables. In addition, we experimentally validate that the proposed schedule can avoid unnecessary search and provide the optimal pivot path. Furthermore, this method can provide the best pivot labels for all kinds of supervised learning methods to solve linear programming problems.


title: VLSNR:Vision-Linguistics Coordination Time Sequence-aware News Recommendation

abstract: News representation and user-oriented modeling are both essential for news recommendation. Most existing methods are based on textual information but ignore the visual information and users' dynamic interests. However, compared to textual only content, multimodal semantics is beneficial for enhancing the comprehension of users' temporal and long-lasting interests. In our work, we propose a vision-linguistics coordinate time sequence news recommendation. Firstly, a pretrained multimodal encoder is applied to embed images and texts into the same feature space. Then the self-attention network is used to learn the chronological sequence. Additionally, an attentional GRU network is proposed to model user preference in terms of time adequately. Finally, the click history and user representation are embedded to calculate the ranking scores for candidate news. Furthermore, we also construct a large scale multimodal news recommendation dataset V-MIND. Experimental results show that our model outperforms baselines and achieves SOTA on our independently constructed dataset.


title: Many-body localization of ${\mathbb Z}_3$ Fock parafermions

abstract: We study the effects of a random magnetic field on a one-dimensional (1D) spin-1 chain with {\it correlated} nearest-neighbor $XY$ interaction. We show that this spin model can be exactly mapped onto the 1D disordered tight-binding model of ${\mathbb Z}_3$ Fock parafermions (FPFs), exotic anyonic quasiparticles that generalize usual spinless fermions. Thus, we have a peculiar case of a disordered Hamiltonian that, despite being bilinear in the creation and annihilation operators, exhibits a many-body localization (MBL) transition owing to the nontrivial statistics of FPFs. This is in sharp contrast to conventional bosonic and fermionic quadratic disordered Hamiltonians that show single-particle (Anderson) localization. We perform finite-size exact diagonalization calculations of level-spacing statistics, fractal dimensions, and entanglement entropy, and provide convincing evidence for the MBL transition at finite disorder strength.


title: Sixfolds of generalized Kummer type and K3 surfaces

abstract: We prove that any hyper-K\"{a}hler sixfold $K$ of generalized Kummer type has a naturally associated manifold $Y_K$ of $\mathrm{K}3^{[3]}$-type. It is obtained as crepant resolution of the quotient of $K$ by a group of symplectic involutions acting trivially on its second cohomology. When $K$ is projective, the variety $Y_K$ is birational to a moduli space of stable sheaves on a uniquely determined projective~$\mathrm{K}3$ surface~$S_K$. As application of this construction we show that the Kuga-Satake correspondence is algebraic for the K3 surfaces $S_K$, producing infinitely many new families of $\mathrm{K}3$ surfaces of general Picard rank $16$ satisfying the Kuga-Satake Hodge conjecture.


title: Inner rates of finite morphisms

abstract: Let $(X, 0)$ be a complex analytic surface germ embedded in $(\mathbb{C}^n,0)$ with an isolated singularity and $\Phi=(g,f):(X,0) \longrightarrow (\mathbb{C}^2,0)$ be a finite morphism. We define a family of analytic invariants of the morphism $\Phi$, called inner rates of $\Phi$. By means of the inner rates we study the polar curve associated to the morphism $\Phi$ when fixing the topological data of the curve $(gf)^{-1}(0)$ and the surface germ $(X,0)$, allowing to address a problem called polar exploration. We also use the inner rates to study the geometry of the Milnor fibers of a non constant holomorphic function $f:(X,0) \longrightarrow (\mathbb{C},0)$. The main result is a formula which involves the inner rates and the polar curve alongside topological invariants of the surface germ $(X,0)$ and the curve $(gf)^{-1}(0)$.


title: Fast Scrambling of mutual information in Kerr-AdS$_{\textbf{5}}$

abstract: We compute the disruption of mutual information in a TFD state dual to a Kerr black hole with equal angular momenta in $AdS_5$ due to an equatorial shockwave. The shockwave respects the axi-symmetry of the Kerr geometry with specific angular momenta $\mathcal{L}_{\phi_1}$ & $\mathcal{L}_{\phi_2}$. The sub-systems considered are hemispheres in the $left$ and the $right$ dual CFTs with the equator of the $S^3$ as their boundary. We compute the change in the mutual information by determining the growth of the HRT surface at late times. We find that at late times leading upto the scrambling time the minimum value of the instantaneous Lyapunov index $\lambda_L^{(min)}$ is bounded by $\kappa=\frac{2\pi T_H}{(1-\mu \,\mathcal{L}_+)}$ and is found to be greater than $2\pi T_H$ in certain regimes with $T_H$ and $\mu$ denoting the black hole's temperature and the horizon angular velocity respectively while $\mathcal{L}_+=\mathcal{L}_{\phi_1}+\mathcal{L}_{\phi_2}$. We also find that for non-extremal geometries the null perturbation obeys $\mathcal{L}_+<\mu^{-1}$ for it to reach the outer horizon from the $AdS$ boundary. The scrambling time at very late times is given by $\kappa\tau_*\approx\log \mathcal{S}$ where $\mathcal{S}$ is the Kerr entropy. We also find that the onset of scrambling is delayed due to a term proportional to $\log(1-\mu\,\mathcal{L}_+)^{-1}$ which is not extensive and does not scale with the entropy of Kerr black hole.


title: On Grothendieck groups and rings with exact sequences for the Picard, $K_{0}(R)^{\ast}$ and ideal class groups

abstract: The main goal of this article is to investigate the Grothendieck groups, especially the Grothendieck ring $K_{0}(R)$, the Picard group $\Pic(R)$ and the ideal class group $\Cl(R)$ of a given commutative ring $R$. Among the main results, we obtain a general theorem which asserts that for any commutative ring $R$ we have the following exact sequence of groups: $$\xymatrix{0\ar[r]&\Cl(R)\ar[r]&\Pic(R)\ar[r]&\Pic(T(R))}$$ where $T(R)$ denotes the total ring of fractions of $R$. As an application, ...


title: Improving the Sample Efficiency of Prompt Tuning with Domain Adaptation

abstract: Prompt tuning, or the conditioning of a frozen pretrained language model (PLM) with soft prompts learned from data, has demonstrated impressive performance on a wide range of NLP tasks. However, prompt tuning requires a large training dataset to be effective and is outperformed by finetuning the entire PLM in data-scarce regimes. Previous work (Gu et al., 2022, Vu et al., 2022) proposed to transfer soft prompts pretrained on the source domain to the target domain. In this paper, we explore domain adaptation for prompt tuning, a problem setting where unlabeled data from the target domain are available during pretraining. We propose bOosting Prompt TunIng with doMain Adaptation (OPTIMA), which regularizes the decision boundary to be smooth around regions where source and target data distributions are similar. Extensive experiments demonstrate that OPTIMA significantly enhances the transferability and sample-efficiency of prompt tuning compared to strong baselines. Moreover, in few-shot settings, OPTIMA exceeds full-model tuning by a large margin.


title: Video Referring Expression Comprehension via Transformer with Content-aware Query

abstract: Video Referring Expression Comprehension (REC) aims to localize a target object in video frames referred by the natural language expression. Recently, the Transformerbased methods have greatly boosted the performance limit. However, we argue that the current query design is suboptima and suffers from two drawbacks: 1) the slow training convergence process; 2) the lack of fine-grained alignment. To alleviate this, we aim to couple the pure learnable queries with the content information. Specifically, we set up a fixed number of learnable bounding boxes across the frame and the aligned region features are employed to provide fruitful clues. Besides, we explicitly link certain phrases in the sentence to the semantically relevant visual areas. To this end, we introduce two new datasets (i.e., VID-Entity and VidSTG-Entity) by augmenting the VIDSentence and VidSTG datasets with the explicitly referred words in the whole sentence, respectively. Benefiting from this, we conduct the fine-grained cross-modal alignment at the region-phrase level, which ensures more detailed feature representations. Incorporating these two designs, our proposed model (dubbed as ContFormer) achieves the state-of-the-art performance on widely benchmarked datasets. For example on VID-Entity dataset, compared to the previous SOTA, ContFormer achieves 8.75% absolute improvement on Accu.@0.6.


title: All hourglass bosonic excitations in the 1651 magnetic space groups and 528 magnetic layer groups

abstract: The band connectivity as imposed by the compatibility relations between the irreducible representations of little groups can give rise to the exotic hourglass-like shape composed of four branches of bands and five band crossings (BCs). Such an hourglass band connectivity could enforce the emergence of nontrivial excitations like Weyl fermion, Dirac fermion or even beyond them. On the other hand, the bosons, like phonons, magnons, and photons, were also shown to possess nontrivial topology and a comprehensive symmetry classification of the hourglass bosonic excitations would be of great significance to both materials design and device applications. Here we firstly list all concrete positions and representations of little groups in the Brillouin zone (BZ) related with the hourglass bosonic excitations in all the 1651 magnetic space groups and 528 magnetic layer groups, applicable to three dimensional (3D) and two dimensional (2D) systems, respectively. 255 (42) MSGs (MLGs) are found to essentially host such hourglass BCs: Here ``essentially'' means that the bosonic hourglass BC exists definitely as long as the studied system is crystallized in the corresponding MSG/MLG. We also perform first-principles calculations on hundreds of 3D nonmagnetic materials essentially hosting hourglass phonons and propose that the 2D material AlI can host hourglass phonons. We choose AuX (X=Br and I) as illustrative examples to demonstrate that two essential hourglass band structures can coexist in the phonon spectra for both materials while for AuBr, an accidental band crossing sticking two hourglasses is found interestingly. Our results of symmetry conditions for hourglass bosonic excitations can provide a useful guide of designing artificial structures with hourglass bosonic excitations.


title: Probabilistic solutions of fractional differential and partial differential equations and their Monte Carlo simulations

abstract: The work in this paper is four-fold. Firstly, we introduce an alternative approach to solve fractional ordinary differential equations as an expected value of a random time process. Using the latter, we present an interesting numerical approach based on Monte Carlo integration to simulate solutions of fractional ordinary and partial differential equations. Thirdly, we show that this approach allows us to find the fundamental solutions for fractional partial differential equations (PDEs), in which the fractional derivative in time is in the Caputo sense and the fractional in space one is in the Riesz-Feller sense. Lastly, using Riccati equation, we study families of fractional PDEs with variable coefficients which allow explicit solutions. Those solutions connect Lie symmetries to fractional PDEs.


title: Are word boundaries useful for unsupervised language learning?

abstract: Word or word-fragment based Language Models (LM) are typically preferred over character-based ones in many downstream applications. This may not be surprising as words seem more linguistically relevant units than characters. Words provide at least two kinds of relevant information: boundary information and meaningful units. However, word boundary information may be absent or unreliable in the case of speech input (word boundaries are not marked explicitly in the speech stream). Here, we systematically compare LSTMs as a function of the input unit (character, phoneme, word, word part), with or without gold boundary information. We probe linguistic knowledge in the networks at the lexical, syntactic and semantic levels using three speech-adapted black box NLP psycholinguistically-inpired benchmarks (pWUGGY, pBLIMP, pSIMI). We find that the absence of boundaries costs between 2\% and 28\% in relative performance depending on the task. We show that gold boundaries can be replaced by automatically found ones obtained with an unsupervised segmentation algorithm, and that even modest segmentation performance gives a gain in performance on two of the three tasks compared to basic character/phone based models without boundary information.


title: From Rules to Regs: A Structural Topic Model of Collusion Research

abstract: Collusive practices of firms continue to be a major threat to competition and consumer welfare. Academic research on this topic aims at understanding the economic drivers and behavioral patterns of cartels, among others, to guide competition authorities on how to tackle them. Utilizing topical machine learning techniques in the domain of natural language processing enables me to analyze the publications on this issue over more than 20 years in a novel way. Coming from a stylized oligopoly-game theory focus, researchers recently turned toward empirical case studies of bygone cartels. Uni- and multivariate time series analyses reveal that the latter did not supersede the former but filled a gap the decline in rule-based reasoning has left. Together with a tendency towards monocultures in topics covered and an endogenous constriction of the topic variety, the course of cartel research has changed notably: The variety of subjects included has grown, but the pluralism in economic questions addressed is in descent. It remains to be seen whether this will benefit or harm the cartel detection capabilities of authorities in the future.


title: Random Splitting of Fluid Models: Positive Lyapunov Exponents

abstract: In this paper we give sufficient conditions for random splitting systems to have a positive top Lyapunov exponent. We verify these conditions for random splittings of two fluid models: the conservative Lorenz-96 equations and Galerkin approximations of the 2D Euler equations on the torus. In doing so, we highlight particular structures in these equations such as shearing. Since a positive top Lyapunov exponent is an indicator of chaos which in turn is a feature of turbulence, our results show these randomly split fluid models have important characteristics of turbulent flow.


title: POPNASv2: An Efficient Multi-Objective Neural Architecture Search Technique

abstract: Automating the research for the best neural network model is a task that has gained more and more relevance in the last few years. In this context, Neural Architecture Search (NAS) represents the most effective technique whose results rival the state of the art hand-crafted architectures. However, this approach requires a lot of computational capabilities as well as research time, which makes prohibitive its usage in many real-world scenarios. With its sequential model-based optimization strategy, Progressive Neural Architecture Search (PNAS) represents a possible step forward to face this resources issue. Despite the quality of the found network architectures, this technique is still limited in research time. A significant step in this direction has been done by Pareto-Optimal Progressive Neural Architecture Search (POPNAS), which expands PNAS with a time predictor to enable a trade-off between search time and accuracy, considering a multi-objective optimization problem. This paper proposes a new version of the Pareto-Optimal Progressive Neural Architecture Search, called POPNASv2. Our approach enhances its first version and improves its performance. We expanded the search space by adding new operators and improved the quality of both predictors to build more accurate Pareto fronts. Moreover, we introduced cell equivalence checks and enriched the search strategy with an adaptive greedy exploration step. Our efforts allow POPNASv2 to achieve PNAS-like performance with an average 4x factor search time speed-up.


title: Fluctuations in heavy ion collisions and global conservation effects

abstract: Subensemble is a type of statistical ensemble which is the generalization of grand canonical and canonical ensembles. The subensemble acceptance method (SAM) provides general formulas to correct the cumulants of distributions in heavy-ion collisions for the global conservation of all QCD charges. The method is applicable for an arbitrary equation of state and sufficiently large systems, such as those created in central collisions of heavy ions. The new fluctuation measures insensitive to global conservation effects are presented. The main results are illustrated in the hadron resonance gas and van der Waals fluid frameworks.


title: Deformational rigidity of integrable metrics on the torus

abstract: It is conjectured that the only integrable metrics on the two-dimensional torus are Liouville metrics. In this paper, we study a deformative version of this conjecture: We consider integrable deformations of a non-flat Liouville metric in a conformal class and show that for a fairly large class of such deformations the deformed metric is again Liouville. Since our method of proof immediately carries over to higher dimensional tori, we obtain analogous statements in this more general case. In order to put our results in perspective, we review existing results about integrable metrics on the torus.


title: Development of the ComPair gamma-ray telescope prototype

abstract: There is a growing interest in the science uniquely enabled by observations in the MeV range, particularly in light of multi-messenger astrophysics. The Compton Pair (ComPair) telescope, a prototype of the AMEGO Probe-class concept, consists of four subsystems that together detect and characterize gamma rays in the MeV regime. A double-sided strip silicon Tracker gives a precise measure of the first Compton scatter interaction and tracks pair-conversion products. A novel cadmium zinc telluride (CZT) detector with excellent position and energy resolution beneath the Tracker detects the Compton-scattered photons. A thick cesium iodide (CsI) calorimeter contains the high-energy Compton and pair events. The instrument is surrounded by a plastic anti-coincidence (ACD) detector to veto the cosmic-ray background. In this work, we will give an overview of the science motivation and a description of the prototype development and performance.


title: Valuing Uncertainties in Wind Generation: An Agent-Based Optimization Approach

abstract: The increasing integration of variable renewable energy sources such as wind and solar will require new methods of managing generation uncertainty. Existing practices of uncertainty management for these resources largely focuses around modifying the energy offers of such resources in the quantity domain and from a centralized system operator consideration of these uncertainties. This paper proposes an approach to instead consider these uncertainties in the price domain, where more uncertain power is offered at a higher price instead of restricting the quantity offered. We demonstrate system-level impacts on a modified version of the RTS-GMLC system where wind generators create market offers valuing their uncertainties over scenario set of day-ahead production forecasts. The results are compared with a dispatch method in which wind energy is offered at zero marginal price and restricted based on the forecast percentile.


title: Designing a Robust Low-Level Agnostic Controller for a Quadrotor with Actor-Critic Reinforcement Learning

abstract: Purpose: Real-life applications using quadrotors introduce a number of disturbances and time-varying properties that pose a challenge to flight controllers. We observed that, when a quadrotor is tasked with picking up and dropping a payload, traditional PID and RL-based controllers found in literature struggle to maintain flight after the vehicle changes its dynamics due to interaction with this external object. Methods: In this work, we introduce domain randomization during the training phase of a low-level waypoint guidance controller based on Soft Actor-Critic. The resulting controller is evaluated on the proposed payload pick up and drop task with added disturbances that emulate real-life operation of the vehicle. Results & Conclusion: We show that, by introducing a certain degree of uncertainty in quadrotor dynamics during training, we can obtain a controller that is capable to perform the proposed task using a larger variation of quadrotor parameters. Additionally, the RL-based controller outperforms a traditional positional PID controller with optimized gains in this task, while remaining agnostic to different simulation parameters.


title: Tensor-product space-time goal-oriented error control and adaptivity with partition-of-unity dual-weighted residuals for nonstationary flow problems

abstract: In this work, the dual-weighted residual method is applied to a space-time formulation of nonstationary Stokes and Navier-Stokes flow. Tensor-product space-time finite elements are being used to discretize the variational formulation with discontinuous Galerkin finite elements in time and inf-sup stable Taylor-Hood finite element pairs in space. To estimate the error in a quantity of interest and drive adaptive refinement in time and space, we demonstrate how the dual-weighted residual method for incompressible flow can be extended to a partition of unity based error localization. We derive the space-time Newton method for the Navier-Stokes equations and substantiate our methodology on 2D benchmark problems from computational fluid mechanics.


title: Poisson Brackets for some Coulomb Branches

abstract: We construct Poisson bracket relations between the operators which generate the chiral ring of the Coulomb branch of certain $3d$ $\mathcal{N}=4$ quiver gauge theories. In the case where the Coulomb branch is a free space, $ADE$ Klein singularity, or the minimal $A_2$ nilpotent orbit, we explicitly compute the Poisson brackets between the generators using either inherited properties of the abstract Coulomb branch variety, or the expected charges of these operators under the global symmetry (known through use of the monopole formula). We also conjecture Poisson brackets for Higgs branches that originate from $6d$ theories with tensionless strings or $5d$ theories with massless instantons for which the HWG is known, based on representation theoretic and operator content constraints known from the study of their magnetic quiver.


title: Few-shot Generation of Personalized Neural Surrogates for Cardiac Simulation via Bayesian Meta-Learning

abstract: Clinical adoption of personalized virtual heart simulations faces challenges in model personalization and expensive computation. While an ideal solution is an efficient neural surrogate that at the same time is personalized to an individual subject, the state-of-the-art is either concerned with personalizing an expensive simulation model, or learning an efficient yet generic surrogate. This paper presents a completely new concept to achieve personalized neural surrogates in a single coherent framework of meta-learning (metaPNS). Instead of learning a single neural surrogate, we pursue the process of learning a personalized neural surrogate using a small amount of context data from a subject, in a novel formulation of few-shot generative modeling underpinned by: 1) a set-conditioned neural surrogate for cardiac simulation that, conditioned on subject-specific context data, learns to generate query simulations not included in the context set, and 2) a meta-model of amortized variational inference that learns to condition the neural surrogate via simple feed-forward embedding of context data. As test time, metaPNS delivers a personalized neural surrogate by fast feed-forward embedding of a small and flexible number of data available from an individual, achieving -- for the first time -- personalization and surrogate construction for expensive simulations in one end-to-end learning framework. Synthetic and real-data experiments demonstrated that metaPNS was able to improve personalization and predictive accuracy in comparison to conventionally-optimized cardiac simulation models, at a fraction of computation.


title: $J^+$-like Invariants under Bifurcations

abstract: We explore how the invariants $J^+$, $J^-$, $\mathcal{J}_1$ and $\mathcal{J}_2$ of immersions -- generic (at most double points and only transverse intersections) planar smooth closed curves with non-vanishing derivative -- change under $k$-bifurcations ($k \ge 2 \in \mathbb{N}$), which are constructed by running $k$ times through an immersion and then perturbing it to be generic.


title: Guess the Instruction! Flipped Learning Makes Language Models Stronger Zero-Shot Learners

abstract: Meta-training, which fine-tunes the language model (LM) on various downstream tasks by maximizing the likelihood of the target label given the task instruction and input instance, has improved the zero-shot task generalization performance. However, meta-trained LMs still struggle to generalize to challenging tasks containing novel labels unseen during meta-training. In this paper, we propose Flipped Learning, an alternative method of meta-training which trains the LM to generate the task instruction given the input instance and label. During inference, the LM trained with Flipped Learning, referred to as Flipped, selects the label option that is most likely to generate the task instruction. On 14 tasks of the BIG-bench benchmark, the 11B-sized Flipped outperforms zero-shot T0-11B and even a 16 times larger 3-shot GPT-3 (175B) on average by 8.4% and 9.7% points, respectively. Flipped gives particularly large improvements on tasks with unseen labels, outperforming T0-11B by up to +20% average F1 score. This indicates that the strong task generalization of Flipped comes from improved generalization to novel labels. We release our code at https://github.com/seonghyeonye/Flipped-Learning.


title: New features in the differential cross sections measured at the LHC

abstract: The critical analysis of the new experimental data obtained by the ATLAS Collaboration group at 13 TeV is presented and the problem of the tension between data of the ATLAS and TOTEM Collaboration is considered. The analysis of new effects discovered on the basis of experimental data at 13 TeV \cite{osc13,fd13} and associated with the specific properties of the hadron potential at large distances is carried out taking account of all sets of experimental data on elastic $pp$-scattering obtained by the TOTEM and ATLAS Collaborations in a wide momentum transfer region. It also gives quantitative descriptions of all examined experimental data with a minimum of fitting parameters. It is shown that the new features determined at a high statistical level give an important contribution to the differential cross sections and allow the research into hadron interactions at large distances.


title: Robust tube-based LPV-MPC for autonomous lane keeping

abstract: This paper proposes a control architecture for autonomous lane keeping by a vehicle. In this paper, the vehicle dynamics consist of two parts: lateral and longitudinal dynamics. Therefore, the control architecture comprises two subsequent controllers. A longitudinal model predictive control (MPC) makes the vehicle track the desired longitudinal speeds that are assumed to be generated by a speed planner. The longitudinal speeds are then passed to a lateral MPC for lane keeping. Due to the dependence of the lateral dynamics on the longitudinal speed, they are represented in a linear parameter-varying (LPV) form, where its scheduling parameter is the longitudinal speed of the vehicle. In order to deal with the imprecise information of the future longitudinal speed (the scheduling parameter), a bound of uncertainty is considered around the nominal trajectory of the future longitudinal velocities. Then, a tube-based LPV- MPC is adopted to control the lateral dynamics for attaining the lane keeping goal. In the end, the effectiveness of the proposed methods is illustrated by carrying out simulation tests.


title: An explicit upper bound on the number of subgroups of a finite group

abstract: In this paper we prove that a finite group of order $r$ has at most $$ 7.3722\cdot r^{\frac{\log_2r}{4}+1.5315}$$ subgroups.


title: The cross-correlation of galaxies in absorption with the Lyman $\alpha$ forest

abstract: We present the first clustering measurement of Strong Blended Lyman $\alpha$ (SBLA) absorption systems by measuring their cross-correlation with the Lyman $\alpha$ forest. SBLAs are a new population of absorbers detected within the Lyman $\alpha$ forest. We find a bias of $2.329\pm0.057$, consistent with that of Damped Lyman $\alpha$ absorbers (DLAs). For DLAs, we recover a bias of $2.331\pm0.057$ larger than previously reported (P\'erez-R\`afols et al. 2018b). We also find a redshift space distortion parameter $\beta=0.417\pm0.010$, also consistent with the recovered value for DLAs ($\beta=0.416\pm0.010$). This is consistent with SBLA and DLA systems tracing different portions of the circumgalactic medium of a broadly common population of galaxies. Given these common clustering properties, we combined them to perform a cross-correlation of galaxies in absorption with the Ly$\alpha$ forest. We find that the BAO scale uncertainty of this new measurement is $1.75\times$ that of Ly$\alpha$ auto-correlation and $1.6\times$ that of the quasar cross-correlation with the Ly$\alpha$ forest. We note that the current preferred metal contamination model for fitting the correlation functions with respect to the Ly$\alpha$ forest is not realistic enough for SBLA systems, likely due to their status as high redshift precision sites of high metal enrichment. Mock spectra including SBLA systems and their associated metal absorption are required to understand this sample fully. We conclude that SBLAs have the potential to complement the standard Ly$\alpha$ cosmological analyses in future surveys.


title: Fault Diagnosis using eXplainable AI: a Transfer Learning-based Approach for Rotating Machinery exploiting Augmented Synthetic Data

abstract: Artificial Intelligence (AI) is one of the approaches that has been proposed to analyze the collected data (e.g., vibration signals) providing a diagnosis of the asset's operating condition. It is known that models trained with labeled data (supervised) achieve excellent results, but two main problems make their application in production processes difficult: (i) impossibility or long time to obtain a sample of all operational conditions (since faults seldom happen) and (ii) high cost of experts to label all acquired data. Another limitating factor for the applicability of AI approaches in this context is the lack of interpretability of the models (black-boxes), which reduces the confidence of the diagnosis and trust/adoption from users. To overcome these problems, a new generic and interpretable approach for classifying faults in rotating machinery based on transfer learning from augmented synthetic data to real rotating machinery is here proposed, namelly FaultD-XAI (Fault Diagnosis using eXplainable AI). To provide scalability using transfer learning, synthetic vibration signals are created mimicking the characteristic behavior of failures in operation. The application of Gradient-weighted Class Activation Mapping (Grad-CAM) with 1D Convolutional Neural Network (1D CNN) allows the interpretation of results, supporting the user in decision making and increasing diagnostic confidence. The proposed approach not only obtained promising diagnostic performance, but was also able to learn characteristics used by experts to identify conditions in a source domain and apply them in another target domain. The experimental results suggest a promising approach on exploiting transfer learning, synthetic data and explainable artificial intelligence for fault diagnosis. Lastly, to guarantee reproducibility and foster research in the field, the developed dataset is made publicly available.


title: Parameter Distributions of Binary Black Hole Mergers Near Supermassive Black Holes as Seen by Advanced Gravitational Wave Detectors

abstract: The environment surrounding supermassive black holes (SMBHs) in galactic nuclei (GNs) is expected to harbour stellar-mass binary black hole (BBH) populations. These binaries were suggested to form a hierarchical triple system with the SMBH, and gravitational perturbations from the SMBH can enhance the mergers of BBHs through Lidov-Kozai (LK) oscillations. Previous studies determined the expected binary parameter distribution for this merger channel in single GNs. Here we account for the different spatial distribution and mass distribution models of BBHs around SMBHs and perform direct high-precision regularized N-body simulations, including Post-Newtonian (PN) terms up to order PN2.5, to model merging BBH populations in single GNs. We use a full inspiral-merger-ringdown waveform model of BBHs with nonzero eccentricities and take into account the observational selection effect to determine the parameter distributions of LK-induced BBHs detected with a single advanced gravitational-wave (GW) detector from all GNs in the Universe. We find that the detected mergers' total binary mass distribution is tilted towards lower masses, and the mass ratio distribution is roughly uniform. The redshift distribution peaks between ~0.15-0.55, and the vast majority of binaries merge within redshift ~1.1. The fraction of binaries entering the LIGO/Virgo/KAGRA band with residual eccentricities >0.1 is below ~10%. We identify a negative correlation between residual eccentricity and mass parameters and a negative correlation between residual eccentricity and source distance. Our results for the parameter distributions and correlations among binary parameters may make it possible to disentangle this merger channel from other BBH merger channels statistically.


title: A new efficient explicit Deferred Correction framework: analysis and applications to hyperbolic PDEs and adaptivity

abstract: The Deferred Correction (DeC) is an iterative procedure, characterized by increasing accuracy at each iteration, which can be used to design numerical methods for systems of ODEs. The main advantage of such framework is the automatic way of getting arbitrarily high order methods, which can be put in Runge--Kutta (RK) form. The drawback is the larger computational cost with respect to the most used RK methods. To reduce such cost, in an explicit setting, we propose an efficient modification: we introduce interpolation processes between the DeC iterations, decreasing the computational cost associated to the low order ones. We provide the Butcher tableaux of the new modified methods and we study their stability, showing that in some cases the computational advantage does not affect the stability. The flexibility of the novel modification allows nontrivial applications to PDEs and construction of adaptive methods. The good performances of the introduced methods are broadly tested on several benchmarks both in ODE and PDE contexts.


title: Quantum Simulation of Preferred Tautomeric State Prediction

abstract: Prediction of tautomers plays an essential role in computer-aided drug discovery. However, it remains a challenging task nowadays to accurately predict the canonical tautomeric form of a given drug-like molecule. Lack of extensive tautomer databases, most likely due to the difficulty in experimental studies, hampers the development of effective empirical methods for tautomer predictions. A more accurate estimation of the stable tautomeric form can be achieved by quantum chemistry calculations. Yet, the computational cost required prevents quantum chemistry calculation as a standard tool for tautomer prediction in computer-aided drug discovery. In this paper we propose a hybrid quantum chemistry-quantum computation workflow to efficiently predict the dominant tautomeric form. Specifically, we select active-space molecular orbitals based on quantum chemistry methods. Then we utilize efficient encoding methods to map the Hamiltonian onto quantum devices to reduce the qubit resources and circuit depth. Finally, variational quantum eigensolver (VQE) algorithms are employed for ground state estimation where hardware-efficient ansatz circuits are used. To demonstrate the applicability of our methodology, we perform experiments on two tautomeric systems: acetone and Edaravone, each having 52 and 150 spin-orbitals in the STO-3G basis set, respectively. Our numerical results show that their tautomeric state prediction agrees with the CCSD benchmarks. Moreover, the required quantum resources are efficient: in the example of Edaravone, we could achieve chemical accuracy with only eight qubits and 80 two-qubit gates.


title: Remembering Netizens: An interview with Ronda Hauben, co-author of Netizens: On the history and impact of Usenet and the Internet (1997)

abstract: Netizens, Michael and Ronda Hauben's foundational treatise on Usenet and the Internet, was first published in print 25 years ago. In this piece, we trace the history and impact of the book and of Usenet itself, contextualising them within the contemporary and modern-day scholarship on virtual communities, online culture, and Internet history. We discuss the Net as a tool of empowerment, and touch on the social, technical, and economic issues related to the maintenance of shared network infrastructures and to the preservation and commodification of Usenet archives. Our interview with Ronda Hauben offers a retrospective look at the development of online communities, their impact, and how they are studied. She recounts her own introduction to the online world, as well as the impetus and writing process for Netizens. She presents Michael Hauben's conception of "netizens" as contributory citizens of the Net (rather than mere users of it) and the "electronic commons" they built up, and argues that this collaborative and collectivist model has been overwhelmed and endangered by the privatisation and commercialisation of the Internet and its communities.


title: Decay constant of $B_c^*$ accurate up to $\mathcal{O}(\alpha_s^3)$

abstract: In this paper, we evaluate, up to QCD next-to-next-to-next-to-leading order, the $B_c^*$ decay constant, which, within the nonrelativistic QCD (NRQCD) framework, is factorized as the product of the short-distance coefficient (SDC) and the long-distance matrix element. For the first time, the renormalization constant and the anomalous dimension for the NRQCD vector current composed of $c\bar{b}$, which are functions of the charm quark mass $m_c$, the bottom quark mass $m_b$ and the factorization scale $\mu_\Lambda$, are obtained analytically at $\mathcal{O}(\alpha_s^2)$ and $\mathcal{O}(\alpha_s^3)$. The SDC is calculated up to $\mathcal{O}(\alpha_s^3)$ in perturbative expansion. Explicitly, the $\mathcal{O}(\alpha_s^2)$ correction to the SDC is analytically calculated in terms of logarithmic and polylogarithmic functions of $r\equiv m_b/m_c$, and the $\mathcal{O}(\alpha_s^3)$ correction to the SDC is numerically calculated at a series of values of $r$, ranging from $2.1$ to $4.0$. Surprisingly, we find that the nontrivial part of the SDC at $\mathcal{O}(\alpha_s^3)$ can be well estimated by a linear function of $r$. In addition, We find that the $\mathcal{O}(\alpha_s^2)$ and $\mathcal{O}(\alpha_s^3)$ corrections to the decay constant and decay width are considerable and very significant, which indicates a very poor convergence for the perturbative expansion.


title: Deep Learning of Near Field Beam Focusing in Terahertz Wideband Massive MIMO Systems

abstract: Employing large antenna arrays and utilizing large bandwidth have the potential of bringing very high data rates to future wireless communication systems. However, this brings the system into the near-field regime and also makes the conventional transceiver architectures suffer from the wideband effects. To address these problems, in this paper, we propose a low-complexity frequency-aware beamforming solution that is designed for hybrid time-delay and phase-shifter based RF architectures. To reduce the complexity, the joint design problem of the time delays and phase shifts is decomposed into two subproblems, where a signal model inspired online learning framework is proposed to learn the shifts of the quantized analog phase shifters, and a low-complexity geometry-assisted method is leveraged to configure the delay settings of the time-delay units. Simulation results highlight the efficacy of the proposed solution in achieving robust performance across a wide frequency range for large antenna array systems.


title: Quantum spin Hall phase in GeSn heterostructures on silicon

abstract: Quantum phases of solid-state electron systems look poised to sustain exotic phenomena and a very rich spin physics. We propose a practical silicon-based architecture that spontaneously sustains topological properties, while being fully compatible with the high-volume manufacturing capabilities of modern microelectronic foundries. Here we show how Ge1-xSnx alloys, an emerging group IV semiconductor, can be engineered into junctions that demonstrate a broken gap alignment. We predict such basic building block undergo a quantum phase transition that can elegantly accommodate the existence of gate-controlled chiral edge states directly on Si. This will enable tantalizing prospects for designing integrated circuits hosting quantum spin hall insulators and advanced topological functionalities.


title: Interplay of Pauli blockade with electron-photon coupling in quantum dots

abstract: Both quantum transport measurements in the Pauli blockade regime and microwave cavity transmission measurements are important tools for spin-qubit readout and characterization. Based on a generalized input-output theory we derive a theoretical framework to investigate how a double quantum dot (DQD) in a transport setup interacts with a coupled microwave resonator while the current through the DQD is rectified by Pauli blockade. We show that the output field of the resonator can be used to infer the leakage current and thus obtain insight into the blockade mechanisms. In the case of a silicon DQD, we show how the valley quasi-degeneracy can impose limitations on this scheme. We also demonstrate that a large number of unknown DQD parameters including (but not limited to) the valley splitting can be estimated from the resonator response simultaneous to a transport experiment, providing more detailed knowledge about the microscopic environment of the DQD. Furthermore, we describe and quantify a back-action of the resonator photons on the steady state leakage current.


title: GNSS/MEMS-INS Integration for Drone Navigation using EKF on Lie Groups

abstract: Building upon the theory of Kalman Filtering on Lie Groups, this paper describes an Extended Kalman Filter and Smoother for Loosely Coupled Integration of GNSS/INS tailored for post-processing applications. The approach employs a dynamic model on a matrix Lie Group that aggregates position, velocity, attitude, and the IMU biases as a single element of a Lie group. The development was motivated by a drone-borne Differential Interferometric SAR (DinSAR) application, which requires high-precision navigation information for short-flight missions using low-cost MEMS sensors. The filter and the Rauch-Tung-Striebel (RTS) smoother are both implemented and validated. The paper also presents a novel algorithm to initialize the heading value as an alternative to gyro-compassing or magnetometer-based alignments. The Mahalanobis Distance and the $\chi^2$-test are employed during the filter update step to address the practical issue of outlier rejection for the GNSS measurements. The paper uses synthetic data to compare classic navigation schemes based on multiplicative quaternions and Euler angles. Finally, real data experiments demonstrate that the Kalman Filter based on Lie Groups performs better DinSAR processing than state-of-the-art commercial software.


title: The Lie Derivative for Measuring Learned Equivariance

abstract: Equivariance guarantees that a model's predictions capture key symmetries in data. When an image is translated or rotated, an equivariant model's representation of that image will translate or rotate accordingly. The success of convolutional neural networks has historically been tied to translation equivariance directly encoded in their architecture. The rising success of vision transformers, which have no explicit architectural bias towards equivariance, challenges this narrative and suggests that augmentations and training data might also play a significant role in their performance. In order to better understand the role of equivariance in recent vision models, we introduce the Lie derivative, a method for measuring equivariance with strong mathematical foundations and minimal hyperparameters. Using the Lie derivative, we study the equivariance properties of hundreds of pretrained models, spanning CNNs, transformers, and Mixer architectures. The scale of our analysis allows us to separate the impact of architecture from other factors like model size or training method. Surprisingly, we find that many violations of equivariance can be linked to spatial aliasing in ubiquitous network layers, such as pointwise non-linearities, and that as models get larger and more accurate they tend to display more equivariance, regardless of architecture. For example, transformers can be more equivariant than convolutional neural networks after training.


title: Non-Hermitian topological quantum states in a reservoir-engineered transmon chain

abstract: Dissipation in open systems enriches the possible symmetries of the Hamiltonians beyond the Hermitian framework allowing the possibility of novel non-Hermitian topological phases, which exhibit long-living end states that are protected against disorder. So far, non-Hermitian topology has been explored only in settings where probing genuine quantum effects has been challenging. We theoretically show that a non-Hermitian topological quantum phase can be realized in a reservoir-engineered transmon chain. The spatial modulation of dissipation is obtained by coupling each transmon to a quantum circuit refrigerator allowing in-situ tuning of dissipation strength in a wide range. By solving the many-body Lindblad master equation using a combination of the density matrix renormalization group and third quantization approaches, we show that the topological end modes and the associated phase transition are visible in simple reflection measurements with experimentally realistic parameters. Finally, we demonstrate that genuine quantum effects are observable in this system via robust and slowly decaying long-range quantum entanglement of the topological end modes, which can be generated passively starting from a locally excited transmon.


title: What Do I Need to Design for Co-Design? Supporting Co-design as a Designerly Practice

abstract: Co-design practices have been used for decades to support participatory engagement in design work. However, despite a wide range of materials that describe the design and commitments of numerous co-design experiences, few descriptions of the knowledge that guides designers when creating these experiences exist. Thus, we ask: What kind of knowledge do designers need to design co-design experiences? What form(s) could intermediate-level knowledge for co-design take? To answer these questions, we adopted a co/auto-ethnographic and Research-through-Design approach to reflexively engage with our design decisions, outcomes, and challenges related to two virtual co-design workshops. We constructed a set of four multi-dimensional facets(Rhythms of Engagement, Material Engagement, Ludic Engagement, and Conceptual Achievement) and three roles (designer, researcher, facilitator) to consider when creating co-design experiences. We illustrate these facets and roles through examples, building new \textit{intermediate-level knowledge} to support future co-design research and design, framing co-design as a designerly practice.


title: TrustVault: A privacy-first data wallet for the European Blockchain Services Infrastructure

abstract: The European Union is on course to introduce a European Digital Identity that will be available to all EU citizens and businesses. This will have a huge impact on how citizens and businesses interact online. Big Tech companies currently dictate how digital identities are used. As a result, they have amassed vast amounts of private user data. Movements like Self-Sovereign Identity aim to give users control over their online identity. TrustVault is the first data wallet that gives users back control of their identity and all their data. TrustVault allows users to store all their data on their smartphones and control with whom they share it. The user has fine-grained access control based on verifiable user attributes. EBSI connects TrustVault to the European Self-Sovereign Identity Framework allowing users to use Verifiable Credentials from public and private institutions in their access control policies. The system is serverless and has no Trusted Third Parties. TrustVault replaces the for-profit infrastructure of Big Tech with a public and transparent platform for innovation.


title: Bounding the diameter and eigenvalues of amply regular graphs via Lin-Lu-Yau curvature

abstract: An amply regular graph is a regular graph such that any two adjacent vertices have $\alpha$ common neighbors and any two vertices with distance $2$ have $\beta$ common neighbors. We prove a sharp lower bound estimate for the Lin--Lu--Yau curvature of any amply regular graph with girth $3$ and $\beta>\alpha$. The proof involves new ideas relating discrete Ricci curvature with local matching properties: This includes a novel construction of a regular bipartite graph from the local structure and related distance estimates. As a consequence, we obtain sharp diameter and eigenvalue bounds for amply regular graphs.


title: SynBench: Task-Agnostic Benchmarking of Pretrained Representations using Synthetic Data

abstract: Recent success in fine-tuning large models, that are pretrained on broad data at scale, on downstream tasks has led to a significant paradigm shift in deep learning, from task-centric model design to task-agnostic representation learning and task-specific fine-tuning. As the representations of pretrained models are used as a foundation for different downstream tasks, this paper proposes a new task-agnostic framework, \textit{SynBench}, to measure the quality of pretrained representations using synthetic data. We set up a reference by a theoretically-derived robustness-accuracy tradeoff of the class conditional Gaussian mixture. Given a pretrained model, the representations of data synthesized from the Gaussian mixture are used to compare with our reference to infer the quality. By comparing the ratio of area-under-curve between the raw data and their representations, SynBench offers a quantifiable score for robustness-accuracy performance benchmarking. Our framework applies to a wide range of pretrained models taking continuous data inputs and is independent of the downstream tasks and datasets. Evaluated with several pretrained vision transformer models, the experimental results show that our SynBench score well matches the actual linear probing performance of the pre-trained model when fine-tuned on downstream tasks. Moreover, our framework can be used to inform the design of robust linear probing on pretrained representations to mitigate the robustness-accuracy tradeoff in downstream tasks.


title: Fourier decay for curved Frostman measures

abstract: We investigate decoupling for Frostman measures supported on curves with nonzero curvature. We combine this tool with known lower bounds for Furstenberg sets to reprove Orponen's recent result for the parabola.


title: Cross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baseline

abstract: As one of the fundamental functions of autonomous driving system, freespace detection aims at classifying each pixel of the image captured by the camera as drivable or non-drivable. Current works of freespace detection heavily rely on large amount of densely labeled training data for accuracy and robustness, which is time-consuming and laborious to collect and annotate. To the best of our knowledge, we are the first work to explore unsupervised domain adaptation for freespace detection to alleviate the data limitation problem with synthetic data. We develop a cross-modality domain adaptation framework which exploits both RGB images and surface normal maps generated from depth images. A Collaborative Cross Guidance (CCG) module is proposed to leverage the context information of one modality to guide the other modality in a cross manner, thus realizing inter-modality intra-domain complement. To better bridge the domain gap between source domain (synthetic data) and target domain (real-world data), we also propose a Selective Feature Alignment (SFA) module which only aligns the features of consistent foreground area between the two domains, thus realizing inter-domain intra-modality adaptation. Extensive experiments are conducted by adapting three different synthetic datasets to one real-world dataset for freespace detection respectively. Our method performs closely to fully supervised freespace detection methods (93.08 v.s. 97.50 F1 score) and outperforms other general unsupervised domain adaptation methods for semantic segmentation with large margins, which shows the promising potential of domain adaptation for freespace detection.


title: COVID-19 Detection Using Segmentation, Region Extraction and Classification Pipeline

abstract: The main purpose of this study is to develop a pipeline for COVID-19 detection from a big and challenging database of Computed Tomography (CT) images. The proposed pipeline includes a segmentation part, a lung extraction part, and a classifier part. Optional slice removal techniques after UNet-based segmentation of slices were also tried. The methodologies tried in the segmentation part are traditional segmentation methods as well as UNet-based methods. In the classification part, a Convolutional Neural Network (CNN) was used to take the final diagnosis decisions. In terms of the results: in the segmentation part, the proposed segmentation methods show high dice scores on a publicly available dataset. In the classification part, the results were compared at slice-level and at patient-level as well. At slice-level, methods were compared and showed high validation accuracy indicating efficiency in predicting 2D slices. At patient level, the proposed methods were also compared in terms of validation accuracy and macro F1 score on the validation set. The dataset used for classification is COV-19CT Database. The method proposed here showed improvement from our precious results on the same dataset. In Conclusion, the improved work in this paper has potential clinical usages for COVID-19 detection and diagnosis via CT images. The code is on github at https://github.com/IDU-CVLab/COV19D_3rd


title: Polar metals: Principles and Prospects

abstract: We review the class of materials known as polar metals, in which polarity and metallicity coexist in the same phase. While the notion of polar metals was first invoked more than 50 years ago, their practical realization has proved challenging, since the itinerant carriers required for metallicity tend to screen any polarization. Huge progress has been made in the last decade, with many mechanisms for combining polarity and metallicity proposed, and the first examples, LiOsO3 and WTe2, identified experimentally. The availability of polar metallic samples has opened a new paradigm in polar metal research, with implications in the fields of topology, ferroelectricity, magnetoelectricity, spintronics, and superconductivity. Here, we review the principles and techniques that have been developed to design and engineer polar metals and describe some of their interesting properties, with a focus on the most promising directions for future work.


title: Scaffolding Ethics-Focused Methods for Practice Resonance

abstract: Numerous methods and tools have been proposed to motivate or support ethical awareness in design practice. However, many existing resources are not easily discoverable by practitioners. One reason being that they are framed using language that is not immediately accessible or resonant with the felt complexity of everyday practice. In this paper, we propose a set of empirically-supported "intentions" to frame practitioners' selection of relevant ethics-focused methods based on interviews with practitioners from a range of technology and design professions, and then leverage these intentions in the design and iterative evaluation of a website that allows practitioners to identify supports for ethics-focused action in their work context. Building on these findings, we propose a set of heuristics to evaluate the practice resonance of resources to support ethics-focused practice, laying the groundwork for increased ecological resonance of ethics-focused methods and method selection tools.


title: Compressed Vision for Efficient Video Understanding

abstract: Experience and reasoning occur across multiple temporal scales: milliseconds, seconds, hours or days. The vast majority of computer vision research, however, still focuses on individual images or short videos lasting only a few seconds. This is because handling longer videos require more scalable approaches even to process them. In this work, we propose a framework enabling research on hour-long videos with the same hardware that can now process second-long videos. We replace standard video compression, e.g. JPEG, with neural compression and show that we can directly feed compressed videos as inputs to regular video networks. Operating on compressed videos improves efficiency at all pipeline levels -- data transfer, speed and memory -- making it possible to train models faster and on much longer videos. Processing compressed signals has, however, the downside of precluding standard augmentation techniques if done naively. We address that by introducing a small network that can apply transformations to latent codes corresponding to commonly used augmentations in the original video space. We demonstrate that with our compressed vision pipeline, we can train video models more efficiently on popular benchmarks such as Kinetics600 and COIN. We also perform proof-of-concept experiments with new tasks defined over hour-long videos at standard frame rates. Processing such long videos is impossible without using compressed representation.