title: Efficient Fine-tuning of Audio Spectrogram Transformers via Soft Mixture of Adapters

abstract: Mixture of Experts (MoE) architectures have recently started burgeoning due to their ability to scale model's capacity while maintaining the computational cost affordable. Furthermore, they can be applied to both Transformers and State Space Models, the current state-of-the-art models in numerous fields. While MoE has been mostly investigated for the pre-training stage, its use in parameter-efficient transfer learning settings is under-explored. To narrow this gap, this paper attempts to demystify the use of MoE for parameter-efficient fine-tuning of Audio Spectrogram Transformers to audio and speech downstream tasks. Specifically, we propose Soft Mixture of Adapters (Soft-MoA). It exploits adapters as the experts and, leveraging the recent Soft MoE method, it relies on a soft assignment between the input tokens and experts to keep the computational time limited. Extensive experiments across 4 benchmarks demonstrate that Soft-MoA outperforms the single adapter method and performs on par with the dense MoA counterpart. We finally present ablation studies on key elements of Soft-MoA, showing for example that Soft-MoA achieves better scaling with more experts, as well as ensuring that all experts contribute to the computation of the output tokens, thus dispensing with the expert imbalance issue.


title: The En Route Truck-Drone Delivery Problem

abstract: We study the truck-drone cooperative delivery problem in a setting where a single truck carrying a drone travels at constant speed on a straight-line trajectory/street. Delivery to clients located in the plane and not on the truck's trajectory is performed by the drone, which has limited carrying capacity and flying range, and whose battery can be recharged when on the truck. We show that the problem of maximizing the number of deliveries is strongly NP-hard even in this simple setting. We present a 2-approximation algorithm for the problem, and an optimal algorithm for a non-trivial family of instances.


title: Common errors in Generative AI systems used for knowledge extraction in the climate action domain

abstract: Large Language Models (LLMs) and, more specifically, the Generative Pre-Trained Transformers (GPT) can help stakeholders in climate action explore digital knowledge bases and extract and utilize climate action knowledge in a sustainable manner. However, LLMs are "probabilistic models of knowledge bases" that excel at generating convincing texts but cannot be entirely relied upon due to the probabilistic nature of the information produced. This brief report illustrates the problem space with examples of LLM responses to some of the questions of relevance to climate action.


title: A YANG-aided Unified Strategy for Black Hole Detection for Backbone Networks

abstract: Despite the crucial importance of addressing Black Hole failures in Internet backbone networks, effective detection strategies in backbone networks are lacking. This is largely because previous research has been centered on Mobile Ad-hoc Networks (MANETs), which operate under entirely different dynamics, protocols, and topologies, making their findings not directly transferable to backbone networks. Furthermore, detecting Black Hole failures in backbone networks is particularly challenging. It requires a comprehensive range of network data due to the wide variety of conditions that need to be considered, making data collection and analysis far from straightforward. Addressing this gap, our study introduces a novel approach for Black Hole detection in backbone networks using specialized Yet Another Next Generation (YANG) data models with Black Hole-sensitive Metric Matrix (BHMM) analysis. This paper details our method of selecting and analyzing four YANG models relevant to Black Hole detection in ISP networks, focusing on routing protocols and ISP-specific configurations. Our BHMM approach derived from these models demonstrates a 10% improvement in detection accuracy and a 13% increase in packet delivery rate, highlighting the efficiency of our approach. Additionally, we evaluate the Machine Learning approach leveraged with BHMM analysis in two different network settings, a commercial ISP network, and a scientific research-only network topology. This evaluation also demonstrates the practical applicability of our method, yielding significantly improved prediction outcomes in both environments.


title: Linear optics and the problem of Bell-like state discrimination

abstract: A linear optics-based scheme to implement various quantum information processing tasks is of paramount importance due to ease of implementation and low noise. Many information-theoretic tasks depend on the successful discrimination of Bell states. A no-go theorem has been proved in literature which tells that it is not possible to perfectly discriminate among the four Bell states by restricting measurement apparatus to linear optical elements. The success probability is only $50\%$. Through using extra resources such as hyper entanglement, ancillary entanglement, and even a minimum amount of non-linearity complete Bell-state discrimination can be achieved. The success probability for Bell-like state discrimination is only $25\%$. We find that this can be boosted up to $50\%$ using hyperentanglement in polarization, momentum, or OAM degrees of freedom of the photons which is in contrast to the Bell-state discrimination scenario where $100\%$ can be achieved. Furthermore, we find that by using correlation in time of the photons all four Bell states can be distinguished with $100\%$ success probability while for the Bell-like state discrimination, it strictly lies between $25\%$ and $50\%$ depending on the state parameter with only three Bell-like states being distinguishable. We also observe a similar contrast when we use ancillary entangled photons. While the success probability for all four Bell-state discrimination increases as $1-\frac{1}{2^N}$ where N is the number of ancillary photons for Bell-like states it depends again on the state parameters and can be less than $25\%$ in some cases. Also adding further ancillary photons decreases the success probability. We then show that using non-linear gadgets namely SFG $100\%$ success probability can be achieved even for Bell-like state discrimination.


title: Orthogonal gamma-based expansion for the CIR's first passage time distribution

abstract: In this paper we analyze a method for approximating the first-passage time density and the corresponding distribution function for a CIR process. This approximation is obtained by truncating a series expansion involving the generalized Laguerre polynomials and the gamma probability density. The suggested approach involves a number of numerical issues which depend strongly on the coefficient of variation of the first passage time random variable. These issues are examined and solutions are proposed also involving the first passage time distribution function. Numerical results and comparisons with alternative approximation methods show the strengths and weaknesses of the proposed method. A general acceptance-rejection-like procedure, that makes use of the approximation, is presented. It allows the generation of first passage time data, even if its distribution is unknown.


title: Approximating maximum-size properly colored forests

abstract: In the Properly Colored Spanning Tree problem, we are given an edge-colored undirected graph and the goal is to find a properly colored spanning tree, i.e., a spanning tree in which any two adjacent edges have distinct colors. The problem is interesting not only from a graph coloring point of view, but is also closely related to the Degree Bounded Spanning Tree and (1,2)-Traveling Salesman problems, two classical questions that have attracted considerable interest in combinatorial optimization and approximation theory. Previous work on properly colored spanning trees has mainly focused on determining the existence of such a tree and hence has not considered the question from an algorithmic perspective. We propose an optimization version called Maximum-size Properly Colored Forest problem, which aims to find a properly colored forest with as many edges as possible. We consider the problem in different graph classes and for different numbers of colors, and present polynomial-time approximation algorithms as well as inapproximability results for these settings. Our proof technique relies on the sum of matching matroids defined by the color classes, a connection that might be of independent combinatorial interest. We also consider the Maximum-size Properly Colored Tree problem, which asks for the maximum size of a properly colored tree not necessarily spanning all the vertices. We show that the optimum is significantly more difficult to approximate than in the forest case, and provide an approximation algorithm for complete multigraphs.


title: ALISON: Fast and Effective Stylometric Authorship Obfuscation

abstract: Authorship Attribution (AA) and Authorship Obfuscation (AO) are two competing tasks of increasing importance in privacy research. Modern AA leverages an author's consistent writing style to match a text to its author using an AA classifier. AO is the corresponding adversarial task, aiming to modify a text in such a way that its semantics are preserved, yet an AA model cannot correctly infer its authorship. To address privacy concerns raised by state-of-the-art (SOTA) AA methods, new AO methods have been proposed but remain largely impractical to use due to their prohibitively slow training and obfuscation speed, often taking hours. To this challenge, we propose a practical AO method, ALISON, that (1) dramatically reduces training/obfuscation time, demonstrating more than 10x faster obfuscation than SOTA AO methods, (2) achieves better obfuscation success through attacking three transformer-based AA methods on two benchmark datasets, typically performing 15% better than competing methods, (3) does not require direct signals from a target AA classifier during obfuscation, and (4) utilizes unique stylometric features, allowing sound model interpretation for explainable obfuscation. We also demonstrate that ALISON can effectively prevent four SOTA AA methods from accurately determining the authorship of ChatGPT-generated texts, all while minimally changing the original text semantics. To ensure the reproducibility of our findings, our code and data are available at: https://github.com/EricX003/ALISON.


title: The Primitive Comparison Theorem in characteristic $p$

abstract: We prove an analogue of Scholze's Primitive Comparison Theorem for proper rigid spaces over an algebraically closed non-archimedean field $K$ of characteristic $p$. This implies a v-topological version of the Primitive Comparison Theorem for proper finite type morphisms $f:X\to Y$ of analytic adic spaces over $\mathbb Z_p$. We deduce new cases of the Proper Base Change Theorem for $p$-torsion coefficients and the K\"unneth formula in this setting.


title: Unveiling nonequilibrium from multifilar events

abstract: Closely related to the laws of thermodynamics, the detection and quantification of disequilibria are crucial in unraveling the complexities of nature, particularly those beneath observable layers. Theoretical developments in nonequilibrium thermodynamics employ coarse-graining methods to consider a diversity of partial information scenarios that mimic experimental limitations, allowing the inference of properties such as the entropy production rate. A ubiquitous but rather unexplored scenario involves observing events that can possibly arise from many transitions in the underlying Markov process--which we dub $\textit{multifilar events}$--as in the cases of exchanges measured at particle reservoirs, hidden Markov models, mixed chemical and mechanical transformations in biological function, composite systems, and more. We relax one of the main assumptions in a previously developed framework, based on first-passage problems, to assess the non-Markovian statistics of mutifilar events. By using the asymmetry of event distributions and their waiting-times, we put forward model-free tools to detect nonequilibrium behavior and estimate entropy production, while discussing their suitability for different classes of systems and regimes where they provide no new information, evidence of nonequilibrium, a lower bound for entropy production, or even its exact value. The results are illustrated in reference models through analytics and numerics.


title: OLMo: Accelerating the Science of Language Models

abstract: Language models (LMs) have become ubiquitous in both NLP research and in commercial product offerings. As their commercial importance has surged, the most powerful models have become closed off, gated behind proprietary interfaces, with important details of their training data, architectures, and development undisclosed. Given the importance of these details in scientifically studying these models, including their biases and potential risks, we believe it is essential for the research community to have access to powerful, truly open LMs. To this end, we have built OLMo, a competitive, truly Open Language Model, to enable the scientific study of language models. Unlike most prior efforts that have only released model weights and inference code, we release OLMo alongside open training data and training and evaluation code. We hope this release will empower the open research community and inspire a new wave of innovation.


title: X-CBA: Explainability Aided CatBoosted Anomal-E for Intrusion Detection System

abstract: The effectiveness of Intrusion Detection Systems (IDS) is critical in an era where cyber threats are becoming increasingly complex. Machine learning (ML) and deep learning (DL) models provide an efficient and accurate solution for identifying attacks and anomalies in computer networks. However, using ML and DL models in IDS has led to a trust deficit due to their non-transparent decision-making. This transparency gap in IDS research is significant, affecting confidence and accountability. To address, this paper introduces a novel Explainable IDS approach, called X-CBA, that leverages the structural advantages of Graph Neural Networks (GNNs) to effectively process network traffic data, while also adapting a new Explainable AI (XAI) methodology. Unlike most GNN-based IDS that depend on labeled network traffic and node features, thereby overlooking critical packet-level information, our approach leverages a broader range of traffic data through network flows, including edge attributes, to improve detection capabilities and adapt to novel threats. Through empirical testing, we establish that our approach not only achieves high accuracy with 99.47% in threat detection but also advances the field by providing clear, actionable explanations of its analytical outcomes. This research also aims to bridge the current gap and facilitate the broader integration of ML/DL technologies in cybersecurity defenses by offering a local and global explainability solution that is both precise and interpretable.


title: Scattering wave packets of hadrons in gauge theories: Preparation on a quantum computer

abstract: Quantum simulation holds promise of enabling a complete description of high-energy scattering processes rooted in gauge theories of the Standard Model. A first step in such simulations is preparation of interacting hadronic wave packets. To create the wave packets, one typically resorts to adiabatic evolution to bridge between wave packets in the free theory and those in the interacting theory, rendering the simulation resource intensive. In this work, we construct a wave-packet creation operator directly in the interacting theory to circumvent adiabatic evolution, taking advantage of resource-efficient schemes for ground-state preparation, such as variational quantum eigensolvers. By means of an ansatz for bound mesonic excitations in confining gauge theories, which is subsequently optimized using classical or quantum methods, we show that interacting mesonic wave packets can be created efficiently and accurately using digital quantum algorithms that we develop. Specifically, we obtain high-fidelity mesonic wave packets in the $Z_2$ and $U(1)$ lattice gauge theories coupled to fermionic matter in 1+1 dimensions. Our method is applicable to both perturbative and non-perturbative regimes of couplings. The wave-packet creation circuit for the case of the $Z_2$ lattice gauge theory is built and implemented on the Quantinuum H1-1 trapped-ion quantum computer using 13 qubits and up to 308 entangling gates. The fidelities agree well with classical benchmark calculations after employing a simple symmetry-based noise-mitigation technique. This work serves as a step toward quantum computing scattering processes in quantum chromodynamics.


title: Tiny Titans: Can Smaller Large Language Models Punch Above Their Weight in the Real World for Meeting Summarization?

abstract: Large Language Models (LLMs) have demonstrated impressive capabilities to solve a wide range of tasks without being explicitly fine-tuned on task-specific datasets. However, deploying LLMs in the real world is not trivial, as it requires substantial computing resources. In this paper, we investigate whether smaller, compact LLMs are a good alternative to the comparatively Larger LLMs2 to address significant costs associated with utilizing LLMs in the real world. In this regard, we study the meeting summarization task in a real-world industrial environment and conduct extensive experiments by comparing the performance of fine-tuned compact LLMs (e.g., FLAN-T5, TinyLLaMA, LiteLLaMA) with zero-shot larger LLMs (e.g., LLaMA-2, GPT-3.5, PaLM-2). We observe that most smaller LLMs, even after fine-tuning, fail to outperform larger zero-shot LLMs in meeting summarization datasets. However, a notable exception is FLAN-T5 (780M parameters), which performs on par or even better than many zero-shot Larger LLMs (from 7B to above 70B parameters), while being significantly smaller. This makes compact LLMs like FLAN-T5 a suitable cost-efficient solution for real-world industrial deployment.


title: The relative Hodge-Tate spectral sequence for rigid analytic spaces

abstract: We construct a relative Hodge-Tate spectral sequence for any smooth proper morphism of rigid analytic spaces over a perfectoid field extension of $\mathbb Q_p$. To this end, we generalise Scholze's strategy in the absolute case by using smoothoid adic spaces. As our main additional ingredient, we prove a perfectoid version of Grothendieck's "cohomology and base-change". We also use this to prove local constancy of Hodge numbers in the rigid analytic setting, and deduce that the relative Hodge-Tate spectral sequence degenerates.


title: Helmholtz quasi-resonances are unstable under most single-signed perturbations of the wave speed

abstract: We consider Helmholtz problems with a perturbed wave speed, where the single-signed perturbation is governed by a parameter $z$. Both the wave speed and the perturbation are allowed to be discontinuous (modelling a penetrable obstacle). We show that, for any frequency, for most values of $z$, the solution operator is polynomially bounded in the frequency. This solution-operator bound is most interesting for Helmholtz problems with strong trapping; recall that here there exist a sequence of real frequencies, tending to infinity, through which the solution operator grows superalgebraically, with these frequencies often called $\textit{quasi-resonances}$. The result of this paper then shows that, at every quasi-resonance, the superalgebraic growth of the solution operator does not occur for most single-signed perturbations of the wave speed, i.e., quasi-resonances are unstable under most such perturbations.


title: Kinematic reconstruction of torsion as dark energy in Friedmann cosmology

abstract: In this paper we study the effects of torsion of space-time in the expansion of the universe as a candidate to dark energy. The analysis is done by reconstructing the torsion function along cosmic evolution by using observational data of Supernovae type Ia and Hubble parameter measurements. We have used a kinematic model for the parameterization of the comoving distance and the Hubble parameter, then the free parameters of the models are constrained by observational data. The reconstruction of the torsion function is obtained directly from the data, using the kinematic parameterizations, and the values for the Hubble parameter and the deceleration parameter are in good agreement to the standard model estimates.


title: When to Preempt in a Status Update System?

abstract: We consider a time-slotted status update system with an error-free preemptive queue. The goal of the sampler-scheduler pair is to minimize the age of information at the monitor by sampling and transmitting the freshly sampled update packets to the monitor. The sampler-scheduler pair also has a choice to preempt an old update packet from the server and transmit a new update packet to the server. We formulate this problem as a Markov decision process (MDP) and find the optimal sampling policy. We find a sufficient, and also separately a necessary, condition for the always preemption policy to be an optimal policy. We show that it is optimal for the sampler-scheduler pair to sample a new packet immediately upon the reception of an update packet at the monitor. We propose a double-threshold sampling policy which we show to be an optimal policy under some assumptions on the queue statistic.

categories: cs.IT cs.GT cs.NI cs.SY eess.SP eess.SY math.IT


title: Computing scattering resonances of rough obstacles

abstract: This paper is concerned with the numerical computation of scattering resonances of the Laplacian for Dirichlet obstacles with rough boundary. We prove that under mild geometric assumptions on the obstacle there exists an algorithm whose output is guaranteed to converge to the set of resonances of the problem. The result is formulated using the framework of Solvability Complexity Indices. The proof is constructive and provides an efficient numerical method. The algorithm is based on a combination of a Glazman decomposition, a polygonal approximation of the obstacle and a finite element method. Our result applies in particular to obstacles with fractal boundary, such as the Koch Snowflake and certain filled Julia sets. Finally, we provide numerical experiments in MATLAB for a range of interesting obstacle domains.


title: BootsTAP: Bootstrapped Training for Tracking-Any-Point

abstract: To endow models with greater understanding of physics and motion, it is useful to enable them to perceive how solid surfaces move and deform in real scenes. This can be formalized as Tracking-Any-Point (TAP), which requires the algorithm to track any point on solid surfaces in a video, potentially densely in space and time. Large-scale groundtruth training data for TAP is only available in simulation, which currently has a limited variety of objects and motion. In this work, we demonstrate how large-scale, unlabeled, uncurated real-world data can improve a TAP model with minimal architectural changes, using a selfsupervised student-teacher setup. We demonstrate state-of-the-art performance on the TAP-Vid benchmark surpassing previous results by a wide margin: for example, TAP-Vid-DAVIS performance improves from 61.3% to 67.4%, and TAP-Vid-Kinetics from 57.2% to 62.5%. For visualizations, see our project webpage at https://bootstap.github.io/


title: One-sided discretization inequalities and sampling recovery

abstract: Recently, in a number of papers it was understood that results on sampling discretization and on the universal sampling discretization can be successfully used in the problem of sampling recovery. Moreover, it turns out that it is sufficient to only have a one-sided discretization inequality for some of those applications. This motivates us to write the present paper as a survey/research paper with the focus on the one-sided discretization inequalities and their applications in the sampling recovery. In this sense the paper complements the two existing survey papers on sampling discretization.


title: Score-based Causal Representation Learning: Linear and General Transformations

abstract: This paper addresses intervention-based causal representation learning (CRL) under a general nonparametric latent causal model and an unknown transformation that maps the latent variables to the observed variables. Linear and general transformations are investigated. The paper addresses both the identifiability and achievability aspects. Identifiability refers to determining algorithm-agnostic conditions that ensure recovering the true latent causal variables and the latent causal graph underlying them. Achievability refers to the algorithmic aspects and addresses designing algorithms that achieve identifiability guarantees. By drawing novel connections between score functions (i.e., the gradients of the logarithm of density functions) and CRL, this paper designs a score-based class of algorithms that ensures both identifiability and achievability. First, the paper focuses on linear transformations and shows that one stochastic hard intervention per node suffices to guarantee identifiability. It also provides partial identifiability guarantees for soft interventions, including identifiability up to ancestors for general causal models and perfect latent graph recovery for sufficiently non-linear causal models. Secondly, it focuses on general transformations and shows that two stochastic hard interventions per node suffice for identifiability. Notably, one does not need to know which pair of interventional environments have the same node intervened.


title: Constant Degree Direct Product Testers with Small Soundness

abstract: Let $X$ be a $d$-dimensional simplicial complex. A function $F\colon X(k)\to \{0,1\}^k$ is said to be a direct product function if there exists a function $f\colon X(1)\to \{0,1\}$ such that $F(\sigma) = (f(\sigma_1), \ldots, f(\sigma_k))$ for each $k$-face $\sigma$. In an effort to simplify components of the PCP theorem, Goldreich and Safra introduced the problem of direct product testing, which asks whether one can test if $F\colon X(k)\to \{0,1\}^k$ is correlated with a direct product function by querying $F$ on only $2$ inputs. Dinur and Kaufman conjectured that there exist bounded degree complexes with a direct product test in the small soundness regime. We resolve their conjecture by showing that for all $\delta>0$, there exists a family of high-dimensional expanders with degree $O_{\delta}(1)$ and a $2$-query direct product tester with soundness $\delta$. We use the characterization given by a subset of the authors and independently by Dikstein and Dinur, who showed that some form of non-Abelian coboundary expansion (which they called "Unique-Games coboundary expansion") is a necessary and sufficient condition for a complex to admit such direct product testers. Our main technical contribution is a general technique for showing coboundary expansion of complexes with coefficients in a non-Abelian group. This allows us to prove that the high dimensional expanders constructed by Chapman and Lubotzky satisfies the necessary conditions, thus admitting a 2-query direct product tester with small soundness.


title: Data Augmentation Scheme for Raman Spectra with Highly Correlated Annotations

abstract: In biotechnology Raman Spectroscopy is rapidly gaining popularity as a process analytical technology (PAT) that measures cell densities, substrate- and product concentrations. As it records vibrational modes of molecules it provides that information non-invasively in a single spectrum. Typically, partial least squares (PLS) is the model of choice to infer information about variables of interest from the spectra. However, biological processes are known for their complexity where convolutional neural networks (CNN) present a powerful alternative. They can handle non-Gaussian noise and account for beam misalignment, pixel malfunctions or the presence of additional substances. However, they require a lot of data during model training, and they pick up non-linear dependencies in the process variables. In this work, we exploit the additive nature of spectra in order to generate additional data points from a given dataset that have statistically independent labels so that a network trained on such data exhibits low correlations between the model predictions. We show that training a CNN on these generated data points improves the performance on datasets where the annotations do not bear the same correlation as the dataset that was used for model training. This data augmentation technique enables us to reuse spectra as training data for new contexts that exhibit different correlations. The additional data allows for building a better and more robust model. This is of interest in scenarios where large amounts of historical data are available but are currently not used for model training. We demonstrate the capabilities of the proposed method using synthetic spectra of Ralstonia eutropha batch cultivations to monitor substrate, biomass and polyhydroxyalkanoate (PHA) biopolymer concentrations during of the experiments.


title: Two-stroke thermal machine using spin squeezing operation

abstract: Quantum thermal machines are powerful platforms to investigate how quantum effects impact the energy flow between different systems. We here investigate a two-stroke cycle in which spin squeezing effects are intrinsically switched on during all the operation time. By using the Kitagawa and Ueda's parameter and the l1-norm to compute the degree of spin squeezing and the quantum coherence, we firstly show that the more the spin squeezing effect the more the amount of coherence in the energy basis. Then we employ the characteristic function approach to investigate the engine performance in view of the amount of spin squeezing into the system. Our results show that even assuming an always-on spin squeezing, which is directly associated with the amount of entropy production in the cycle, it is possible to find a better set of efficiency and extracted power for the engine provided a high control over the relevant parameters, i.e., the operation time and the squeezing intensity.


title: LTAU-FF: Loss Trajectory Analysis for Uncertainty in Atomistic Force Fields

abstract: Model ensembles are effective tools for estimating prediction uncertainty in deep learning atomistic force fields. However, their widespread adoption is hindered by high computational costs and overconfident error estimates. In this work, we address these challenges by leveraging distributions of per-sample errors obtained during training and employing a distance-based similarity search in the model latent space. Our method, which we call LTAU, efficiently estimates the full probability distribution function (PDF) of errors for any test point using the logged training errors, achieving speeds that are 2--3 orders of magnitudes faster than typical ensemble methods and allowing it to be used for tasks where training or evaluating multiple models would be infeasible. We apply LTAU towards estimating parametric uncertainty in atomistic force fields (LTAU-FF), demonstrating that its improved ensemble diversity produces well-calibrated confidence intervals and predicts errors that correlate strongly with the true errors for data near the training domain. Furthermore, we show that the errors predicted by LTAU-FF can be used in practical applications for detecting out-of-domain data, tuning model performance, and predicting failure during simulations. We believe that LTAU will be a valuable tool for uncertainty quantification (UQ) in atomistic force fields and is a promising method that should be further explored in other domains of machine learning.


title: SymbolicAI: A framework for logic-based approaches combining generative models and solvers

abstract: We introduce SymbolicAI, a versatile and modular framework employing a logic-based approach to concept learning and flow management in generative processes. SymbolicAI enables the seamless integration of generative models with a diverse range of solvers by treating large language models (LLMs) as semantic parsers that execute tasks based on both natural and formal language instructions, thus bridging the gap between symbolic reasoning and generative AI. We leverage probabilistic programming principles to tackle complex tasks, and utilize differentiable and classical programming paradigms with their respective strengths. The framework introduces a set of polymorphic, compositional, and self-referential operations for multi-modal data that connects multi-step generative processes and aligns their outputs with user objectives in complex workflows. As a result, we can transition between the capabilities of various foundation models with in-context learning capabilities and specialized, fine-tuned models or solvers proficient in addressing specific problems. Through these operations based on in-context learning our framework enables the creation and evaluation of explainable computational graphs. Finally, we introduce a quality measure and its empirical score for evaluating these computational graphs, and propose a benchmark that compares various state-of-the-art LLMs across a set of complex workflows. We refer to the empirical score as the "Vector Embedding for Relational Trajectory Evaluation through Cross-similarity", or VERTEX score for short. The framework codebase and benchmark are linked below.


title: 'Egalitarian pooling and sharing of longevity risk', a.k.a. 'The many ways to skin a tontine cat'

abstract: There is little disagreement among insurance actuaries and financial economists about the societal benefits of longevity-risk pooling in the form of life annuities, defined benefit pensions, self-annuitization funds, and even tontine schemes. Indeed, the discounted value or cost of providing an income for life is lower -- in other words, the amount of upfront capital required to generate a similar income stream with the same level of statistical safety is lower -- when participants pool their financial resources versus going it alone. Moreover, when participants' financial circumstances and lifespans are homogenous, there is consensus on how to share the "winnings" among survivors, namely by distributing them equally among survivors, a.k.a. a uniform rule. Alas, what is lesser-known and much more problematic is allocating the winnings in such a pool when participants differ in wealth (contributions) and health (longevity), especially when the pools are relatively small in size. The same problems arise when viewed from the dual perspective of decentralized risk sharing (DRS). The positive correlation between health and income and the fact that wealthier participants are likely to live longer is a growing concern among pension and retirement policymakers. With that motivation in mind, this paper offers a modelling framework for distributing longevity-risk pools' income and benefits (or tontine winnings) when participants are heterogeneous. Similar to the nascent literature on decentralized risk sharing, there are several equally plausible arrangements for sharing benefits (a.k.a. "skinning the cat") among survivors. Moreover, the selected rule depends on the extent of social cohesion within the longevity risk pool, ranging from solidarity and altruism to pure individualism. In sum, actuarial science cannot really offer or guarantee uniqueness, only a methodology.


title: Towards Efficient Exact Optimization of Language Model Alignment

abstract: The alignment of language models with human preferences is vital for their application in real-world tasks. The problem is formulated as optimizing the model's policy to maximize the expected reward that reflects human preferences with minimal deviation from the initial policy. While considered as a straightforward solution, reinforcement learning (RL) suffers from high variance in policy updates, which impedes efficient policy improvement. Recently, direct preference optimization (DPO) was proposed to directly optimize the policy from preference data. However, we show that DPO derived based on the optimal solution of the problem leads to a compromised mean-seeking approximation of the optimal solution in practice. In this paper, we propose efficient exact optimization (EXO) of the alignment objective. EXO is guaranteed to optimize in the same direction as RL algorithms asymptotically for arbitrary policy parametrization. This leads to the same mode-seeking solution, while enables efficient optimization by circumventing the complexities of RL. We also compare our method to DPO with both theoretical and empirical analyses, and further demonstrate the advantages of our method over existing approaches on realistic human preference data. Code is available at https://github.com/haozheji/exact-optimization.


title: Early Time Classification with Accumulated Accuracy Gap Control

abstract: Early time classification algorithms aim to label a stream of features without processing the full input stream, while maintaining accuracy comparable to that achieved by applying the classifier to the entire input. In this paper, we introduce a statistical framework that can be applied to any sequential classifier, formulating a calibrated stopping rule. This data-driven rule attains finite-sample, distribution-free control of the accuracy gap between full and early-time classification. We start by presenting a novel method that builds on the Learn-then-Test calibration framework to control this gap marginally, on average over i.i.d. instances. As this algorithm tends to yield an excessively high accuracy gap for early halt times, our main contribution is the proposal of a framework that controls a stronger notion of error, where the accuracy gap is controlled conditionally on the accumulated halt times. Numerical experiments demonstrate the effectiveness, applicability, and usefulness of our method. We show that our proposed early stopping mechanism reduces up to 94% of timesteps used for classification while achieving rigorous accuracy gap control.


title: Can Large Language Models Understand Context?

abstract: Understanding context is key to understanding human language, an ability which Large Language Models (LLMs) have been increasingly seen to demonstrate to an impressive extent. However, though the evaluation of LLMs encompasses various domains within the realm of Natural Language Processing, limited attention has been paid to probing their linguistic capability of understanding contextual features. This paper introduces a context understanding benchmark by adapting existing datasets to suit the evaluation of generative models. This benchmark comprises of four distinct tasks and nine datasets, all featuring prompts designed to assess the models' ability to understand context. First, we evaluate the performance of LLMs under the in-context learning pretraining scenario. Experimental results indicate that pre-trained dense models struggle with understanding more nuanced contextual features when compared to state-of-the-art fine-tuned models. Second, as LLM compression holds growing significance in both research and real-world applications, we assess the context understanding of quantized models under in-context-learning settings. We find that 3-bit post-training quantization leads to varying degrees of performance reduction on our benchmark. We conduct an extensive analysis of these scenarios to substantiate our experimental results.


title: Deep Room Impulse Response Completion

abstract: Rendering immersive spatial audio in virtual reality (VR) and video games demands a fast and accurate generation of room impulse responses (RIRs) to recreate auditory environments plausibly. However, the conventional methods for simulating or measuring long RIRs are either computationally intensive or challenged by low signal-to-noise ratios. This study is propelled by the insight that direct sound and early reflections encapsulate sufficient information about room geometry and absorption characteristics. Building upon this premise, we propose a novel task termed "RIR completion," aimed at synthesizing the late reverberation given only the early portion (50 ms) of the response. To this end, we introduce DECOR, Deep Exponential Completion Of Room impulse responses, a deep neural network structured as an autoencoder designed to predict multi-exponential decay envelopes of filtered noise sequences. The interpretability of DECOR's output facilitates its integration with diverse rendering techniques. The proposed method is compared against an adapted state-of-the-art network, and comparable performance shows promising results supporting the feasibility of the RIR completion task. The RIR completion can be widely adapted to enhance RIR generation tasks where fast late reverberation approximation is required.


title: JWST-MIRI Spectroscopy of Warm Molecular Emission and Variability in the AS 209 Disk

abstract: We present MIRI MRS observations of the large, multi-gapped protoplanetary disk around the T-Tauri star AS 209. The observations reveal hundreds of water vapor lines from 4.9 to 25.5 $\mu$m towards the inner $\sim1$ au in the disk, including the first detection of ro-vibrational water emission in this disk. The spectrum is dominated by hot ($\sim800$ K) water vapor and OH gas, with only marginal detections of CO$_2$, HCN, and a possible colder water vapor component. Using slab models with a detailed treatment of opacities and line overlap, we retrieve the column density, emitting area, and excitation temperature of water vapor and OH, and provide upper limits for the observable mass of other molecules. Compared to MIRI spectra of other T-Tauri disks, the inner disk of AS 209 does not appear to be atypically depleted in CO$_2$ nor HCN. Based on \textit{Spitzer IRS} observations, we further find evidence for molecular emission variability over a 10-year baseline. Water, OH, and CO$_2$ line luminosities have decreased by factors 2-4 in the new MIRI epoch, yet there are minimal continuum emission variations. The origin of this variability is yet to be understood.


title: Evaluating Large Language Models for Generalization and Robustness via Data Compression

abstract: Existing methods for evaluating large language models face challenges such as data contamination, sensitivity to prompts, and the high cost of benchmark creation. To address this, we propose a lossless data compression based evaluation approach that tests how models' predictive abilities generalize after their training cutoff. Specifically, we collect comprehensive test data spanning 83 months from 2017 to 2023 and split the data into training and testing periods according to models' training data cutoff. We measure: 1) the compression performance on the testing period as a measure of generalization on unseen data; and 2) the performance gap between the training and testing period as a measure of robustness. Our experiments test 14 representative large language models with various sizes on sources including Wikipedia, news articles, code, arXiv papers, and multi-modal data. We find that the compression rate of many models reduces significantly after their cutoff date, but models such as Mistral and Llama-2 demonstrate a good balance between performance and robustness. Results also suggest that models struggle to generalize on news and code data, but work especially well on arXiv papers. We also find the context size and tokenization implementation have a big impact of on the overall compression performance.


title: Murphy's Law for Algebraic Stacks

abstract: We show that various natural algebro-geometric moduli stacks, including the stack of curves, have the property that every Deligne-Mumford gerbe over a field appears as the residual gerbe of one of their points. These gerbes are universal obstructions for objects of the stack to be defined over their fields of moduli, and for the corresponding coarse moduli space to be fine. Thus, our results show that many natural moduli stacks hold objects that are obstructed from being defined over their fields of moduli in every possible way, and have coarse spaces which fail to be fine moduli spaces in every possible way. A basic insight enabling our arguments is that many classical constructions in equivariant projective geometry generalize to the setting of relative geometry over an arbitrary Deligne-Mumford gerbe over a field.


title: Geometry Transfer for Stylizing Radiance Fields

abstract: Shape and geometric patterns are essential in defining stylistic identity. However, current 3D style transfer methods predominantly focus on transferring colors and textures, often overlooking geometric aspects. In this paper, we introduce Geometry Transfer, a novel method that leverages geometric deformation for 3D style transfer. This technique employs depth maps to extract a style guide, subsequently applied to stylize the geometry of radiance fields. Moreover, we propose new techniques that utilize geometric cues from the 3D scene, thereby enhancing aesthetic expressiveness and more accurately reflecting intended styles. Our extensive experiments show that Geometry Transfer enables a broader and more expressive range of stylizations, thereby significantly expanding the scope of 3D style transfer.


title: ViCA-NeRF: View-Consistency-Aware 3D Editing of Neural Radiance Fields

abstract: We introduce ViCA-NeRF, the first view-consistency-aware method for 3D editing with text instructions. In addition to the implicit neural radiance field (NeRF) modeling, our key insight is to exploit two sources of regularization that explicitly propagate the editing information across different views, thus ensuring multi-view consistency. For geometric regularization, we leverage the depth information derived from NeRF to establish image correspondences between different views. For learned regularization, we align the latent codes in the 2D diffusion model between edited and unedited images, enabling us to edit key views and propagate the update throughout the entire scene. Incorporating these two strategies, our ViCA-NeRF operates in two stages. In the initial stage, we blend edits from different views to create a preliminary 3D edit. This is followed by a second stage of NeRF training, dedicated to further refining the scene's appearance. Experimental results demonstrate that ViCA-NeRF provides more flexible, efficient (3 times faster) editing with higher levels of consistency and details, compared with the state of the art. Our code is publicly available.


title: Towards Optimal Feature-Shaping Methods for Out-of-Distribution Detection

abstract: Feature shaping refers to a family of methods that exhibit state-of-the-art performance for out-of-distribution (OOD) detection. These approaches manipulate the feature representation, typically from the penultimate layer of a pre-trained deep learning model, so as to better differentiate between in-distribution (ID) and OOD samples. However, existing feature-shaping methods usually employ rules manually designed for specific model architectures and OOD datasets, which consequently limit their generalization ability. To address this gap, we first formulate an abstract optimization framework for studying feature-shaping methods. We then propose a concrete reduction of the framework with a simple piecewise constant shaping function and show that existing feature-shaping methods approximate the optimal solution to the concrete optimization problem. Further, assuming that OOD data is inaccessible, we propose a formulation that yields a closed-form solution for the piecewise constant shaping function, utilizing solely the ID data. Through extensive experiments, we show that the feature-shaping function optimized by our method improves the generalization ability of OOD detection across a large variety of datasets and model architectures.


title: Energetic comparison of exciton gas versus electron-hole plasma in a bilayer two-dimensional electron-hole system

abstract: We study the zero-temperature phase diagram of a symmetric electron-hole bilayer system by comparing the ground state energies of two distinct limiting cases, characterized by an electron-hole plasma or an exciton gas, respectively. For the electron-hole plasma, the random phase approximation is used; for the exciton gas, we consider three different approximations: the unscreened Coulomb interaction, the statically screened one, and the dynamically screened one under the plasmon-pole approximation. Our results suggest that the exciton gas is stable at small layer separation. However, static screening in general suppresses the formation of excitons, and dynamic screening gives different results depending on the representative energy scale we used in the plasmon-pole approximation. We conclude that energetic considerations alone are very sensitive to the approximation schemes, and the phase diagram of the system may depend crucially on exactly how the electron-hole attraction is treated in the theory. For very small and very large densities, however, all our approximations show the exciton gas to have lower energy than the plasma.


title: AToM: Amortized Text-to-Mesh using 2D Diffusion

abstract: We introduce Amortized Text-to-Mesh (AToM), a feed-forward text-to-mesh framework optimized across multiple text prompts simultaneously. In contrast to existing text-to-3D methods that often entail time-consuming per-prompt optimization and commonly output representations other than polygonal meshes, AToM directly generates high-quality textured meshes in less than 1 second with around 10 times reduction in the training cost, and generalizes to unseen prompts. Our key idea is a novel triplane-based text-to-mesh architecture with a two-stage amortized optimization strategy that ensures stable training and enables scalability. Through extensive experiments on various prompt benchmarks, AToM significantly outperforms state-of-the-art amortized approaches with over 4 times higher accuracy (in DF415 dataset) and produces more distinguishable and higher-quality 3D outputs. AToM demonstrates strong generalizability, offering finegrained 3D assets for unseen interpolated prompts without further optimization during inference, unlike per-prompt solutions.


title: We're Not Using Videos Effectively: An Updated Domain Adaptive Video Segmentation Baseline

abstract: There has been abundant work in unsupervised domain adaptation for semantic segmentation (DAS) seeking to adapt a model trained on images from a labeled source domain to an unlabeled target domain. While the vast majority of prior work has studied this as a frame-level Image-DAS problem, a few Video-DAS works have sought to additionally leverage the temporal signal present in adjacent frames. However, Video-DAS works have historically studied a distinct set of benchmarks from Image-DAS, with minimal cross-benchmarking. In this work, we address this gap. Surprisingly, we find that (1) even after carefully controlling for data and model architecture, state-of-the-art Image-DAS methods (HRDA and HRDA+MIC) outperform Video-DAS methods on established Video-DAS benchmarks (+14.5 mIoU on Viper$\rightarrow$CityscapesSeq, +19.0 mIoU on Synthia$\rightarrow$CityscapesSeq), and (2) naive combinations of Image-DAS and Video-DAS techniques only lead to marginal improvements across datasets. To avoid siloed progress between Image-DAS and Video-DAS, we open-source our codebase with support for a comprehensive set of Video-DAS and Image-DAS methods on a common benchmark. Code available at https://github.com/SimarKareer/UnifiedVideoDA


title: Molecular Pairing in Twisted Bilayer Graphene Superconductivity

abstract: We propose a theory for how the weak phonon-mediated interaction ($J_{\rm A}\!=\!1\!\sim\!4$meV) wins over the prohibitive Coulomb repulsion ($U\!=\!30\!\sim\!60$meV) and leads to a superconductor in magic-angle twisted bilayer graphene (MATBG). We find the pairing mechanism akin to that in the A$_3$C$_{60}$ family of molecular superconductors: Each AA stacking region of MATBG resembles a C$_{60}$ molecule, in that optical phonons can dynamically lift the degeneracy of the moir\'e orbitals, in analogy to the dynamical Jahn-Teller effect. Such induced $J_{\rm A}$ has the form of an inter-valley anti-Hund's coupling and is less suppressed than $U$ by the Kondo screening near a Mott insulator. Additionally, we also considered an intra-orbital Hund's coupling $J_{\rm H}$ that originates from the on-site repulsion of a carbon atom. Under a reasonable approximation of the realistic model, we prove that the renormalized local interaction between quasi-particles must have a pairing (negative) channel in a doped correlated insulator at $\nu=\pm(2+\delta\nu)$, albeit the bare interaction is positive definite. The proof is non-perturbative and based on exact asymptotic behaviors of the vertex function imposed by Ward identities. Existence of an optimal $U$ for superconductivity is predicted. We also analyzed the pairing symmetry. In a large area of the parameter space of $J_{\rm A}$, $J_{\rm H}$, the ground state has a nematic $d$-wave singlet pairing, which, however, can lead to a $p$-wave-like nodal structure due to the Berry's phase on Fermi surfaces (or Euler obstruction).


title: Prioritising Interactive Flows in Data Center Networks With Central Control

abstract: Data centers are on the rise and scientists are re-thinking and re-designing networks for data centers. The concept of central control which was not effective in the Internet era is now gaining popularity and is used in many data centers due to lower scale of operation (compared to Internet), structured topologies and as the entire network resources is under a single entity's control. With new opportunities, data center networks also pose new problems. Data centers require: high utilization, low median, tail latencies and fairness. In the traditional systems, the bulk traffic generally stalls the interactive flows thereby affecting their flow completion times adversely. In this thesis, we deal with two problems relating to central controller assisted prioritization of interactive flow in data center networks. Fastpass is a centralized "zero-queue" data center network. But the central arbiter of Fastpass doesn't scale well for more than 256 nodes (or 8 cores). In our test runs, it supports only about 1.5 Terabits's of network traffic. In this work, we re-design their timeslot allocator of their central arbiter so that it scales linearly till 12 cores and supports about 1024 nodes and 7.1 Terabits's of network traffic. In the second part of the thesis, we deal with the problem of congestion control in a software defined network. We propose a framework, where the controller with its global view of the network actively participates in the congestion control decisions of the end TCP hosts, by setting the ECN bits of IPV4 packets appropriately. Our framework can be deployed very easily without any change to the end node TCPs or the SDN switches. We also show 30x improvement over TCP cubic and 1.7x improvement over RED in flow completion times of interactive traffic for one implementation of this framework.


title: Research on Resource Allocation under Unlicensed Spectrum Using Q-Learning

abstract: In response to the advent of the 5G era, enhancing throughput and increasing transmission efficiency within limited spectrum resources is an important research topic. In the LTE system, utilizing unlicensed spectrum to assist traditional mobile networks, known as License Assisted Access, has emerged as a viable solution to effectively improve transmission efficiency. However, as the unlicensed spectrum also accommodates other users, such as Wi-Fi for mobile communication, there is a need to address the issue of spectrum resource allocation, aiming to achieve fair transmission among different mobile communication users. This research project aims to explore and compare two approaches: traditional communication algorithms and reinforcement learning method Q-leaning, under the condition of achieving maximum system throughput, in order to determine the differences between the two methods.


title: Data On the Go: Seamless Data Routing for Intermittently-Powered Battery-Free Sensing

abstract: The rising demand for sustainable IoT has promoted the adoption of battery-free devices intermittently powered by ambient energy for sensing. However, the intermittency poses significant challenges in sensing data collection. Despite recent efforts to enable one-to-one communication, routing data across multiple intermittently-powered battery-free devices, a crucial requirement for a sensing system, remains a formidable challenge. This paper fills this gap by introducing Swift, which enables seamless data routing in intermittently-powered battery-free sensing systems. Swift overcomes the challenges posed by device intermittency and heterogeneous energy conditions through three major innovative designs. First, Swift incorporates a reliable node synchronization protocol backed by number theory, ensuring successful synchronization regardless of energy conditions. Second, Swift adopts a low-latency message forwarding protocol, allowing continuous message forwarding without repeated synchronization. Finally, Swift features a simple yet effective mechanism for routing path construction, enabling nodes to obtain the optimal path to the sink node with minimum hops. We implement Swift and perform large-scale experiments representing diverse realworld scenarios. The results demonstrate that Swift achieves an order of magnitude reduction in end-to-end message delivery time compared with the state-of-the-art approaches for intermittentlypowered battery-free sensing systems.


title: Non-Divergent Spinning Substructures Near Acoustic Field Nodes

abstract: In this work, we examine the extraordinary behavior of polarization and spin angular momentum (AM) density in the vicinity of longitudinal field zeros in three-dimensional monochromatic acoustic fields. We demonstrate that, as governed by the continuity equation, the velocity fields of arbitrary acoustic sources maintain non-diffractive elliptical polarization structures that enclose longitudinal field zeros, despite having divergent transverse spatial profiles of intensity. Furthermore, embedded in these nonparaxial field contours, for infinite distance, are threads of circular polarization singularities. We illuminate these inherent properties in acoustic vortex fields, dipole arrays, and the famous Young's double slit experiment. Our results reveal novel characteristics of vector sound waves that provide a platform for future studies and applications of structured acoustic waves and chiral acoustic phenomena.


title: dRG-MEC: Decentralized Reinforced Green Offloading for MEC-enabled Cloud Network

abstract: Multi-access-Mobile Edge Computing (MEC) is a promising solution for computationally demanding rigorous applications, that can meet 6G network service requirements. However, edge servers incur high computation costs during task processing. In this paper, we proposed a technique to minimize the total computation and communication overhead for optimal resource utilization with joint computational offloading that enables a green environment. Our optimization problem is NP-hard; thus, we proposed a decentralized Reinforcement Learning (dRL) approach where we eliminate the problem of dimensionality and over-estimation of the value functions. Compared to baseline schemes our technique achieves a 37.03% reduction in total system costs.


title: Minimum-Cost Sensor Channel Selection For Wearable Computing

abstract: Sensor systems are constrained by design and finding top sensor channel(s) for a given computational task is an important but hard problem. We define an optimization framework and mathematically formulate the minimum-cost channel selection problem. We then propose two novel algorithms of varying scope and complexity to solve the optimization problem. Branch and bound channel selection finds a globally optimal channel subset and the greedy channel selection finds the best intermediate subset based on the value of a score function. Proposed channel selection algorithms are conditioned with performance as well as the cost of the channel subset. We evaluate both algorithms on two publicly available time series datasets of human activity recognition and mental task detection. Branch and bound channel selection achieved a cost saving of up to 94.8% and the greedy search reduced the cost by 89.6% while maintaining performance thresholds.


title: Building Blocks to Empower Cognitive Internet with Hybrid Edge Cloud

abstract: As we transition from the mobile internet to the 'Cognitive Internet,' a significant shift occurs in how we engage with technology and intelligence. We contend that the Cognitive Internet goes beyond the Cognitive Internet of Things (Cognitive IoT), enabling connected objects to independently acquire knowledge and understanding. Unlike the Mobile Internet and Cognitive IoT, the Cognitive Internet integrates collaborative intelligence throughout the network, blending the cognitive IoT realm with system-wide collaboration and human intelligence. This integrated intelligence facilitates interactions between devices, services, entities, and individuals across diverse domains while preserving decision-making autonomy and accommodating various identities. The paper delves into the foundational elements, distinct characteristics, benefits, and industrial impact of the 'Cognitive Internet' paradigm. It highlights the importance of adaptable AI infrastructures and hybrid edge cloud (HEC) platforms in enabling this shift. This evolution brings forth cognitive services, a Knowledge as a Service (KaaS) economy, enhanced decision-making autonomy, sustainable digital progress, advancements in data management, processing techniques, and a stronger emphasis on privacy. In essence, this paper serves as a crucial resource for understanding and leveraging the transformative potential of HEC for Cognitive Internet. Supported by case studies, forward-looking perspectives, and real-world applications, it provides comprehensive insights into this emerging paradigm.


title: A Review on Recent Energy Harvesting Methods for Increasing Battery Efficiency in WBANs

abstract: Today, technology development has led humans to employ wearable and implantable devices for biomedical applications. An important research issue in this field is the wireless body area networks (WBANs), which focus on such devices. In WBAN, using batteries as the only energy supply is a significant challenge, especially in medical applications. Charging the batteries is a problem for patients who use WBAN. Replacing the battery is not very difficult for wearable devices, but implantable devices have different conditions. The use of batteries in implantable devices has many problems, including pain and costs due to surgery, mental stress, and lack of comfort. Batteries' life depends on their type, operation, the patient's medical condition, and other factors. This paper reviews recent energy harvesting methods for battery recharge in WBAN's sensors. Moreover, we provide future research directions on energy harvesting methods in WBANs. Therefore, active research fields such as reinforcement learning (RL) and distributed optimization in WBAN applications were investigated. We strongly believe that these insights will aid in studying and developing a new generation of rechargeable sensors in WBANs for fellow researchers.


title: Radio Map Estimation -- An Open Dataset with Directive Transmitter Antennas and Initial Experiments

abstract: Over the last years, several works have explored the application of deep learning algorithms to determine the large-scale signal fading (also referred to as ``path loss'') between transmitter and receiver pairs in urban communication networks. The central idea is to replace costly measurement campaigns, inaccurate statistical models or computationally expensive ray-tracing simulations by machine learning models which, once trained, produce accurate predictions almost instantly. Although the topic has attracted attention from many researchers, there are few open benchmark datasets and codebases that would allow everyone to test and compare the developed methods and algorithms. We take a step towards filling this gap by releasing a publicly available dataset of simulated path loss radio maps together with realistic city maps from real-world locations and aerial images from open datasources. Initial experiments regarding model architectures, input feature design and estimation of radio maps from aerial images are presented and the code is made available.


title: Graph Representation Learning for Contention and Interference Management in Wireless Networks

abstract: Restricted access window (RAW) in Wi-Fi 802.11ah networks manages contention and interference by grouping users and allocating periodic time slots for each group's transmissions. We will find the optimal user grouping decisions in RAW to maximize the network's worst-case user throughput. We review existing user grouping approaches and highlight their performance limitations in the above problem. We propose formulating user grouping as a graph construction problem where vertices represent users and edge weights indicate the contention and interference. This formulation leverages the graph's max cut to group users and optimizes edge weights to construct the optimal graph whose max cut yields the optimal grouping decisions. To achieve this optimal graph construction, we design an actor-critic graph representation learning (AC-GRL) algorithm. Specifically, the actor neural network (NN) is trained to estimate the optimal graph's edge weights using path losses between users and access points. A graph cut procedure uses semidefinite programming to solve the max cut efficiently and return the grouping decisions for the given weights. The critic NN approximates user throughput achieved by the above-returned decisions and is used to improve the actor. Additionally, we present an architecture that uses the online-measured throughput and path losses to fine-tune the decisions in response to changes in user populations and their locations. Simulations show that our methods achieve $30\%\sim80\%$ higher worst-case user throughput than the existing approaches and that the proposed architecture can further improve the worst-case user throughput by $5\%\sim30\%$ while ensuring timely updates of grouping decisions.


title: Supersymmetric smooth distributions of M2-branes as AdS solitons

abstract: We show that the singularities of certain distributions of M2-branes can be removed by adding a Wilson loop around a compact direction along the brane. The holographic coordinate naturally ends up before the singularity and the resulting spacetime provides an AdS soliton configuration, albeit possibly supersymmetric. We study the phase space diagram of these M2-branes distributions endowed with Wilson loops and show that different distributions are interconnected, providing a rich structure of phase transitions at zero temperature.


title: On the Interplay of Artificial Intelligence and Space-Air-Ground Integrated Networks: A Survey

abstract: Space-Air-Ground Integrated Networks (SAGINs), which incorporate space and aerial networks with terrestrial wireless systems, are vital enablers of the emerging sixth-generation (6G) wireless networks. Besides bringing significant benefits to various applications and services, SAGINs are envisioned to extend high-speed broadband coverage to remote areas, such as small towns or mining sites, or areas where terrestrial infrastructure cannot reach, such as airplanes or maritime use cases. However, due to the limited power and storage resources, as well as other constraints introduced by the design of terrestrial networks, SAGINs must be intelligently configured and controlled to satisfy the envisioned requirements. Meanwhile, Artificial Intelligence (AI) is another critical enabler of 6G. Due to massive amounts of available data, AI has been leveraged to address pressing challenges of current and future wireless networks. By adding AI and facilitating the decision-making and prediction procedures, SAGINs can effectively adapt to their surrounding environment, thus enhancing the performance of various metrics. In this work, we aim to investigate the interplay of AI and SAGINs by providing a holistic overview of state-of-the-art research in AI-enabled SAGINs. Specifically, we present a comprehensive overview of some potential applications of AI in SAGINs. We also cover open issues in employing AI and detail the contributions of SAGINs in the development of AI. Finally, we highlight some limitations of the existing research works and outline potential future research directions.


title: Study of a general growth model

abstract: We discuss a general growth curve including several parameters, whose choice leads to a variety of models including the classical cases of Malthusian, Richards, Gompertz, Logistic and some their generalizations. The advantage is to obtain a single mathematically tractable equation from which the main characteristics of the considered curves can be deduced. We focus on the effects of the involved parameters through both analytical results and computational evaluations.


title: The dynamical bulk boundary correspondence and dynamical quantum phase transitions in the Benalcazar-Bernevig-Hughes model

abstract: In this article we demonstrate that dynamical quantum phase transitions occur for an exemplary higher order topological insulator, the Benalcazar-Bernevig-Hughes model, following quenches across a topological phase boundary. A dynamical bulk boundary correspondence is also seen both in the eigenvalues of the Loschmidt overlap matrix and the boundary return rate. The latter is found from a finite size scaling analysis for which the relative simplicity of the model is crucial. Contrary to the usual two dimensional case the dynamical quantum phase transitions in this model show up as cusps in the return rate, as for a one dimensional model, rather than as cusps in its derivative as would be typical for a two dimensional model. We explain the origin of this behaviour.


title: Correlated phases and topological phase transition in twisted bilayer graphene at one quantum of magnetic flux

abstract: When the perpendicular magnetic flux per unit cell in a crystal is equal to the quantum of magnetic flux, $\Phi_0=h/e$, we enter the 'Hofstadter regime'. The large unit cell of moir\'e materials like magic-angle twisted bilayer graphene (MATBG) allows the experimental study of this regime at feasible values of the field around $20$ to $30$ T. In this work, we report numerical analysis of a tight-binding model for MATBG at one quantum of external magnetic flux, including the long-range Coulomb and on-site Hubbard interaction. We study the correlated states for dopings of $-2,0$ and $2$ electrons per unit cell at the mean-field level. We find competing insulators with Chern numbers $2$ and $0$ at positive doping, the stability of which is determined by the dielectric screening, which opens up the possibility of observing a topological phase transition in this system.


title: TopologicalNumbers.jl: A Julia package for topological number computation

abstract: Topological insulators have been of considerable interest in the last decades. These materials show new states of matter that are insulating in the bulk but have conducting states on their surfaces. The conducting states on the surface are protected by the topology of the bulk band structure, and topological numbers, such as first Chern number, second Chern number, $\mathbb{Z}_2$ number, etc., are used to characterize them. As a typical example, the quantum Hall effect has the quantized Hall conductivity, which can be calculated by the first Chern number. Other topological numbers similarly become important physical quantities that characterize the system, depending on the system dimension and symmetry classes. To obtain the topological numbers, we often need numerical calculations, and it may require an enormous amount of computation before convergence is achieved. Therefore, creating tools to easily compute these numbers will lead to advances in research for the topological phase of matters. So far, several methods have been reported that suggest that some topological numbers can be computed efficiently. However, since each method is specialized for a specific dimension or symmetry class, it is necessary to implement the algorithm for each problem, respectively. Our project, TopologicalNumbers.jl, aims to provide a package that can easily and efficiently compute topological numbers comprehensively in various dimensions and symmetry classes.


title: Time-Dependent Dielectric Breakdown on Subnanometer EOT nMOS FinFETs

abstract: In this paper, the time-dependent dielectric breakdown (TDDB) in sub-1-nm equivalent oxide thickness (EOT) n-type bulk FinFETs is studied. The gate stacks consist of an IMEC clean interfacial layer, atomic layer deposition HfO2 high-k and TiN metal electrode. For the 0.8-nm EOT FinFETs, it is found that TDDB lifetime is consistent with results of planar devices for areas around 1e-8 cm2, implying that the FinFET architecture does not seem to introduce new failure mechanisms. However, for devices with smaller area, the extrapolated voltage at a ten-year lifetime for soft breakdown (SBD) does not meet the specifications, and as a consequence, the SBD path wear-out will have to be included in the final extrapolation. Furthermore, it is shown that for EOTs smaller than 0.8 nm, the TDDB reliability on n-type FinFETs is challenged by the high leakage currents.


title: Gadolinium scandate by high-pressure sputtering for future generations of high-k dielectrics

abstract: Gd-rich gadolinium scandate (Gd2-xScxO3) was deposited by high-pressure sputtering on (100) silicon by alternating the deposition of lower than 0.5 nm thick films of its binary components: Sc2O3 and Gd2O3. The formation of the ternary oxide was observed after the thermal treatments, with a high increase in the effective permittivity of the dielectric (up to 21). The silicon diffuses into the Gd2-xScxO3 films, which show an amorphous character. After the annealing no interfacial silicon oxide is present. CHF-VG curves indicated low hysteresis (55 mV) and a density of interfacial defects of 6e11 eV-1 cm-2.


title: Security and Privacy Challenges of Large Language Models: A Survey

abstract: Large Language Models (LLMs) have demonstrated extraordinary capabilities and contributed to multiple fields, such as generating and summarizing text, language translation, and question-answering. Nowadays, LLM is becoming a very popular tool in computerized language processing tasks, with the capability to analyze complicated linguistic patterns and provide relevant and appropriate responses depending on the context. While offering significant advantages, these models are also vulnerable to security and privacy attacks, such as jailbreaking attacks, data poisoning attacks, and Personally Identifiable Information (PII) leakage attacks. This survey provides a thorough review of the security and privacy challenges of LLMs for both training data and users, along with the application-based risks in various domains, such as transportation, education, and healthcare. We assess the extent of LLM vulnerabilities, investigate emerging security and privacy attacks for LLMs, and review the potential defense mechanisms. Additionally, the survey outlines existing research gaps in this domain and highlights future research directions.


title: Electrical characterization of gadolinium oxide deposited by high pressure sputtering with in situ plasma oxidation

abstract: In this work, we characterized gadolinium oxide films deposited on silicon by high pressure sputtering with a two-step process: first, we sputtered metallic gadolinium in an argon atmosphere and then, we performed an in-situ plasma oxidation of the metallic layer previously deposited. By means of high resolution transmission electron microscopy, we can detect the oxidation degree of the metallic film. Under optimized deposition conditions, fully oxidized Gd2O3 films are obtained. In addition, the capacitance and conductance as a function of gate voltage of Pt gated metal-insulator-semiconductor capacitors confirm stable dielectric behavior of the fully oxidized films. The devices show low gate leakage currents (1e5 A/cm2 at 1 V for 2.2 nm of equivalent oxide thickness), low interface trap density and an almost negligible hysteresis and frequency dispersion.


title: Utilizing Large Language Models to Translate RFC Protocol Specifications to CPSA Definitions

abstract: This paper proposes the use of Large Language Models (LLMs) for translating Request for Comments (RFC) protocol specifications into a format compatible with the Cryptographic Protocol Shapes Analyzer (CPSA). This novel approach aims to reduce the complexities and efforts involved in protocol analysis, by offering an automated method for translating protocol specifications into structured models suitable for CPSA. In this paper we discuss the implementation of an RFC Protocol Translator, its impact on enhancing the accessibility of formal methods analysis, and its potential for improving the security of internet protocols.


title: Large Language Models in Cybersecurity: State-of-the-Art

abstract: The rise of Large Language Models (LLMs) has revolutionized our comprehension of intelligence bringing us closer to Artificial Intelligence. Since their introduction, researchers have actively explored the applications of LLMs across diverse fields, significantly elevating capabilities. Cybersecurity, traditionally resistant to data-driven solutions and slow to embrace machine learning, stands out as a domain. This study examines the existing literature, providing a thorough characterization of both defensive and adversarial applications of LLMs within the realm of cybersecurity. Our review not only surveys and categorizes the current landscape but also identifies critical research gaps. By evaluating both offensive and defensive applications, we aim to provide a holistic understanding of the potential risks and opportunities associated with LLM-driven cybersecurity.


title: EVA-GAN: Enhanced Various Audio Generation via Scalable Generative Adversarial Networks

abstract: The advent of Large Models marks a new era in machine learning, significantly outperforming smaller models by leveraging vast datasets to capture and synthesize complex patterns. Despite these advancements, the exploration into scaling, especially in the audio generation domain, remains limited, with previous efforts didn't extend into the high-fidelity (HiFi) 44.1kHz domain and suffering from both spectral discontinuities and blurriness in the high-frequency domain, alongside a lack of robustness against out-of-domain data. These limitations restrict the applicability of models to diverse use cases, including music and singing generation. Our work introduces Enhanced Various Audio Generation via Scalable Generative Adversarial Networks (EVA-GAN), yields significant improvements over previous state-of-the-art in spectral and high-frequency reconstruction and robustness in out-of-domain data performance, enabling the generation of HiFi audios by employing an extensive dataset of 36,000 hours of 44.1kHz audio, a context-aware module, a Human-In-The-Loop artifact measurement toolkit, and expands the model to approximately 200 million parameters. Demonstrations of our work are available at https://double-blind-eva-gan.cc.


title: MoDE: A Mixture-of-Experts Model with Mutual Distillation among the Experts

abstract: The application of mixture-of-experts (MoE) is gaining popularity due to its ability to improve model's performance. In an MoE structure, the gate layer plays a significant role in distinguishing and routing input features to different experts. This enables each expert to specialize in processing their corresponding sub-tasks. However, the gate's routing mechanism also gives rise to narrow vision: the individual MoE's expert fails to use more samples in learning the allocated sub-task, which in turn limits the MoE to further improve its generalization ability. To effectively address this, we propose a method called Mixture-of-Distilled-Expert (MoDE), which applies moderate mutual distillation among experts to enable each expert to pick up more features learned by other experts and gain more accurate perceptions on their original allocated sub-tasks. We conduct plenty experiments including tabular, NLP and CV datasets, which shows MoDE's effectiveness, universality and robustness. Furthermore, we develop a parallel study through innovatively constructing "expert probing", to experimentally prove why MoDE works: moderate distilling knowledge can improve each individual expert's test performances on their assigned tasks, leading to MoE's overall performance improvement.


title: Photovoltaic properties evaluated by its thermodynamic evolution in a double quantum dot photocell

abstract: Obtaining the physical mechanism of photoelectric transfer in quantum-dot (QD) photocells may be one strategy to boost the photovoltaic conversion efficiency. In this work, we attempted to formulate a novel theoretical approach to evaluate photocells' performance via evaluating their thermodynamic evolution during the photoelectric conversion process in a double quantum dot (DQD) photocell model. Results demonstrate that the thermodynamic-related quantities can reflect the law of photovoltaic dynamics, i.e., the photoelectric transfer properties can be evaluated by the heat currents indirectly. The merit of this work not only expands our understanding of the physical law of heat currents in the photoelectric transport process, but it may also propose a new method for optimizing photoelectric conversion efficiency in a DQD photocell.


title: Photoexcited carriers transfer properties in a doped double quantum dots photocell

abstract: Identifying the behavior of photoexcited carriers is one method for empirically boosting their transfer efficiencies in doped double quantum dots (DQDs) photocells. The photoexcited carriers transfer qualities were assessed in this study by the output current, power, and output efficiency in the multi-photon absorption process for a doped DQDs photocell, and an optimization technique is theoretically obtained for this proposed photocell model. The results show that some structure parameters caused by doping, such as gaps, incoherent tunneling coupling, and symmetry of structure between two vertically aligned QDs, can remarkably control the photoexcited carriers transfer properties, and that slightly increasing the ambient temperature around room temperature is beneficial to the transfer performance in this doping DQDs photocell model. Thus, our scheme proves a way to optimized strategies for DQDs photocell.


title: Privacy and Security Implications of Cloud-Based AI Services : A Survey

abstract: This paper details the privacy and security landscape in today's cloud ecosystem and identifies that there is a gap in addressing the risks introduced by machine learning models. As machine learning algorithms continue to evolve and find applications across diverse domains, the need to categorize and quantify privacy and security risks becomes increasingly critical. With the emerging trend of AI-as-a-Service (AIaaS), machine learned AI models (or ML models) are deployed on the cloud by model providers and used by model consumers. We first survey the AIaaS landscape to document the various kinds of liabilities that ML models, especially Deep Neural Networks pose and then introduce a taxonomy to bridge this gap by holistically examining the risks that creators and consumers of ML models are exposed to and their known defences till date. Such a structured approach will be beneficial for ML model providers to create robust solutions. Likewise, ML model consumers will find it valuable to evaluate such solutions and understand the implications of their engagement with such services. The proposed taxonomies provide a foundational basis for solutions in private, secure and robust ML, paving the way for more transparent and resilient AI systems.


title: Screening method for early dementia using sound objects as voice biomarkers

abstract: Introduction: We present a screening method for early dementia using features based on sound objects as voice biomarkers. Methods: The final dataset used for machine learning models consisted of 266 observations, with a distribution of 186 healthy individuals, 46 diagnosed with Alzheimer's, and 34 with MCI. This method is based on six-second recordings of the sustained vowel /a/ spoken by the subject. The main original contribution of this work is the use of carefully crafted features based on sound objects. This approach allows one to first represent the sound spectrum in a more accurate way than the standard spectrum, and then build interpretable features containing relevant information about subjects' control over their voice. Results: ROC AUC obtained in this work for distinguishing healthy subjects from those with MCI was 0.85, while accuracy was 0.76. For distinguishing between healthy subjects and those with either MCI or Alzheimer's the results were 0.84, 0.77, respectively. Conclusion: The use of features based on sound objects enables screening for early dementia even on very short recordings of language-independent voice samples.


title: An Early Categorization of Prompt Injection Attacks on Large Language Models

abstract: Large language models and AI chatbots have been at the forefront of democratizing artificial intelligence. However, the releases of ChatGPT and other similar tools have been followed by growing concerns regarding the difficulty of controlling large language models and their outputs. Currently, we are witnessing a cat-and-mouse game where users attempt to misuse the models with a novel attack called prompt injections. In contrast, the developers attempt to discover the vulnerabilities and block the attacks simultaneously. In this paper, we provide an overview of these emergent threats and present a categorization of prompt injections, which can guide future research on prompt injections and act as a checklist of vulnerabilities in the development of LLM interfaces. Moreover, based on previous literature and our own empirical research, we discuss the implications of prompt injections to LLM end users, developers, and researchers.


title: Weakly Supervised Learners for Correction of AI Errors with Provable Performance Guarantees

abstract: We present a new methodology for handling AI errors by introducing weakly supervised AI error correctors with a priori performance guarantees. These AI correctors are auxiliary maps whose role is to moderate the decisions of some previously constructed underlying classifier by either approving or rejecting its decisions. The rejection of a decision can be used as a signal to suggest abstaining from making a decision. A key technical focus of the work is in providing performance guarantees for these new AI correctors through bounds on the probabilities of incorrect decisions. These bounds are distribution agnostic and do not rely on assumptions on the data dimension. Our empirical example illustrates how the framework can be applied to improve the performance of an image classifier in a challenging real-world task where training data are scarce.


title: Test of the formal basis of Arrhenius law with heat capacities

abstract: The exponential factor of Arrhenius satisfactorily quantifies the energetic restriction of chemical reactions but is still awaiting a rigorous basis. Assuming that the Arrhenius equation should be based on statistical mechanics and is probabilistic in nature, two structures for this equation are compared, depending on whether the reactant energies are viewed as the mean values of specific energy distributions or as particular levels in a global energy distribution. In the first version, the Arrhenius exponential factor would be a probability that depends once on temperature, while in the second it is a ratio of probabilities that depends twice on temperature. These concurrent equations are tested using experimental data for the isomerization of 2-butene. This comparison reveals the fundamental structure of the Arrhenius law in isothermal systems and overlooked properties resulting from the introduction of reactant energies into the equation.


title: Real Sparks of Artificial Intelligence and the Importance of Inner Interpretability

abstract: The present paper looks at one of the most thorough articles on the intelligence of GPT, research conducted by engineers at Microsoft. Although there is a great deal of value in their work, I will argue that, for familiar philosophical reasons, their methodology, !Blackbox Interpretability"#is wrongheaded. But there is a better way. There is an exciting and emerging discipline of !Inner Interpretability"#(and specifically Mechanistic Interpretability) that aims to uncover the internal activations and weights of models in order to understand what they represent and the algorithms they implement. In my view, a crucial mistake in Black-box Interpretability is the failure to appreciate that how processes are carried out matters when it comes to intelligence and understanding. I can#t pretend to have a full story that provides both necessary and sufficient conditions for being intelligent, but I do think that Inner Interpretability dovetails nicely with plausible philosophical views of what intelligence requires. So the conclusion is modest, but the important point in my view is seeing how to get the research on the right track. Towards the end of the paper, I will show how some of the philosophical concepts can be used to further refine how Inner Interpretability is approached, so the paper helps draw out a profitable, future two-way exchange between Philosophers and Computer Scientists.


title: GAMPix: a novel fine-grained, low-noise and ultra-low power pixelated charge readout for TPCs

abstract: We report on the development of a novel pixel charge readout system, Grid Activated Multi-scale pixel readout (GAMPix), which is under development for use in the GammaTPC gamma ray instrument concept. GammaTPC is being developed to optimize the use of liquid argon time projection chamber technology for gamma ray astrophysics, for which a fine grained low power charge readout is essential. GAMPix uses a new architecture with coarse and fine scale instrumented electrodes to solve the twin problems of loss of measured charge after diffusion, and high readout power. Fundamentally, it enables low noise and ultra low power charge readout at the spatial scale limited by diffusion in a time projection chamber, and has other possibly applications, including future DUNE modules.


title: Enhancement of Chiral-Induced Spin Selectivity via Circularly Polarized Light

abstract: The notion of chiral-induced spin selectivity (CISS) has attracted intensive research interest recently. However, the practical applications of the CISS effects face challenges due to relatively low spin polarization. In this Letter, we propose a non-perturbative theory illustrating how circularly polarized (CP) light enhances CISS effects through strong light-matter interactions. We introduce a Floquet electronic friction model to study the nonadiabatic dynamics and spin transport through a chiral molecule in a molecule junction subjected to external driving. Our results show that the interplay of the nonadiabatic effects and light-matter interactions can significantly ($>90\%$) enhance electron spin polarization under CP light. Our predictions can be very useful in experiments for using CP light to control spin current in chiral molecular junctions.

categories: cond-mat.mes-hall physics.chem-ph physics.optics quant-ph


title: Graph Domain Adaptation: Challenges, Progress and Prospects

abstract: As graph representation learning often suffers from label scarcity problems in real-world applications, researchers have proposed graph domain adaptation (GDA) as an effective knowledge-transfer paradigm across graphs. In particular, to enhance model performance on target graphs with specific tasks, GDA introduces a bunch of task-related graphs as source graphs and adapts the knowledge learnt from source graphs to the target graphs. Since GDA combines the advantages of graph representation learning and domain adaptation, it has become a promising direction of transfer learning on graphs and has attracted an increasing amount of research interest in recent years. In this paper, we comprehensively overview the studies of GDA and present a detailed survey of recent advances. Specifically, we outline the research status and challenges, propose a taxonomy, introduce the details of representative works, and discuss the prospects. To the best of our knowledge, this paper is the first survey for graph domain adaptation. A detailed paper list is available at https://github.com/Skyorca/Awesome-Graph-Domain-Adaptation-Papers.


title: Fine-Tuning and Prompt Engineering for Large Language Models-based Code Review Automation

abstract: Context: The rapid evolution of Large Language Models (LLMs) has sparked significant interest in leveraging their capabilities for automating code review processes. Prior studies often focus on developing LLMs for code review automation, yet require expensive resources, which is infeasible for organizations with limited budgets and resources. Thus, fine-tuning and prompt engineering are the two common approaches to leveraging LLMs for code review automation. Objective: We aim to investigate the performance of LLMs-based code review automation based on two contexts, i.e., when LLMs are leveraged by fine-tuning and prompting. Fine-tuning involves training the model on a specific code review dataset, while prompting involves providing explicit instructions to guide the model's generation process without requiring a specific code review dataset. Method: We leverage model fine-tuning and inference techniques (i.e., zero-shot learning, few-shot learning and persona) on LLMs-based code review automation. In total, we investigate 12 variations of two LLMs-based code review automation (i.e., GPT- 3.5 and Magicoder), and compare them with the Guo et al.'s approach and three existing code review automation approaches. Results: The fine-tuning of GPT 3.5 with zero-shot learning helps GPT-3.5 to achieve 73.17% -74.23% higher EM than the Guo et al.'s approach. In addition, when GPT-3.5 is not fine-tuned, GPT-3.5 with few-shot learning achieves 46.38% - 659.09% higher EM than GPT-3.5 with zero-shot learning. Conclusions: Based on our results, we recommend that (1) LLMs for code review automation should be fine-tuned to achieve the highest performance; and (2) when data is not sufficient for model fine-tuning (e.g., a cold-start problem), few-shot learning without a persona should be used for LLMs for code review automation.


title: BrainLeaks: On the Privacy-Preserving Properties of Neuromorphic Architectures against Model Inversion Attacks

abstract: With the mainstream integration of machine learning into security-sensitive domains such as healthcare and finance, concerns about data privacy have intensified. Conventional artificial neural networks (ANNs) have been found vulnerable to several attacks that can leak sensitive data. Particularly, model inversion (MI) attacks enable the reconstruction of data samples that have been used to train the model. Neuromorphic architectures have emerged as a paradigm shift in neural computing, enabling asynchronous and energy-efficient computation. However, little to no existing work has investigated the privacy of neuromorphic architectures against model inversion. Our study is motivated by the intuition that the non-differentiable aspect of spiking neural networks (SNNs) might result in inherent privacy-preserving properties, especially against gradient-based attacks. To investigate this hypothesis, we propose a thorough exploration of SNNs' privacy-preserving capabilities. Specifically, we develop novel inversion attack strategies that are comprehensively designed to target SNNs, offering a comparative analysis with their conventional ANN counterparts. Our experiments, conducted on diverse event-based and static datasets, demonstrate the effectiveness of the proposed attack strategies and therefore questions the assumption of inherent privacy-preserving in neuromorphic architectures.


title: AlphaRank: An Artificial Intelligence Approach for Ranking and Selection Problems

abstract: We introduce AlphaRank, an artificial intelligence approach to address the fixed-budget ranking and selection (R&S) problems. We formulate the sequential sampling decision as a Markov decision process and propose a Monte Carlo simulation-based rollout policy that utilizes classic R&S procedures as base policies for efficiently learning the value function of stochastic dynamic programming. We accelerate online sample-allocation by using deep reinforcement learning to pre-train a neural network model offline based on a given prior. We also propose a parallelizable computing framework for large-scale problems, effectively combining "divide and conquer" and "recursion" for enhanced scalability and efficiency. Numerical experiments demonstrate that the performance of AlphaRank is significantly improved over the base policies, which could be attributed to AlphaRank's superior capability on the trade-off among mean, variance, and induced correlation overlooked by many existing policies.