title: Interaction between U-shaped amyloid beta fibril and semiconducting silicon nitride monolayer

abstract: Motivated by some recent works showing the ability of semiconducting monolayers to disintegrate the structures of biological fibrils, we have applied molecular dynamics (MD) simulations in both classical and quantum regimes to investigate whether semiconducting Si$_3$N$_4$ monolayer has the same ability on interaction with U-shaped amyloid beta (A$\beta$) fibril. A number of conventional MD indicators have then been calculated including root mean square deviation, gyration radius, per-residue root mean square fluctuation, number of hydrogen bonds, solvent-accessible surface area, and secondary structure of the fibril as functions of time. Results showed that the monolayer is capable of affecting fibril's conformation. We also found that disintegration begins from the last chain (chain E) due to the rather strong interaction between the monolayer and the fibril residues numbered from 17 to 28 on the very chain, also engaging the next chain (chain D) as the time goes by. The $\beta$-sheet-rich content of chain E accordingly turns into other secondary-structure types including "turn", "coil", and "isolated bridge", decreasing the $\beta$-sheet content of the entire fibril as well. Results support the view that Si$_3$N$_4$ monolayer has a potential for destabilizing the structure of U-shaped amyloid beta fibrils.


title: Semantic Extraction Model Selection for IoT Devices in Edge-assisted Semantic Communications

abstract: Semantic communications offer the potential to alleviate communication loads by exchanging meaningful information. However, semantic extraction (SE) is computationally intensive, posing challenges for resource-constrained Internet of Things (IoT) devices. To address this, leveraging computing resources at the edge servers (ESs) is essential. ESs can support multiple SE models for various tasks, making it crucial to select appropriate SE models based on diverse requirements of IoT devices and limited ES computing resources. In this letter, we study an SE model selection problem, where the ES co-located at the access point can provide multiple SE models to execute the uploaded SE tasks of associated IoT devices. We aim to maximize the total semantic rate of all SE tasks by selecting appropriate SE models, while considering SE delay and ES capacity constraints, and SE accuracy requirements. The formulated NP-complete integer programming problem is transformed into a modified Knapsack problem. The proposed efficient approximation algorithm using dynamic programming can yield a guaranteed near-optimum solution. Simulation results demonstrate the superior performance of proposed solution.


title: MATADOR: Automated System-on-Chip Tsetlin Machine Design Generation for Edge Applications

abstract: System-on-Chip Field-Programmable Gate Arrays (SoC-FPGAs) offer significant throughput gains for machine learning (ML) edge inference applications via the design of co-processor accelerator systems. However, the design effort for training and translating ML models into SoC-FPGA solutions can be substantial and requires specialist knowledge aware trade-offs between model performance, power consumption, latency and resource utilization. Contrary to other ML algorithms, Tsetlin Machine (TM) performs classification by forming logic proposition between boolean actions from the Tsetlin Automata (the learning elements) and boolean input features. A trained TM model, usually, exhibits high sparsity and considerable overlapping of these logic propositions both within and among the classes. The model, thus, can be translated to RTL-level design using a miniscule number of AND and NOT gates. This paper presents MATADOR, an automated boolean-to-silicon tool with GUI interface capable of implementing optimized accelerator design of the TM model onto SoC-FPGA for inference at the edge. It offers automation of the full development pipeline: model training, system level design generation, design verification and deployment. It makes use of the logic sharing that ensues from propositional overlap and creates a compact design by effectively utilizing the TM model's sparsity. MATADOR accelerator designs are shown to be up to 13.4x faster, up to 7x more resource frugal and up to 2x more power efficient when compared to the state-of-the-art Quantized and Binary Deep Neural Network implementations.


title: A solution of the problem of standard compact Clifford-Klein forms

abstract: We solve the long standing problem of classification of standard compact Clifford-Klein forms of homogeneous spaces of simple non-compact real Lie groups. The result is that standard compact Clifford-Klein forms always arise from triples $(\mathfrak{g},\mathfrak{h},\mathfrak{l})$ of real Lie algebras such that $\mathfrak{h}\subset\mathfrak{g},\mathfrak{l}\subset\mathfrak{g}$, $\mathfrak{g}$ is simple and absolutely simple, $\mathfrak{h},\mathfrak{l}$ are (non-compact) reductive, $\mathfrak{g}=\mathfrak{h}+\mathfrak{l}$, and the intersection $\mathfrak{h}\cap\mathfrak{l}$ is compact. The consequence of this is the following characterization of proper co-compact actions of reductive Lie subgroups $L\subset G$ on a homogeneous spaces $G/H$ determined by absolutely simple real Lie group $G$ and a closed reductive subgroup $H$: $L$ acts on $G/H$ properly and co-compactly if and only if $G=H\cdot L$ and $H\cap L$ is compact


title: A Hybrid Delay Model for Interconnected Multi-Input Gates

abstract: Dynamic digital timing analysis aims at substituting highly accurate but slow analog simulations of digital circuits with less accurate but fast digital approaches to facilitate tracing timing relations between individual transitions in a signal trace. This primarily requires gate delay models, where the input-to-output delay of a transition also depends on the signal history. We focus on a recently proposed hybrid delay model for CMOS multi-input gates, exemplified by a 2-input \NOR\ gate, which is the only delay model known to us that faithfully captures both single-input switching (SIS) and multi-input switching (MIS) effects, also known as ``Charlie effects''. Despite its simplicity as a first-order model, simulations have revealed that suitably parametrized versions of the model predict the actual delays of NOR gates accurately. However, the approach considers isolated gates without their interconnect. In this work, we augment the existing model and its theoretical analysis by a first-order interconnect, and conduct a systematic evaluation of the resulting modeling accuracy: Using SPICE simulations, we study both SIS and MIS effects on the overall delay of \NOR\ gates under variation of input driving strength, wire length, load capacitance and CMOS technology, and compare it to the predictions of appropriately parametrized versions of our model. Overall, our results reveal a surprisingly good accuracy of our fast delay model.


title: Contact SHIV SoS or Contact ${\bf S}$tructure ${\bf H}$olographique at ${\bf I}$ntermediate coupling and bulk ${\bf V}$iscosity, and ${\bf S}$peed ${\bf o}$f ${\bf S}$ound

abstract: Thermal QCD systems like strongly coupled QGP require not only a large 't-Hooft coupling but also a finite gauge coupling arXiv:hep-ph/0701201. Unlike almost all top-down holographic models in the literature, holographic large-$N$ thermal QCD models based on this assumption, therefore necessarily require addressing this limit from ${\cal M}$ theory. In the context of strongly coupled (very large `t-Hooft coupling), bulk viscosity $\zeta$ of the type IIA-theory dual of thermal QCD-like theories was found to vary like $\frac{1}{3} - c_s^2$ arXiv:1807.04713 ($c_s$ being the speed of sound), and the same at weak coupling using kinetic theory and finite temperature field theory, was shown in arXiv:1807.04713 to vary like $\left(\frac{1}{3} - c_s^2\right)^2$. In this paper, we not only show that at intermediate coupling, $\zeta$ varies like a linear combination of the strong and weak coupling results, but also observe that this behavior is related to the existence of Contact 3-Structures that exists only at intermediate coupling effected by the intermediate-$N$ "MQGP" limit arXiv:2211.13186.


title: SF-MMCN: A Low Power Re-configurable Server Flow Convolution Neural Network Accelerator

abstract: Convolution Neural Network (CNN) accelerators have been developed rapidly in recent studies. There are lots of CNN accelerators equipped with a variety of function and algorithm which results in low power and high-speed performances. However, the scale of a PE array in traditional CNN accelerators is too big, which costs the most energy consumption while conducting multiply and accumulation (MAC) computations. The other issue is that due to the advance of CNN models, there are enormous models consist of parallel structures such as residual block in Residual Network (ResNet). The appearance of parallel structure in CNN models gives a challenge to the design of CNN accelerators owing to impacts on both operation and area efficiency. This study proposed SF-MMCN structure. The scale of PE array in proposed designs is reduced by pipeline technique in a PE. Proposed SF structure successfully make proposed SF-MMCN operate in high efficiency when facing parallel structures in CNN models. Proposed design is implemented with TSMC 90nm technology on VGG-16 and ResNet-18 environments. The performance of proposed design achieves 76% energy saving, 55% area saving and increases operation and are efficiency 9.25 times and 4.92 times respectively.


title: Mitigating Oversmoothing Through Reverse Process of GNNs for Heterophilic Graphs

abstract: Graph Neural Network (GNN) resembles the diffusion process, leading to the over-smoothing of learned representations when stacking many layers. Hence, the reverse process of message passing can produce the distinguishable node representations by inverting the forward message propagation. The distinguishable representations can help us to better classify neighboring nodes with different labels, such as in heterophilic graphs. In this work, we apply the design principle of the reverse process to the three variants of the GNNs. Through the experiments on heterophilic graph data, where adjacent nodes need to have different representations for successful classification, we show that the reverse process significantly improves the prediction performance in many cases. Additional analysis reveals that the reverse mechanism can mitigate the over-smoothing over hundreds of layers. Our code is available at https://github.com/ml-postech/reverse-gnn.


title: Process-Aware Analysis of Treatment Paths in Heart Failure Patients: A Case Study

abstract: Process mining in healthcare presents a range of challenges when working with different types of data within the healthcare domain. There is high diversity considering the variety of data collected from healthcare processes: operational processes given by claims data, a collection of events during surgery, data related to pre-operative and post-operative care, and high-level data collections based on regular ambulant visits with no apparent events. In this case study, a data set from the last category is analyzed. We apply process-mining techniques on sparse patient heart failure data and investigate whether an information gain towards several research questions is achievable. Here, available data are transformed into an event log format, and process discovery and conformance checking are applied. Additionally, patients are split into different cohorts based on comorbidities, such as diabetes and chronic kidney disease, and multiple statistics are compared between the cohorts. Conclusively, we apply decision mining to determine whether a patient will have a cardiovascular outcome and whether a patient will die.


title: The role of fluid friction in streamer formation and biofilm growth

abstract: Bacillus subtilis biofilms were grown in laminar channel flow at wall shear stress spanning one order of magnitude ($\tau_w = 0.068$ Pa to $\tau_w = 0.67$ Pa). We monitor, non-invasively, the evolution of the three-dimensional distribution of biofilm over seven days using optical coherence tomography (OCT). The obtained biofilms consist of many microcolonies where the characteristic colony has a base structure in the form of a leaning pillar and a streamer in the form of a thin filament that originates near the tip of the pillar. While the shape, size and distribution of these microcolonies depend on the imposed shear stress, the same structural features appear consistently for all shear stress values. The formation of streamers seems to occur after the development of a base structure, suggesting that the latter induces a curved secondary flow that triggers the formation of the streamers. Moreover, we observe that the biofilm volume grows approximately linearly over seven days for all the shear stress values, with a growth rate that is inversely proportional to the wall shear stress. We develop a simple model of friction-limited growth, which agrees with the experimental observations. The model provides physical insight into growth mechanisms and can be used to develop accurate continuum models of bacterial biofilm growth.


title: A Note on the Practice of Logical Inferentialism

abstract: A short essay presenting the State-Effect Interpretation of natural deduction rules as an explanatory framework for recent developments in proof-theoretic semantics.


title: Robust Second-Order Nonconvex Optimization and Its Application to Low Rank Matrix Sensing

abstract: Finding an approximate second-order stationary point (SOSP) is a well-studied and fundamental problem in stochastic nonconvex optimization with many applications in machine learning. However, this problem is poorly understood in the presence of outliers, limiting the use of existing nonconvex algorithms in adversarial settings. In this paper, we study the problem of finding SOSPs in the strong contamination model, where a constant fraction of datapoints are arbitrarily corrupted. We introduce a general framework for efficiently finding an approximate SOSP with \emph{dimension-independent} accuracy guarantees, using $\widetilde{O}({D^2}/{\epsilon})$ samples where $D$ is the ambient dimension and $\epsilon$ is the fraction of corrupted datapoints. As a concrete application of our framework, we apply it to the problem of low rank matrix sensing, developing efficient and provably robust algorithms that can tolerate corruptions in both the sensing matrices and the measurements. In addition, we establish a Statistical Query lower bound providing evidence that the quadratic dependence on $D$ in the sample complexity is necessary for computationally efficient algorithms.


title: Two-sided Acoustic Metascreen for Broadband and Individual Reflection and Transmission Control

abstract: Acoustic wave modulation plays a pivotal role in various applications, including sound-field reconstruction, wireless communication, and particle manipulation, among others. However, current acoustic metamaterial and metasurface designs typically focus on controlling either reflection or transmission waves, often overlooking the coupling between amplitude and phase of acoustic waves. To fulfill this gap, we propose and experimentally validate a design enabling complete control of reflected and transmitted acoustic waves individually across a frequency range of 4 kHz to 8 kHz, allowing arbitrary combinations of amplitude and phase for reflected and transmitted sound in a broadband manner. Additionally, we demonstrate the significance of our approach for sound manipulation by achieving acoustic diffusion, reflection, focusing, and generating a two-sided 3D hologram at three distinct frequencies. These findings open an alternative avenue for extensively engineering sound waves, promising applications in acoustics and related fields.


title: On-Device Domain Learning for Keyword Spotting on Low-Power Extreme Edge Embedded Systems

abstract: Keyword spotting accuracy degrades when neural networks are exposed to noisy environments. On-site adaptation to previously unseen noise is crucial to recovering accuracy loss, and on-device learning is required to ensure that the adaptation process happens entirely on the edge device. In this work, we propose a fully on-device domain adaptation system achieving up to 14% accuracy gains over already-robust keyword spotting models. We enable on-device learning with less than 10 kB of memory, using only 100 labeled utterances to recover 5% accuracy after adapting to the complex speech noise. We demonstrate that domain adaptation can be achieved on ultra-low-power microcontrollers with as little as 806 mJ in only 14 s on always-on, battery-operated devices.


title: Semi-Supervised Learning for Anomaly Traffic Detection via Bidirectional Normalizing Flows

abstract: With the rapid development of the Internet, various types of anomaly traffic are threatening network security. We consider the problem of anomaly network traffic detection and propose a three-stage anomaly detection framework using only normal traffic. Our framework can generate pseudo anomaly samples without prior knowledge of anomalies to achieve the detection of anomaly data. Firstly, we employ a reconstruction method to learn the deep representation of normal samples. Secondly, these representations are normalized to a standard normal distribution using a bidirectional flow module. To simulate anomaly samples, we add noises to the normalized representations which are then passed through the generation direction of the bidirectional flow module. Finally, a simple classifier is trained to differentiate the normal samples and pseudo anomaly samples in the latent space. During inference, our framework requires only two modules to detect anomalous samples, leading to a considerable reduction in model size. According to the experiments, our method achieves the state of-the-art results on the common benchmarking datasets of anomaly network traffic detection. The code is given in the https://github.com/ZxuanDang/ATD-via-Flows.git


title: Impact of Decoherence on Average Correlation

abstract: This article presents a comprehensive study of the impact of decoherence on the average correlation for pure quantum states. We explore two primary mechanisms of decoherence: phase damping and amplitude damping, each having distinct effects on quantum systems. Phase damping, which describes the loss of quantum coherence without energy loss, primarily affects the phase relationships between the components of a quantum system while amplitude damping involves energy dissipation and also affects the state's occupation probabilities. We show that the average correlation follows a predictable decaying pattern in both scenarios. Our analysis can be understood in the context of quantum computing, by focusing on how phase damping influences the entanglement and correlation between qubits, key factors in quantum computational efficiency and error correction protocols.


title: Training Self-localization Models for Unseen Unfamiliar Places via Teacher-to-Student Data-Free Knowledge Transfer

abstract: A typical assumption in state-of-the-art self-localization models is that an annotated training dataset is available in the target workspace. However, this does not always hold when a robot travels in a general open-world. This study introduces a novel training scheme for open-world distributed robot systems. In our scheme, a robot ("student") can ask the other robots it meets at unfamiliar places ("teachers") for guidance. Specifically, a pseudo-training dataset is reconstructed from the teacher model and thereafter used for continual learning of the student model. Unlike typical knowledge transfer schemes, our scheme introduces only minimal assumptions on the teacher model, such that it can handle various types of open-set teachers, including uncooperative, untrainable (e.g., image retrieval engines), and blackbox teachers (i.e., data privacy). Rather than relying on the availability of private data of teachers as in existing methods, we propose to exploit an assumption that holds universally in self-localization tasks: "The teacher model is a self-localization system" and to reuse the self-localization system of a teacher as a sole accessible communication channel. We particularly focus on designing an excellent student/questioner whose interactions with teachers can yield effective question-and-answer sequences that can be used as pseudo-training datasets for the student self-localization model. When applied to a generic recursive knowledge distillation scenario, our approach exhibited stable and consistent performance improvement.


title: Learning to Watermark LLM-generated Text via Reinforcement Learning

abstract: We study how to watermark LLM outputs, i.e. embedding algorithmically detectable signals into LLM-generated text to track misuse. Unlike the current mainstream methods that work with a fixed LLM, we expand the watermark design space by including the LLM tuning stage in the watermark pipeline. While prior works focus on token-level watermark that embeds signals into the output, we design a model-level watermark that embeds signals into the LLM weights, and such signals can be detected by a paired detector. We propose a co-training framework based on reinforcement learning that iteratively (1) trains a detector to detect the generated watermarked text and (2) tunes the LLM to generate text easily detectable by the detector while keeping its normal utility. We empirically show that our watermarks are more accurate, robust, and adaptable (to new attacks). It also allows watermarked model open-sourcing. In addition, if used together with alignment, the extra overhead introduced is low - only training an extra reward model (i.e. our detector). We hope our work can bring more effort into studying a broader watermark design that is not limited to working with a fixed LLM. We open-source the code: https://github.com/xiaojunxu/learning-to-watermark-llm .


title: Safe Planning through Incremental Decomposition of Signal Temporal Logic Specifications

abstract: Trajectory planning is a critical process that enables autonomous systems to safely navigate complex environments. Signal temporal logic (STL) specifications are an effective way to encode complex temporally extended objectives for trajectory planning in cyber-physical systems (CPS). However, planning from these specifications using existing techniques scale exponentially with the number of nested operators and the horizon of specification. Additionally, performance is exacerbated at runtime due to limited computational budgets and compounding modeling errors. Decomposing a complex specification into smaller subtasks and incrementally planning for them can remedy these issues. In this work, we present a way to decompose STL requirements temporally to improve planning efficiency and performance. The key insight in our work is to encode all specifications as a set of reachability and invariance constraints and scheduling these constraints sequentially at runtime. Our proposed technique outperforms the state-of-the-art trajectory synthesis techniques for both linear and non linear dynamical systems.


title: KARINA: An Efficient Deep Learning Model for Global Weather Forecast

abstract: Deep learning-based, data-driven models are gaining prevalence in climate research, particularly for global weather prediction. However, training the global weather data at high resolution requires massive computational resources. Therefore, we present a new model named KARINA to overcome the substantial computational demands typical of this field. This model achieves forecasting accuracy comparable to higher-resolution counterparts with significantly less computational resources, requiring only 4 NVIDIA A100 GPUs and less than 12 hours of training. KARINA combines ConvNext, SENet, and Geocyclic Padding to enhance weather forecasting at a 2.5{\deg} resolution, which could filter out high-frequency noise. Geocyclic Padding preserves pixels at the lateral boundary of the input image, thereby maintaining atmospheric flow continuity in the spherical Earth. SENet dynamically improves feature response, advancing atmospheric process modeling, particularly in the vertical column process as numerous channels. In this vein, KARINA sets new benchmarks in weather forecasting accuracy, surpassing existing models like the ECMWF S2S reforecasts at a lead time of up to 7 days. Remarkably, KARINA achieved competitive performance even when compared to the recently developed models (Pangu-Weather, GraphCast, ClimaX, and FourCastNet) trained with high-resolution data having 100 times larger pixels. Conclusively, KARINA significantly advances global weather forecasting by efficiently modeling Earth's atmosphere with improved accuracy and resource efficiency.


title: A bi-directional low-Reynolds-number swimmer with passive elastic arms

abstract: It has been recently shown that it is possible to design simple artificial swimmers at low Reynoldsnumber that possess only one degree of freedom and, nevertheless, can overcome Purcell's celebratedscallop theorem. One of the few examples is given by Montino and DeSimone, Eur. Phys. J. E, vol.38, 2015, who consider the three-sphere Swimmer of Najafi and Golestanian, replacing one active armwith a passive elastic spring. We further generalize this idea by increasing the number of springs andshow that it is possible to invert the swimming direction using the frequency of the single actuatedarm.


title: Second-Order Information Matters: Revisiting Machine Unlearning for Large Language Models

abstract: With the rapid development of Large Language Models (LLMs), we have witnessed intense competition among the major LLM products like ChatGPT, LLaMa, and Gemini. However, various issues (e.g. privacy leakage and copyright violation) of the training corpus still remain underexplored. For example, the Times sued OpenAI and Microsoft for infringing on its copyrights by using millions of its articles for training. From the perspective of LLM practitioners, handling such unintended privacy violations can be challenging. Previous work addressed the ``unlearning" problem of LLMs using gradient information, while they mostly introduced significant overheads like data preprocessing or lacked robustness. In this paper, contrasting with the methods based on first-order information, we revisit the unlearning problem via the perspective of second-order information (Hessian). Our unlearning algorithms, which are inspired by classic Newton update, are not only data-agnostic/model-agnostic but also proven to be robust in terms of utility preservation or privacy guarantee. Through a comprehensive evaluation with four NLP datasets as well as a case study on real-world datasets, our methods consistently show superiority over the first-order methods.


title: Adaptive Hybrid Masking Strategy for Privacy-Preserving Face Recognition Against Model Inversion Attack

abstract: The utilization of personal sensitive data in training face recognition (FR) models poses significant privacy concerns, as adversaries can employ model inversion attacks (MIA) to infer the original training data. Existing defense methods, such as data augmentation and differential privacy, have been employed to mitigate this issue. However, these methods often fail to strike an optimal balance between privacy and accuracy. To address this limitation, this paper introduces an adaptive hybrid masking algorithm against MIA. Specifically, face images are masked in the frequency domain using an adaptive MixUp strategy. Unlike the traditional MixUp algorithm, which is predominantly used for data augmentation, our modified approach incorporates frequency domain mixing. Previous studies have shown that increasing the number of images mixed in MixUp can enhance privacy preservation but at the expense of reduced face recognition accuracy. To overcome this trade-off, we develop an enhanced adaptive MixUp strategy based on reinforcement learning, which enables us to mix a larger number of images while maintaining satisfactory recognition accuracy. To optimize privacy protection, we propose maximizing the reward function (i.e., the loss function of the FR system) during the training of the strategy network. While the loss function of the FR network is minimized in the phase of training the FR network. The strategy network and the face recognition network can be viewed as antagonistic entities in the training process, ultimately reaching a more balanced trade-off. Experimental results demonstrate that our proposed hybrid masking scheme outperforms existing defense algorithms in terms of privacy preservation and recognition accuracy against MIA.


title: Generative Models and Connected and Automated Vehicles: A Survey in Exploring the Intersection of Transportation and AI

abstract: This report investigates the history and impact of Generative Models and Connected and Automated Vehicles (CAVs), two groundbreaking forces pushing progress in technology and transportation. By focusing on the application of generative models within the context of CAVs, the study aims to unravel how this integration could enhance predictive modeling, simulation accuracy, and decision-making processes in autonomous vehicles. This thesis discusses the benefits and challenges of integrating generative models and CAV technology in transportation. It aims to highlight the progress made, the remaining obstacles, and the potential for advancements in safety and innovation.


title: Holographic Phase Retrieval via Wirtinger Flow: Cartesian Form with Auxiliary Amplitude

abstract: We propose a new gradient method for holography, where a phase-only hologram is parameterized by not only the phase but also amplitude. The key idea of our approach is the formulation of a phase-only hologram using an auxiliary amplitude. We optimize the parameters using the so-called Wirtinger flow algorithm in the Cartesian domain, which is a gradient method defined on the basis of the Wirtinger calculus. At the early stage of optimization, each element of the hologram exists inside a complex circle, and it can take a large gradient while diverging from the origin. This characteristic contributes to accelerating the gradient descent. Meanwhile, at the final stage of optimization, each element evolves along a complex circle, similar to previous state-of-the-art gradient methods. The experimental results demonstrate that our method outperforms previous methods, primarily due to the optimization of the amplitude.

categories: cs.IT cs.GR cs.NA eess.IV math.IT math.NA


title: A collection of the accepted papers for the Human-Centric Representation Learning workshop at AAAI 2024

abstract: This non-archival index is not complete, as some accepted papers chose to opt-out of inclusion. The list of all accepted papers is available on the workshop website.


title: Counter-Samples: A Stateless Strategy to Neutralize Black Box Adversarial Attacks

abstract: Our paper presents a novel defence against black box attacks, where attackers use the victim model as an oracle to craft their adversarial examples. Unlike traditional preprocessing defences that rely on sanitizing input samples, our stateless strategy counters the attack process itself. For every query we evaluate a counter-sample instead, where the counter-sample is the original sample optimized against the attacker's objective. By countering every black box query with a targeted white box optimization, our strategy effectively introduces an asymmetry to the game to the defender's advantage. This defence not only effectively misleads the attacker's search for an adversarial example, it also preserves the model's accuracy on legitimate inputs and is generic to multiple types of attacks. We demonstrate that our approach is remarkably effective against state-of-the-art black box attacks and outperforms existing defences for both the CIFAR-10 and ImageNet datasets. Additionally, we also show that the proposed defence is robust against strong adversaries as well.


title: A Plausible Path Towards Unification of Interactions via Gauge Fields Consistent with the Equivalence Principle-II

abstract: An extension of the Lorentz group that includes generators $\Gamma^\mu$ carrying a space-time index has been previously demonstrated to \emph{explicitly} construct the Minkowski metric \emph{within} the internal group space as a consequence of the non-vanishing commutation relations between those generators. Fields that transform under representations of this extended group can fundamentally incorporate microscopic causality as a crucial property of physical fields. The first part of this exploration focused on the fundamental representation fermions (which satisfy the Dirac equation), and explored additional internal symmetries associated with those fermions. Any interactions that could result from those symmetries were demonstrated to necessarily be consistent with gravitational equivalence under curvilinear extensions of the (abelian) space-time translations. The first boson representation of this algebra is the focus of this second paper. In particular, the equations of motion for a group of massive vector bosons are degenerate with that of massless vector bosons, allowing them to unitarily mix to form physical states with differing masses and dynamics. Thus, this representation exhibits a potential for enhancing insights into the standard modeling of electro-weak mixing of bosons. The various spinors that represent these bosons exhibit kinematic factors, and those factors are related during unitary mixing to generate the resultant physical states. For this reason, analytic and kinematic coincidences associated with known electro-weak masses will be explored for insights into possible predictive relationships between their masses and those of this first causal boson representation. To conclude, a plausible model will be constructed using examined coincidences for critique and insights into the potential viability of the approach.


title: All incompatible measurements on qubits lead to multiparticle Bell nonlocality

abstract: Bell nonlocality is a fundamental phenomenon of quantum physics as well as an essential resource for various tasks in quantum information processing. It is known that for the observation of nonlocality the measurements on a quantum system have to be incompatible, but the question which incompatible measurements are useful, remained open. Here we prove that any set of incompatible measurements on qubits leads to a violation of a suitable Bell inequality in a multiparticle scenario, where all parties perform the same set of measurements. Since there exists incompatible measurements on qubits which do not lead to Bell nonlocality for two particles, our results demonstrate a fundamental difference between two-particle and multi-particle nonlocality, pointing at the superactivation of measurement incompatibility as a resource. In addition, our results imply that measurement incompatibility for qubits can always be certified in a device-independent manner.


title: PTSD-MDNN : Fusion tardive de r\'eseaux de neurones profonds multimodaux pour la d\'etection du trouble de stress post-traumatique

abstract: In order to provide a more objective and quicker way to diagnose post-traumatic stress disorder (PTSD), we present PTSD-MDNN which merges two unimodal convolutional neural networks and which gives low detection error rate. By taking only videos and audios as inputs, the model could be used in the configuration of teleconsultation sessions, in the optimization of patient journeys or for human-robot interaction.

categories: eess.AS cs.AI cs.CV cs.SD eess.IV q-bio.NC


title: Cooling-Guide Diffusion Model for Battery Cell Arrangement

abstract: Our study introduces a Generative AI method that employs a cooling-guided diffusion model to optimize the layout of battery cells, a crucial step for enhancing the cooling performance and efficiency of battery thermal management systems. Traditional design processes, which rely heavily on iterative optimization and extensive guesswork, are notoriously slow and inefficient, often leading to suboptimal solutions. In contrast, our innovative method uses a parametric denoising diffusion probabilistic model (DDPM) with classifier and cooling guidance to generate optimized cell layouts with enhanced cooling paths, significantly lowering the maximum temperature of the cells. By incorporating position-based classifier guidance, we ensure the feasibility of generated layouts. Meanwhile, cooling guidance directly optimizes cooling-efficiency, making our approach uniquely effective. When compared to two advanced models, the Tabular Denoising Diffusion Probabilistic Model (TabDDPM) and the Conditional Tabular GAN (CTGAN), our cooling-guided diffusion model notably outperforms both. It is five times more effective than TabDDPM and sixty-six times better than CTGAN across key metrics such as feasibility, diversity, and cooling efficiency. This research marks a significant leap forward in the field, aiming to optimize battery cell layouts for superior cooling efficiency, thus setting the stage for the development of more effective and dependable battery thermal management systems.


title: Uncertainty estimation in spatial interpolation of satellite precipitation with ensemble learning

abstract: Predictions in the form of probability distributions are crucial for decision-making. Quantile regression enables this within spatial interpolation settings for merging remote sensing and gauge precipitation data. However, ensemble learning of quantile regression algorithms remains unexplored in this context. Here, we address this gap by introducing nine quantile-based ensemble learners and applying them to large precipitation datasets. We employed a novel feature engineering strategy, reducing predictors to distance-weighted satellite precipitation at relevant locations, combined with location elevation. Our ensemble learners include six stacking and three simple methods (mean, median, best combiner), combining six individual algorithms: quantile regression (QR), quantile regression forests (QRF), generalized random forests (GRF), gradient boosting machines (GBM), light gradient boosting machines (LightGBM), and quantile regression neural networks (QRNN). These algorithms serve as both base learners and combiners within different stacking methods. We evaluated performance against QR using quantile scoring functions in a large dataset comprising 15 years of monthly gauge-measured and satellite precipitation in contiguous US (CONUS). Stacking with QR and QRNN yielded the best results across quantile levels of interest (0.025, 0.050, 0.075, 0.100, 0.200, 0.300, 0.400, 0.500, 0.600, 0.700, 0.800, 0.900, 0.925, 0.950, 0.975), surpassing the reference method by 3.91% to 8.95%. This demonstrates the potential of stacking to improve probabilistic predictions in spatial interpolation and beyond.


title: MoPE: Parameter-Efficient and Scalable Multimodal Fusion via Mixture of Prompt Experts

abstract: Prompt-tuning has demonstrated parameter-efficiency in fusing unimodal foundation models for multimodal tasks. However, its limited adaptivity and expressiveness lead to suboptimal performance when compared with other tuning methods. In this paper, we address this issue by disentangling the vanilla prompts to adaptively capture dataset-level and instance-level features. Building upon this disentanglement, we introduce the mixture of prompt experts (MoPE) technique to enhance expressiveness. MoPE leverages multimodal pairing priors to route the most effective prompt on a per-instance basis. Compared to vanilla prompting, our MoPE-based conditional prompting exhibits greater expressiveness for multimodal fusion, scaling better with the training data and the overall number of trainable parameters. We also study a regularization term for expert routing, leading to emergent expert specialization, where different experts focus on different concepts, enabling interpretable soft prompting. Extensive experiments across three multimodal datasets demonstrate that our method achieves state-of-the-art results, matching or even surpassing the performance of fine-tuning, while requiring only 0.8% of the trainable parameters. Code will be released: https://github.com/songrise/MoPE.


title: Achieving Pareto Optimality using Efficient Parameter Reduction for DNNs in Resource-Constrained Edge Environment

abstract: This paper proposes an optimization of an existing Deep Neural Network (DNN) that improves its hardware utilization and facilitates on-device training for resource-constrained edge environments. We implement efficient parameter reduction strategies on Xception that shrink the model size without sacrificing accuracy, thus decreasing memory utilization during training. We evaluate our model in two experiments: Caltech-101 image classification and PCB defect detection and compare its performance against the original Xception and lightweight models, EfficientNetV2B1 and MobileNetV2. The results of the Caltech-101 image classification show that our model has a better test accuracy (76.21%) than Xception (75.89%), uses less memory on average (847.9MB) than Xception (874.6MB), and has faster training and inference times. The lightweight models overfit with EfficientNetV2B1 having a 30.52% test accuracy and MobileNetV2 having a 58.11% test accuracy. Both lightweight models have better memory usage than our model and Xception. On the PCB defect detection, our model has the best test accuracy (90.30%), compared to Xception (88.10%), EfficientNetV2B1 (55.25%), and MobileNetV2 (50.50%). MobileNetV2 has the least average memory usage (849.4MB), followed by our model (865.8MB), then EfficientNetV2B1 (874.8MB), and Xception has the highest (893.6MB). We further experiment with pre-trained weights and observe that memory usage decreases thereby showing the benefits of transfer learning. A Pareto analysis of the models' performance shows that our optimized model architecture satisfies accuracy and low memory utilization objectives.


title: Symbiotic Game and Foundation Models for Cyber Deception Operations in Strategic Cyber Warfare

abstract: We are currently facing unprecedented cyber warfare with the rapid evolution of tactics, increasing asymmetry of intelligence, and the growing accessibility of hacking tools. In this landscape, cyber deception emerges as a critical component of our defense strategy against increasingly sophisticated attacks. This chapter aims to highlight the pivotal role of game-theoretic models and foundation models (FMs) in analyzing, designing, and implementing cyber deception tactics. Game models (GMs) serve as a foundational framework for modeling diverse adversarial interactions, allowing us to encapsulate both adversarial knowledge and domain-specific insights. Meanwhile, FMs serve as the building blocks for creating tailored machine learning models suited to given applications. By leveraging the synergy between GMs and FMs, we can advance proactive and automated cyber defense mechanisms by not only securing our networks against attacks but also enhancing their resilience against well-planned operations. This chapter discusses the games at the tactical, operational, and strategic levels of warfare, delves into the symbiotic relationship between these methodologies, and explores relevant applications where such a framework can make a substantial impact in cybersecurity. The chapter discusses the promising direction of the multi-agent neurosymbolic conjectural learning (MANSCOL), which allows the defender to predict adversarial behaviors, design adaptive defensive deception tactics, and synthesize knowledge for the operational level synthesis and adaptation. FMs serve as pivotal tools across various functions for MANSCOL, including reinforcement learning, knowledge assimilation, formation of conjectures, and contextual representation. This chapter concludes with a discussion of the challenges associated with FMs and their application in the domain of cybersecurity.


title: JaxDecompiler: Redefining Gradient-Informed Software Design

abstract: Among numerical libraries capable of computing gradient descent optimization, JAX stands out by offering more features, accelerated by an intermediate representation known as Jaxpr language. However, editing the Jaxpr code is not directly possible. This article introduces JaxDecompiler, a tool that transforms any JAX function into an editable Python code, especially useful for editing the JAX function generated by the gradient function. JaxDecompiler simplifies the processes of reverse engineering, understanding, customizing, and interoperability of software developed by JAX. We highlight its capabilities, emphasize its practical applications especially in deep learning and more generally gradient-informed software, and demonstrate that the decompiled code speed performance is similar to the original.


title: Discovering Invariant Neighborhood Patterns for Heterophilic Graphs

abstract: This paper studies the problem of distribution shifts on non-homophilous graphs Mosting existing graph neural network methods rely on the homophilous assumption that nodes from the same class are more likely to be linked. However, such assumptions of homophily do not always hold in real-world graphs, which leads to more complex distribution shifts unaccounted for in previous methods. The distribution shifts of neighborhood patterns are much more diverse on non-homophilous graphs. We propose a novel Invariant Neighborhood Pattern Learning (INPL) to alleviate the distribution shifts problem on non-homophilous graphs. Specifically, we propose the Adaptive Neighborhood Propagation (ANP) module to capture the adaptive neighborhood information, which could alleviate the neighborhood pattern distribution shifts problem on non-homophilous graphs. We propose Invariant Non-Homophilous Graph Learning (INHGL) module to constrain the ANP and learn invariant graph representation on non-homophilous graphs. Extensive experimental results on real-world non-homophilous graphs show that INPL could achieve state-of-the-art performance for learning on large non-homophilous graphs.


title: Medical Unlearnable Examples: Securing Medical Data from Unauthorized Traning via Sparsity-Aware Local Masking

abstract: With the rapid growth of artificial intelligence (AI) in healthcare, there has been a significant increase in the generation and storage of sensitive medical data. This abundance of data, in turn, has propelled the advancement of medical AI technologies. However, concerns about unauthorized data exploitation, such as training commercial AI models, often deter researchers from making their invaluable datasets publicly available. In response to the need to protect this hard-to-collect data while still encouraging medical institutions to share it, one promising solution is to introduce imperceptible noise into the data. This method aims to safeguard the data against unauthorized training by inducing degradation in model generalization. Although existing methods have shown commendable data protection capabilities in general domains, they tend to fall short when applied to biomedical data, mainly due to their failure to account for the sparse nature of medical images. To address this problem, we propose the Sparsity-Aware Local Masking (SALM) method, a novel approach that selectively perturbs significant pixel regions rather than the entire image as previous strategies have done. This simple-yet-effective approach significantly reduces the perturbation search space by concentrating on local regions, thereby improving both the efficiency and effectiveness of data protection for biomedical datasets characterized by sparse features. Besides, we have demonstrated that SALM maintains the essential characteristics of the data, ensuring its clinical utility remains uncompromised. Our extensive experiments across various datasets and model architectures demonstrate that SALM effectively prevents unauthorized training of deep-learning models and outperforms previous state-of-the-art data protection methods.


title: Autoregressive Queries for Adaptive Tracking with Spatio-TemporalTransformers

abstract: The rich spatio-temporal information is crucial to capture the complicated target appearance variations in visual tracking. However, most top-performing tracking algorithms rely on many hand-crafted components for spatio-temporal information aggregation. Consequently, the spatio-temporal information is far away from being fully explored. To alleviate this issue, we propose an adaptive tracker with spatio-temporal transformers (named AQATrack), which adopts simple autoregressive queries to effectively learn spatio-temporal information without many hand-designed components. Firstly, we introduce a set of learnable and autoregressive queries to capture the instantaneous target appearance changes in a sliding window fashion. Then, we design a novel attention mechanism for the interaction of existing queries to generate a new query in current frame. Finally, based on the initial target template and learnt autoregressive queries, a spatio-temporal information fusion module (STM) is designed for spatiotemporal formation aggregation to locate a target object. Benefiting from the STM, we can effectively combine the static appearance and instantaneous changes to guide robust tracking. Extensive experiments show that our method significantly improves the tracker's performance on six popular tracking benchmarks: LaSOT, LaSOText, TrackingNet, GOT-10k, TNL2K, and UAV123.


title: Exploring Language Model's Code Generation Ability with Auxiliary Functions

abstract: Auxiliary function is a helpful component to improve language model's code generation ability. However, a systematic exploration of how they affect has yet to be done. In this work, we comprehensively evaluate the ability to utilize auxiliary functions encoded in recent code-pretrained language models. First, we construct a human-crafted evaluation set, called HumanExtension, which contains examples of two functions where one function assists the other. With HumanExtension, we design several experiments to examine their ability in a multifaceted way. Our evaluation processes enable a comprehensive understanding of including auxiliary functions in the prompt in terms of effectiveness and robustness. An additional implementation style analysis captures the models' various implementation patterns when they access the auxiliary function. Through this analysis, we discover the models' promising ability to utilize auxiliary functions including their self-improving behavior by implementing the two functions step-by-step. However, our analysis also reveals the model's underutilized behavior to call the auxiliary function, suggesting the future direction to enhance their implementation by eliciting the auxiliary function call ability encoded in the models. We release our code and dataset to facilitate this research direction.


title: Ignore Me But Don't Replace Me: Utilizing Non-Linguistic Elements for Pretraining on the Cybersecurity Domain

abstract: Cybersecurity information is often technically complex and relayed through unstructured text, making automation of cyber threat intelligence highly challenging. For such text domains that involve high levels of expertise, pretraining on in-domain corpora has been a popular method for language models to obtain domain expertise. However, cybersecurity texts often contain non-linguistic elements (such as URLs and hash values) that could be unsuitable with the established pretraining methodologies. Previous work in other domains have removed or filtered such text as noise, but the effectiveness of these methods have not been investigated, especially in the cybersecurity domain. We propose different pretraining methodologies and evaluate their effectiveness through downstream tasks and probing tasks. Our proposed strategy (selective MLM and jointly training NLE token classification) outperforms the commonly taken approach of replacing non-linguistic elements (NLEs). We use our domain-customized methodology to train CyBERTuned, a cybersecurity domain language model that outperforms other cybersecurity PLMs on most tasks.


title: Stembridge codes, permutahedral varieties, and their extensions

abstract: It is well known that the Eulerian polynomial is the Hilbert series of the cohomology of the permutahedral variety. Stanley obtained a formula showing that the cohomology carries a permutation representation of $\mathfrak{S}_n$. We answer a question of Stembridge on finding an explicit permutation basis of this cohomology. We observe that the Feichtner-Yuzvinsky basis for the Chow ring of the Boolean matroid is such a permutation basis, and then we construct an $\mathfrak{S}_n$-equivariant bijection between this basis and codes introduced by Stembridge, thereby giving a combinatorial proof of Stanley's formula. We obtain an analogous result for the stellahedral variety. We find a permutation basis of the permutation representation its cohomology carries. This involves the augmented Chow ring of a matroid introduced by Braden, Huh, Matherne, Proudfoot and Wang. Along the way, we obtain a general result on augmented Chow rings (which was also independently obtained by Eur) asserting that augmented Chow rings of matroids are actually Chow rings in the sense of Feichtner and Yuzvinsky. In the last part of the paper, we study enumerative aspects of the permutahedra and the stellohedra related to these permutation bases.


title: Generative Modelling of Stochastic Rotating Shallow Water Noise

abstract: In recent work, the authors have developed a generic methodology for calibrating the noise in fluid dynamics stochastic partial differential equations where the stochasticity was introduced to parametrize subgrid-scale processes. The stochastic parameterization of sub-grid scale processes is required in the estimation of uncertainty in weather and climate predictions, to represent systematic model errors arising from subgrid-scale fluctuations. The previous methodology used a principal component analysis (PCA) technique based on the ansatz that the increments of the stochastic parametrization are normally distributed. In this paper, the PCA technique is replaced by a generative model technique. This enables us to avoid imposing additional constraints on the increments. The methodology is tested on a stochastic rotating shallow water model with the elevation variable of the model used as input data. The numerical simulations show that the noise is indeed non-Gaussian. The generative modelling technology gives good RMSE, CRPS score and forecast rank histogram results.

categories: stat.ML cs.LG cs.NA math.DS math.NA physics.flu-dyn


title: Metamaterialy, konfigurowalne matryce antenowe i komunikacja holograficzna. Wstepna analiza nowej koncepcji bezprzewodowej transmisji danych

abstract: In the last few years, a very original concept of holographic communication has gained a lot of interest among scientists from all over the world. The specificity of this approach, on the one hand, is very different from the known and currently used solutions, on the other hand, it creates great development opportunities in the field of wireless communication. The article provides an overview of two technological solutions that gave rise to the idea of holographic communication. First, the possibility of using the so-called metamaterials for the purposes of wireless data transmission, and the second, the use of reconfigurable antenna surfaces. The last part presents the assumptions of the idea of holographic communication, in which the principles of creating images known from optical holography have been transferred to the radio band, and to some extend, generalized.


title: Simple circuit and experimental proposal for the detection of gauge-waves

abstract: Aharonov-Bohm electrodynamics predicts the existence of traveling waves of pure potentials, with zero electromagnetic fields, denoted as gauge waves, or g-waves for short. In general, these waves cannot be shielded by matter since their lack of electromagnetic fields prevents the material from reacting to them. However, a not-locally-conserved electric current present in the material does interact with the potentials in the wave, giving the possibility of its detection. In [F.M., G.M., Eur.Phys.J. C 83, 1086 (2023)] the basic theoretical description of a detecting circuit was presented, based on a phenomenological theory of materials that can sustain not-locally-conserved electric currents. In the present work we discuss how that circuit can be built in practice, and used for the effective detection of g-waves.


title: Large Language Model-informed ECG Dual Attention Network for Heart Failure Risk Prediction

abstract: Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate. Early detection and prevention of HF could significantly reduce its impact. We introduce a novel methodology for predicting HF risk using 12-lead electrocardiograms (ECGs). We present a novel, lightweight dual-attention ECG network designed to capture complex ECG features essential for early HF risk prediction, despite the notable imbalance between low and high-risk groups. This network incorporates a cross-lead attention module and twelve lead-specific temporal attention modules, focusing on cross-lead interactions and each lead's local dynamics. To further alleviate model overfitting, we leverage a large language model (LLM) with a public ECG-Report dataset for pretraining on an ECG-report alignment task. The network is then fine-tuned for HF risk prediction using two specific cohorts from the UK Biobank study, focusing on patients with hypertension (UKB-HYP) and those who have had a myocardial infarction (UKB-MI).The results reveal that LLM-informed pre-training substantially enhances HF risk prediction in these cohorts. The dual-attention design not only improves interpretability but also predictive accuracy, outperforming existing competitive methods with C-index scores of 0.6349 for UKB-HYP and 0.5805 for UKB-MI. This demonstrates our method's potential in advancing HF risk assessment with clinical complex ECG data.


title: How Suboptimal is Training rPPG Models with Videos and Targets from Different Body Sites?

abstract: Remote camera measurement of the blood volume pulse via photoplethysmography (rPPG) is a compelling technology for scalable, low-cost, and accessible assessment of cardiovascular information. Neural networks currently provide the state-of-the-art for this task and supervised training or fine-tuning is an important step in creating these models. However, most current models are trained on facial videos using contact PPG measurements from the fingertip as targets/ labels. One of the reasons for this is that few public datasets to date have incorporated contact PPG measurements from the face. Yet there is copious evidence that the PPG signals at different sites on the body have very different morphological features. Is training a facial video rPPG model using contact measurements from another site on the body suboptimal? Using a recently released unique dataset with synchronized contact PPG and video measurements from both the hand and face, we can provide precise and quantitative answers to this question. We obtain up to 40 % lower mean squared errors between the waveforms of the predicted and the ground truth PPG signals using state-of-the-art neural models when using PPG signals from the forehead compared to using PPG signals from the fingertip. We also show qualitatively that the neural models learn to predict the morphology of the ground truth PPG signal better when trained on the forehead PPG signals. However, while models trained from the forehead PPG produce a more faithful waveform, models trained from a finger PPG do still learn the dominant frequency (i.e., the heart rate) well.


title: Bitcoin MiCA Whitepaper

abstract: This document is written as an academic exercise, with the goal of exploring the feasibility of writing a white paper in accordance with Regulation (EU) 2023/1114 (MiCA). It is meant as a Proof of Concept (PoC) illustrating a concrete application of the requirements of MiCA. Like the MiCA white papers PoC shared by ESMA, this document is solely for the purposes of the PoC, to inform the public as to how a crypto-asset white paper could work, inspire public debate and feedback, and enhance the public conversation around the implementation of EU regulations.


title: The apolar inner product and a Bombieri type inequality for polynomials

abstract: We consider inequalities of Bombieri type for polynomials that need not be homogeneous, using the apolar inner product.


title: Solving General Noisy Inverse Problem via Posterior Sampling: A Policy Gradient Viewpoint

abstract: Solving image inverse problems (e.g., super-resolution and inpainting) requires generating a high fidelity image that matches the given input (the low-resolution image or the masked image). By using the input image as guidance, we can leverage a pretrained diffusion generative model to solve a wide range of image inverse tasks without task specific model fine-tuning. To precisely estimate the guidance score function of the input image, we propose Diffusion Policy Gradient (DPG), a tractable computation method by viewing the intermediate noisy images as policies and the target image as the states selected by the policy. Experiments show that our method is robust to both Gaussian and Poisson noise degradation on multiple linear and non-linear inverse tasks, resulting into a higher image restoration quality on FFHQ, ImageNet and LSUN datasets.


title: From Algorithms to Outcomes: Reviewing AI's Role in Non-Muscle-Invasive Bladder Cancer Recurrence Prediction

abstract: Bladder cancer, the leading urinary tract cancer, is responsible for 15 deaths daily in the UK. This cancer predominantly manifests as non-muscle-invasive bladder cancer (NMIBC), characterised by tumours not yet penetrating the muscle layer of the bladder wall. NMIBC is plagued by a very high recurrence rate of 70-80% and hence the costliest treatments. Current tools for predicting recurrence use scoring systems that overestimate risk and have poor accuracy. Inaccurate and delayed prediction of recurrence significantly elevates the likelihood of mortality. Accurate prediction of recurrence is hence vital for cost-effective management and treatment planning. This is where Machine learning (ML) techniques have emerged as a promising approach for predicting NMIBC recurrence by leveraging molecular and clinical data. This review provides a comprehensive analysis of ML approaches for predicting NMIBC recurrence. Our systematic evaluation demonstrates the potential of diverse ML algorithms and markers, including radiomic, clinical, histopathological, genomic, and biochemical data in enhancing recurrence prediction and personalised patient management. We summarise various prediction tasks, data modalities, and ML models used, highlighting their performance, limitations, and future directions of incorporating cost-effectiveness. Challenges related to generalisability and interpretability of artificial intelligent models are discussed, emphasising the need for collaborative efforts and robust datasets.


title: Towards Two Bloch Sphere Representation of Pure Two Qubit States and Unitaries

abstract: We extend Bloch Sphere formalism to pure two qubit systems. Combining insights from Geometric Algebra and analysis of entanglement in different conjugate bases we identify Two Bloch Sphere geometry that is suitable for representing maximally entangled states. It turns out that relative direction of coordinate axes of the two Bloch Spheres may be used to describe the states. Moreover, coordinate axes of one Bloch sphere should be rignt-handed and of the other one - left-handed. We describe and depict separable and maximally entangled states as well as entangling and non-entangling rotations. We also offer graphical representation of workings of a CNOT gate for different inputs. Finally we provide a way to also represent partially entangled states and describe entanglement measure related to the surface area of the sphere enclosing the state representation.


title: S3LLM: Large-Scale Scientific Software Understanding with LLMs using Source, Metadata, and Document

abstract: The understanding of large-scale scientific software poses significant challenges due to its diverse codebase, extensive code length, and target computing architectures. The emergence of generative AI, specifically large language models (LLMs), provides novel pathways for understanding such complex scientific codes. This paper presents S3LLM, an LLM-based framework designed to enable the examination of source code, code metadata, and summarized information in conjunction with textual technical reports in an interactive, conversational manner through a user-friendly interface. S3LLM leverages open-source LLaMA-2 models to enhance code analysis through the automatic transformation of natural language queries into domain-specific language (DSL) queries. Specifically, it translates these queries into Feature Query Language (FQL), enabling efficient scanning and parsing of entire code repositories. In addition, S3LLM is equipped to handle diverse metadata types, including DOT, SQL, and customized formats. Furthermore, S3LLM incorporates retrieval augmented generation (RAG) and LangChain technologies to directly query extensive documents. S3LLM demonstrates the potential of using locally deployed open-source LLMs for the rapid understanding of large-scale scientific computing software, eliminating the need for extensive coding expertise, and thereby making the process more efficient and effective. S3LLM is available at https://github.com/ResponsibleAILab/s3llm.


title: A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models

abstract: Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs, such as unexpected artifacts and noises. To reduce these artifacts and enhance the perceptual quality of the results, in this paper, we propose a general method that can be effectively used in most GAN-based super-resolution (SR) models by introducing essential spatial information into the training process. We extract spatial information from the input data and incorporate it into the training loss, making the corresponding loss a spatially adaptive (SA) one. After that, we utilize it to guide the training process. We will show that the proposed approach is independent of the methods used to extract the spatial information and independent of the SR tasks and models. This method consistently guides the training process towards generating visually pleasing SR images and video frames, substantially mitigating artifacts and noise, ultimately leading to enhanced perceptual quality.


title: Practical realization of chiral nonlinearity for strong topological protection

abstract: Nonlinear topology has been much less inquired compared to its linear counterpart. Existing advances have focused on nonlinearities of limited magnitudes and fairly homogeneous types. As such, the realizations have rarely been concerned with the requirements for nonlinearity. Here we explore nonlinear topological protection through the determination of nonlinear rules and demonstrate their relevance in real-world experiments. We take advantage of chiral symmetry and identify the condition for its continuation in general nonlinear environments. Applying it to one-dimensional topological lattices, we can obtain definite evolution paths of zero-energy edge states that preserve topologically nontrivial phases regardless of the specifics of the chiral nonlinearities. Based on an acoustic prototype design, we theoretically, numerically, and experimentally showcase the nonlinear topological edge states that persist in all nonlinear degrees and directions without any frequency shift. Our findings unveil a broad family of nonlinearities that are compatible with topological non-triviality, establishing a solid ground for future drilling in the emergent field of nonlinear topology.


title: Effective time-dependent temperature for fermionic master equations beyond the Markov and the secular approximations

abstract: We consider a quantum system coupled to environment at a fixed temperature and describe the reduced evolution of the system by means of a Redfield equation with effective time-dependent contact temperature obeying a universal law. At early times, after the system and environment start in a product state, the effective contact temperature appears to be much higher, yet eventually it settles down towards the true environment value. In this way, we obtain a method which includes non-Markovian effects and can be further applied to various types of GKSL equations, beyond the secular approximation and time-averaging methods. We derive the theory from first principles and discuss its application using a simple example of a single quantum dot.


title: Studying Stabilizer de Finetti Theorems and Possible Applications in Quantum Information Processing

abstract: Symmetries are of fundamental interest in many areas of science. In quantum information theory, if a quantum state is invariant under permutations of its subsystems, it is a well-known and widely used result that its marginal can be approximated by a mixture of tensor powers of a state on a single subsystem. Applications of this quantum de Finetti theorem range from quantum key distribution (QKD) to quantum state tomography and numerical separability tests. Recently, it has been discovered by Gross, Nezami and Walter that a similar observation can be made for a larger symmetry group than permutations: states that are invariant under stochastic orthogonal symmetry are approximated by tensor powers of stabilizer states, with an exponentially smaller overhead than previously possible. This naturally raises the question if similar improvements could be found for applications where this symmetry appears (or can be enforced). Here, two such examples are investigated.


title: Circumnuclear Multi-phase Gas in the Circinus Galaxy. VI. Detectability of Molecular Inflow and Atomic Outflow

abstract: Recent submillimeter observations have revealed signs of pc-scale molecular inflow and atomic outflow in the nearest Seyfert 2 galaxy, the Circinus galaxy. To verify the gas kinematics suggested by these observations, we performed molecular and atomic line transfer calculations based on a physics-based 3D radiation-hydrodynamic model, which has been compared with multi-wavelength observations in this paper series. The major axis position-velocity diagram (PVD) of CO(3-2) reproduces the observed faint emission at the systemic velocity, and our calculations confirm that this component originates from failed winds falling back to the disk plane. The minor-axis PVD of [CI]($^3P_1$-$^3P_0$), when created using only the gas with positive radial velocities, presents a sign of blue- and redshifted offset peaks similar to those in the observation, suggesting that the observed peaks indeed originate from the outflow, but that the model may lack outflows as strong as those in the Circinus galaxy. Similar to the observed HCN(3-2), the similar dense gas tracer HCO$^+$(3-2) can exhibit nuclear spectra with inverse P-Cygni profiles with $\sim$0.5 pc beams, but the line shape is azimuthally dependent. The corresponding continuum absorbers are inflowing clumps at 5-10 pc from the center. To detect significant absorption with a high probability, the inclination must be fairly edge-on ($\gtrsim$85$^\circ$), and the beam size must be small ($\lesssim$1 pc). These results suggest that HCN or HCO$^+$ and [CI] lines are effective for observing pc-scale inflows and outflows, respectively.


title: Hidden Amplitude Zeros From Double Copy

abstract: Recently, Arkani-Hamed et al. proposed the existence of zeros in scattering amplitudes in certain quantum field theories including the cubic adjoint scalar theory Tr($\phi^3$), the $SU(N)$ non-linear sigma model (NLSM) and Yang-Mills (YM) theory. These hidden zeros are special kinematic points where the amplitude vanishes and factorizes into a product of lower-point amplitudes, similar to factorization near poles. In this letter, we show a close connection between the existence of such zeros and color-kinematics duality. In fact, all zeros can be derived from the Bern-Carrasco-Johansson (BCJ) relations. We also show that these zeros extend via the Kawai-Lewellen-Tye (KLT) relations to special Galileon amplitudes and their corrections, evincing that these hidden zeros are also present in permutation-invariant amplitudes.


title: A survey for variable stars with small telescopes: IX -- Evolution of Spot Properties on YSOs in IC5070

abstract: We present spot properties on 32 periodic young stellar objects in IC 5070. Long term, $\sim$5 yr, light curves in the $V$, $R$, and $I$-bands are obtained through the HOYS (Hunting Outbursting Young Stars) citizen science project. These are dissected into six months long slices, with 3 months oversampling, to measure 234 sets of amplitudes in all filters. We fit 180 of these with reliable spot solutions. Two thirds of spot solutions are cold spots, the lowest is 2150 K below the stellar temperature. One third are warm spots that are above the stellar temperature by less than $\sim$2000 K. Cold and warm spots have maximum surface coverage values of 40 percent, although only 16 percent of warm spots are above 20 percent surface coverage as opposed to 60 percent of the cold spots. Warm spots are most likely caused by a combination of plages and low density accretion columns, most common on objects without inner disc excess emission in $K-W2$. Five small hot spot solutions have $<3$ percent coverage and are 3000 - 5000 K above the stellar temperature. These are attributed to accretion, and four of them occur on the same object. The majority of our objects are likely to be accreting. However, we observe very few accretion hot spots as either the accretion is not stable on our timescale or the photometry is dominated by other features. We do not identify cyclical spot behaviour on the targets. We additionally identify and discuss a number of objects that have interesting amplitudes, phase changes, or spot properties.


title: Neural Erosion: Emulating Controlled Neurodegeneration and Aging in AI Systems

abstract: Creating controlled methods to simulate neurodegeneration in artificial intelligence (AI) is crucial for applications that emulate brain function decline and cognitive disorders. We use IQ tests performed by Large Language Models (LLMs) and, more specifically, the LLaMA 2 to introduce the concept of ``neural erosion." This deliberate erosion involves ablating synapses or neurons, or adding Gaussian noise during or after training, resulting in a controlled progressive decline in the LLMs' performance. We are able to describe the neurodegeneration in the IQ tests and show that the LLM first loses its mathematical abilities and then its linguistic abilities, while further losing its ability to understand the questions. To the best of our knowledge, this is the first work that models neurodegeneration with text data, compared to other works that operate in the computer vision domain. Finally, we draw similarities between our study and cognitive decline clinical studies involving test subjects. We find that with the application of neurodegenerative methods, LLMs lose abstract thinking abilities, followed by mathematical degradation, and ultimately, a loss in linguistic ability, responding to prompts incoherently. These findings are in accordance with human studies.


title: Detailed chemical composition of the globular cluster Sextans A GC-1 on the outskirts of the Local Group

abstract: The chemical composition of globular clusters (GCs) across the Local Group provides information on chemical abundance trends. The host galaxy, Sextans A, is a low-surface-brightness dwarf irregular galaxy located on the edge of the Local Group.We derive the dynamical mass of the GC together with the mass-to-light ratio and the abundances of the ${\alpha}$ (Mg, Ca, Ti, Si), Fe-peak (Fe, Cr, Mn, Sc, Ni), and heavy elements (Ba, Cu, Zn, Eu). Abundance ratios were determined from the analysis of an optical integrated-light spectrum of Sextans A GC-1, obtained with UVES on the VLT. We apply non-local thermodynamic equilibrium (NLTE) corrections to Mg, Ca, Ti, Fe, and Ni. The GC appears to be younger and more metal-poor than the majority of the GCs of the Milky Way, with an age of 8.6$\pm$2.7 Gyr and $\text{[Fe/H]}=-2.14\pm0.04$ dex. The calculated dynamical mass is $(5.18 \pm1.62) \times 10^5 M_{\odot}$, which results in an atypically high value of the mass-to-light ratio, 4.35$\pm$1.40 M$_{\odot}$/L$_{V \odot}$. Sextans A GC-1 has varying $\alpha$ elements - the Mg abundance is extremely low ($\text{[Mg/Fe]}=-0.79\pm0.29$), Ca and Ti are solar-scaled or mildly enhanced, and Si is enhanced. This makes the mean $\alpha$ abundance (excluding Mg) to be enhanced. The Fe-peak elements are consistent with scaled-solar or slightly enhanced abundances. Ba and Cu have sub-solar abundance ratios, while Zn and Eu are consistent with their upper limits being solar-scaled and enhanced. The composition of Sextans A GC-1 resembles the overall pattern and behaviour of GCs in the Local Group. The anomalous values are the mass-to-light ratio and the depleted abundance of Mg. There is no definite explanation for such an extreme abundance value. Variations in the initial mass function or the presence of an intermediate-mass black hole might explain the high mass-to-light ratio value.


title: Quantum nonlinear optics on the edge of small lattice fractional quantum Hall fluids

abstract: We study the quantum dynamics of the edge modes of lattice fractional quantum Hall liquids in response to time-dependent external potentials. We show that the nonlinear chiral Luttinger liquid theory provides a quantitatively accurate description even for the small lattice geometries away from the continuum limit that are available in state-of-the-art experiments. Experimentally accessible signatures of the quantized value of the bulk transverse Hall conductivity are identified both in the linear and the non-linear response to an external excitation. The strong nonlinearity induced by the open boundaries is responsible for sizable quantum blockade effects, leading to the generation of nonclassical states of the edge modes.


title: Quantum memory at nonzero temperature in a thermodynamically trivial system

abstract: Passive error correction protects logical information forever (in the thermodynamic limit) by updating the system based only on local information and few-body interactions. A paradigmatic example is the classical two-dimensional Ising model: a Metropolis-style Gibbs sampler retains the sign of the initial magnetization (a logical bit) for thermodynamically long times in the low-temperature phase. Known models of passive quantum error correction similarly exhibit thermodynamic phase transitions to a low-temperature phase wherein logical qubits are protected by thermally stable topological order. Here, in contrast, we show that constant-rate classical and quantum low-density parity check codes have no $\textit{thermodynamic}$ phase transitions at nonzero temperature, but nonetheless exhibit $\textit{ergodicity-breaking}$ dynamical transitions: below a critical nonzero temperature, the mixing time of local Gibbs sampling diverges in the thermodynamic limit. We conjecture that the circuit complexity of preparing extensive-energy states may diverge without crossing any thermodynamic transition. Fault-tolerant passive decoders, inspired by Gibbs samplers, may be amenable to measurement-free quantum error correction and may present a desirable experimental alternative to conventional quantum error correction based on syndrome measurements and active feedback.


title: Entanglement patterns of quantum chaotic Hamiltonians with a scalar U(1) charge

abstract: Our current understanding of quantum chaos hinges on the random matrix behavior (RMT) of typical states in quantum many-body systems, particularly eigenstates and their energy level statistics. Although RMT has been remarkably successful in describing `coarse' features of quantum states in chaotic regimes, it fails to capture their `finer' features, particularly those arising from spatial locality and symmetries. Here, we show that we can accurately describe the behavior of eigenstate ensembles in physical systems by using RMT ensembles with constraints that capture the key features of the physical system. We demonstrate our approach on local spin Hamiltonians with a scalar U(1) charge. By constructing constrained RMT ensembles that account for two local scalar charges playing the role of energy and magnetization, we describe the patterns of entanglement of mid-spectrum eigenstates at all lengthscales and beyond their average behavior, analytically and numerically. When defining the correspondence between quantum chaos and RMT, our work clarifies that RMT ensembles must be constrained to account for all the features of the underlying Hamiltonian, particularly spatial locality and symmetries.


title: A Classical Chiral Spin-Liquid from Chiral Interactions on the Pyrochlore Lattice

abstract: Classical spin-liquids are paramagnetic phases which feature nontrivial patterns of spin correlations within their ground-state manifold whose degeneracy scales with system size. Often they harbor fractionalized excitations, and their low-energy fluctuations are described by emergent gauge theories. In this work, we discuss a model composed of chiral three-body spin interactions on the pyrochlore lattice that realizes a novel classical chiral spin-liquid. Employing both analytical and numerical techniques, we show that the ground-state manifold of this spin-liquid is given by a subset of the so-called color-ice states. We demonstrate that the ground states are captured by an effective gauge theory which possesses a divergence-free condition and an additional chiral term that constrains the total flux of the fields through a single tetrahedron. The divergence-free condition results in two-fold pinch points in the spin structure factor and the identification of bionic charges as the elementary excitations of the system. We discuss how the mobility of these elementary charges is restricted by the additional chiral term, which in turn suggests that these charges are fractons.


title: FROST-CLUSTERS -- I. Hierarchical star cluster assembly boosts intermediate-mass black hole formation

abstract: Observations and high-resolution hydrodynamical simulations indicate that massive star clusters assemble hierarchically from sub-clusters with a universal power-law cluster mass function. We study the consequences of such assembly for the formation of intermediate-mass black holes (IMBHs) at low metallicities ($Z=0.01\;Z_\mathrm{\odot}$) with our updated N-body code BIFROST based on the hierarchical fourth-order forward integrator. BIFROST integrates few-body systems using secular and regularized techniques including post-Newtonian equations of motion up to order PN3.5 and gravitational-wave recoil kicks for BHs. Single stellar evolution is treated using the fast population synthesis code SEVN. We evolve three cluster assembly regions with $N_\mathrm{tot} = 1.70$--$2.35 \times 10^6$ stars following a realistic IMF in $\sim$1000 sub-clusters for $t=50$ Myr. IMBHs with masses up to $m_\bullet \sim 2200\:M_\mathrm{\odot}$ form rapidly mainly via the collapse of very massive stars (VMSs) assembled through repeated collisions of massive stars followed by growth through tidal disruption events and BH mergers. No IMBHs originate from the stars in the initially most massive clusters. We explain this by suppression of hard massive star binary formation at high velocity dispersions and the competition between core collapse and massive star life-times. Later the IMBHs form subsystems resulting in gravitational-wave BH-BH, IMBH-BH and IMBH-IMBH mergers with a $m_\bullet\sim1000\:M_\mathrm{\odot}$ gravitational-wave detection being the observable prediction. Our simulations indicate that the hierarchical formation of massive star clusters in metal poor environments naturally results in formation of potential seeds for supermassive black holes.


title: SurvRNC: Learning Ordered Representations for Survival Prediction using Rank-N-Contrast

abstract: Predicting the likelihood of survival is of paramount importance for individuals diagnosed with cancer as it provides invaluable information regarding prognosis at an early stage. This knowledge enables the formulation of effective treatment plans that lead to improved patient outcomes. In the past few years, deep learning models have provided a feasible solution for assessing medical images, electronic health records, and genomic data to estimate cancer risk scores. However, these models often fall short of their potential because they struggle to learn regression-aware feature representations. In this study, we propose Survival Rank-N Contrast (SurvRNC) method, which introduces a loss function as a regularizer to obtain an ordered representation based on the survival times. This function can handle censored data and can be incorporated into any survival model to ensure that the learned representation is ordinal. The model was extensively evaluated on a HEad \& NeCK TumOR (HECKTOR) segmentation and the outcome-prediction task dataset. We demonstrate that using the SurvRNC method for training can achieve higher performance on different deep survival models. Additionally, it outperforms state-of-the-art methods by 3.6% on the concordance index. The code is publicly available on https://github.com/numanai/SurvRNC


title: Open EFT for Interacting Fermions from Holography

abstract: We initiate the study of an open EFT for finite-temperature holographic systems with interacting fermions. In particular, we do this for Yukawa interactions in the bulk using the real-time formalism (grSK geometry). From the bulk perspective, this study corresponds to Yukawa scattering against a black hole, incorporating the effects of Hawking radiation. We derive an EFT in the exterior of the black hole and thus develop a Witten diagrammatic understanding of the scattering processes. This allows the explicit evaluation of boundary Schwinger-Keldysh (SK) correlators to arbitrary order, at tree-level in the bulk. Here we present explicitly the SK generating functional up to four-point functions. Finally, we represent the correlators in a column-vector representation that manifests microscopic unitarity and thermality, with all the statistical factors neatly folded in.


title: Quasinormal Modes and Universality of the Penrose Limit of Black Hole Photon Rings

abstract: We study the physics of photon rings in a wide range of axisymmetric black holes admitting a separable Hamilton-Jacobi equation for the geodesics. Utilizing the Killing-Yano tensor, we derive the Penrose limit of the black holes, which describes the physics near the photon ring. The obtained plane wave geometry is directly linked to the frequency matrix of the massless wave equation, as well as the instabilities and Lyapunov exponents of the null geodesics. Consequently, the Lyapunov exponents and frequencies of the photon geodesics, along with the quasinormal modes, can be all extracted from a Hamiltonian in the Penrose limit plane wave metric. Additionally, we explore potential bounds on the Lyapunov exponent, the orbital and precession frequencies, in connection with the corresponding inverted harmonic oscillators and we discuss the possibility of photon rings serving as holographic horizons in a holographic duality framework for astrophysical black holes. Our formalism is applicable to spacetimes encompassing various types of black holes, including stationary ones like Kerr, Kerr-Newman, as well as static black holes such as Schwarzschild, Reissner-Nordstr\"om, among others.

categories: gr-qc astro-ph.CO astro-ph.HE hep-ph hep-th


title: Cosmic Inflation: Background dynamics, Quantum fluctuations and Reheating

abstract: These lecture notes provide a pedagogical introduction to some aspects of the inflationary cosmology, including the background scalar field dynamics, generation of primordial seed perturbations via quantum fluctuations during inflation, and the process of reheating after inflation in the single-field inflationary paradigm.


title: A differential representation for holographic correlators

abstract: We present a differential representation for holographic four-point correlators. In this representation, the correlators are given by acting differential operators on certain seed functions. The number of these functions is much smaller than what is normally seen in known examples of holographic correlators, and all of them have simple Mellin amplitudes. This representation establishes a direct connection between correlators in position space and their Mellin space counterpart. The existence of this representation also imposes non-trivial constraints on the structure of holographic correlators. We illustrate these ideas by correlators in ${\rm AdS}_5 \times {\rm S}^5$ and ${\rm AdS}_5 \times {\rm S}^3$.


title: Simulations of stochastic fluid dynamics near a critical point in the phase diagram

abstract: We present simulations of stochastic fluid dynamics in the vicinity of a critical endpoint belonging to the universality class of the Ising model. This study is motivated by the challenge of modeling the dynamics of critical fluctuations near a conjectured critical endpoint in the phase diagram of Quantum Chromodynamics (QCD). We focus on the interaction of shear modes with a conserved scalar density, which is known as model H. We show that the observed dynamical scaling behavior depends on the correlation length and the shear viscosity of the fluid. As the correlation length is increased or the viscosity is decreased we observe a cross-over from the dynamical exponent of critical diffusion, $z\simeq 4$, to the expected scaling exponent of model H, $z\simeq 3$. We use our method to investigate time-dependent correlation function of non-Gaussian moments $M^n(t)$ of the order parameter. We find that the relaxation time depends in non-trivial manner on the power $n$.


title: Zooming by in the CARPoolGP lane: new CAMELS-TNG simulations of zoomed-in massive halos

abstract: Galaxy formation models within cosmological hydrodynamical simulations contain numerous parameters with non-trivial influences over the resulting properties of simulated cosmic structures and galaxy populations. It is computationally challenging to sample these high dimensional parameter spaces with simulations, particularly for halos in the high-mass end of the mass function. In this work, we develop a novel sampling and reduced variance regression method, CARPoolGP, which leverages built-in correlations between samples in different locations of high dimensional parameter spaces to provide an efficient way to explore parameter space and generate low variance emulations of summary statistics. We use this method to extend the Cosmology and Astrophysics with MachinE Learning Simulations (CAMELS) to include a set of 768 zoom-in simulations of halos in the mass range of $10^{13} - 10^{14.5} M_\odot\,h^{-1}$ that span a 28-dimensional parameter space in the IllustrisTNG model. With these simulations and the CARPoolGP emulation method, we explore parameter trends in the Compton $Y-M$, black hole mass-halo mass, and metallicity-mass relations, as well as thermodynamic profiles and quenched fractions of satellite galaxies. We use these emulations to provide a physical picture of the complex interplay between supernova and active galactic nuclei feedback. We then use emulations of the $Y-M$ relation of massive halos to perform Fisher forecasts on astrophysical parameters for future Sunyaev-Zeldovich observations and find a significant improvement in forecasted constraints. We publicly release both the simulation suite and CARPoolGP software package.


title: Sequential Monte Carlo for Inclusive KL Minimization in Amortized Variational Inference

abstract: For training an encoder network to perform amortized variational inference, the Kullback-Leibler (KL) divergence from the exact posterior to its approximation, known as the inclusive or forward KL, is an increasingly popular choice of variational objective due to the mass-covering property of its minimizer. However, minimizing this objective is challenging. A popular existing approach, Reweighted Wake-Sleep (RWS), suffers from heavily biased gradients and a circular pathology that results in highly concentrated variational distributions. As an alternative, we propose SMC-Wake, a procedure for fitting an amortized variational approximation that uses likelihood-tempered sequential Monte Carlo samplers to estimate the gradient of the inclusive KL divergence. We propose three gradient estimators, all of which are asymptotically unbiased in the number of iterations and two of which are strongly consistent. Our method interleaves stochastic gradient updates, SMC samplers, and iterative improvement to an estimate of the normalizing constant to reduce bias from self-normalization. In experiments with both simulated and real datasets, SMC-Wake fits variational distributions that approximate the posterior more accurately than existing methods.


title: Two-dimensional gauge anomalies and $p$-adic numbers

abstract: We show how methods of number theory can be used to study anomalies in gauge quantum field theories in spacetime dimension two. To wit, the anomaly cancellation conditions for the abelian part of the local anomaly admit solutions if and only if they admit solutions in the reals and in the $p$-adics for every prime $p$ and we use this to build an algorithm to find all solutions.


title: Social Optima of a Linear Quadratic Collective Choice Model under Congestion

abstract: This paper investigates the social optimum for a dynamic linear quadratic collective choice problem where a group of agents choose among multiple alternatives or destinations. The agents' common objective is to minimize the average cost of the entire population. A naive approach to finding a social optimum for this problem involves solving a number of linear quadratic regulator (LQR) problems that increases exponentially with the population size. By exploiting the problem's symmetries, we first show that one can equivalently solve a number of LQR problems equal to the number of destinations, followed by an optimal transport problem parameterized by the fraction of agents choosing each destination. Then, we further reduce the complexity of the solution search by defining an appropriate system of limiting equations, whose solution is used to obtain a strategy shown to be asymptotically optimal as the number of agents becomes large. The model includes a congestion effect captured by a negative quadratic term in the social cost function, which may cause agents to escape to infinity in finite time. Hence, we identify sufficient conditions, independent of the population size, for the existence of the social optimum. Lastly, we investigate the behavior of the model through numerical simulations in different scenarios.


title: Process-and-Forward: Deep Joint Source-Channel Coding Over Cooperative Relay Networks

abstract: This paper introduces an innovative deep joint source-channel coding (DeepJSCC) approach to image transmission over a cooperative relay channel. The relay either amplifies and forwards a scaled version of its received signal, referred to as DeepJSCC-AF, or leverages neural networks to extract relevant features about the source signal before forwarding it to the destination, which we call DeepJSCC-PF (Process-and-Forward). In the full-duplex scheme, inspired by the block Markov coding (BMC) concept, we introduce a novel block transmission strategy built upon novel vision transformer architecture. In the proposed scheme, the source transmits information in blocks, and the relay updates its knowledge about the input signal after each block and generates its own signal to be conveyed to the destination. To enhance practicality, we introduce an adaptive transmission model, which allows a single trained DeepJSCC model to adapt seamlessly to various channel qualities, making it a versatile solution. Simulation results demonstrate the superior performance of our proposed DeepJSCC compared to the state-of-the-art BPG image compression algorithm, even when operating at the maximum achievable rate of conventional decode-and-forward and compress-and-forward protocols, for both half-duplex and full-duplex relay scenarios.


title: Gentrification, displacement, and income trajectory of incumbents

abstract: Gentrification is associated with rapid demographic changes within inner-city neighborhoods. While many fear that gentrification drives low-income people from their homes and communities, there is limited evidence of the consequences of these changes. I use Canadian administrative tax files to track the movements of incumbent workers and their income trajectory as their neighborhood gentrifies. I exploit the timing at which neighborhoods gentrify in a matched staggered event-study framework. I find no evidence of displacement effects, even for low socioeconomic status households. In fact, families living in gentrifying neighborhoods are more likely to stay longer. I suggest that this might be related to tenant rights protection laws. When they endogenously decide to leave, low-income families do not relocate to worse neighborhoods. Finally, I find no adverse effects on their income trajectory, suggesting no repercussions on their labor market outcomes.