title: The density-bounded twilight of starbursts in the early Universe

abstract: The peculiar nebular emission displayed by galaxies in the early Universe presents a unique opportunity to gain insight into the regulation of star formation in extreme environments. We investigate 500 (109) galaxies with deep NIRSpec/PRISM observations from the JADES survey at $z>2$ ($z>5.3$), finding 52 (26) galaxies with Balmer line ratios more than $1\sigma$ inconsistent with Case B recombination. These anomalous Balmer emitters (ABEs) cannot be explained by dust attenuation, indicating a departure from Case B recombination. To address this discrepancy, we model density-bounded nebulae with the photoionisation code CLOUDY. Density-bounded nebulae show anomalous Balmer line ratios due to Lyman line pumping and a transition from the nebulae being optically thin to optically thick for Lyman lines with increasing cloud depth. The H$\alpha$/H$\beta$ versus H$\gamma$/H$\beta$ trend of density-bounded models is robust to changes in stellar age of the ionising source, gas density, and ionisation parameter; however, increasing the stellar metallicity drives a turnover in the trend. This is due to stronger stellar absorption features around Ly$\gamma$ reducing H$\beta$ fluorescence, allowing density-bounded models to account for all observed Balmer line ratios. ABEs show higher [OIII]/[OII], have steeper ultra-violet slopes, are fainter, and are more preferentially Ly$\alpha$ emitters than galaxies which are consistent with Case B and little dust. These findings suggest that ABEs are galaxies that have become density bounded during extreme quenching events, representing a transient phase of $\sim$20 Myr during a fast breathing mode of star formation.


title: Free Performance Gain from Mixing Multiple Partially Labeled Samples in Multi-label Image Classification

abstract: Multi-label image classification datasets are often partially labeled where many labels are missing, posing a significant challenge to training accurate deep classifiers. However, the powerful Mixup sample-mixing data augmentation cannot be well utilized to address this challenge, as it cannot perform linear interpolation on the unknown labels to construct augmented samples. In this paper, we propose LogicMix, a Mixup variant designed for such partially labeled datasets. LogicMix mixes the sample labels by logical OR so that the unknown labels can be correctly mixed by utilizing OR's logical equivalences, including the domination and identity laws. Unlike Mixup, which mixes exactly two samples, LogicMix can mix multiple ($\geq2$) partially labeled samples, constructing visually more confused augmented samples to regularize training. LogicMix is more general and effective than other compared Mixup variants in the experiments on various partially labeled dataset scenarios. Moreover, it is plug-and-play and only requires minimal computation, hence it can be easily inserted into existing frameworks to collaborate with other methods to improve model performance with a negligible impact on training time, as demonstrated through extensive experiments. In particular, through the collaboration of LogicMix, RandAugment, Curriculum Labeling, and Category-wise Fine-Tuning, we attain state-of-the-art performance on MS-COCO, VG-200, and Pascal VOC 2007 benchmarking datasets. The remarkable generality, effectiveness, collaboration, and simplicity suggest that LogicMix promises to be a popular and vital data augmentation method.


title: Achieving Dimension-Free Communication in Federated Learning via Zeroth-Order Optimization

abstract: Federated Learning (FL) offers a promising framework for collaborative and privacy-preserving machine learning across distributed data sources. However, the substantial communication costs associated with FL pose a significant challenge to its efficiency. Specifically, in each communication round, the communication costs scale linearly with the model's dimension, which presents a formidable obstacle, especially in large model scenarios. Despite various communication efficient strategies, the intrinsic dimension-dependent communication cost remains a major bottleneck for current FL implementations. In this paper, we introduce a novel dimension-free communication strategy for FL, leveraging zero-order optimization techniques. We propose a new algorithm, FedDisco, which facilitates the transmission of only a constant number of scalar values between clients and the server in each communication round, thereby reducing the communication cost from $\mathscr{O}(d)$ to $\mathscr{O}(1)$, where $d$ is the dimension of the model parameters. Theoretically, in non-convex functions, we prove that our algorithm achieves state-of-the-art rates, which show a linear speedup of the number of clients and local steps under standard assumptions and dimension-free rate for low effective rank scenarios. Empirical evaluations through classic deep learning training and large language model fine-tuning substantiate significant reductions in communication overhead compared to traditional FL approaches. Our code is available at https://github.com/ZidongLiu/FedDisco.


title: The Mariana Environmental Disaster and its Labor Market Effects

abstract: This paper examines the labor market impacts of the 2015 Mariana Dam disaster in Brazil. It contrasts two theoretical models: an urban spatial equilibrium model and a factor of production model, with diverging perspectives on environmental influences on labor outcomes. Utilizing rich national administrative and spatial data, the study reveals that the unusual environmental alteration, with minimal human capital loss, primarily affected outcomes via the factor of production channel. Nevertheless, spatial equilibrium dynamics are discernible within certain market segments. This research contributes to the growing literature on environmental changes and its economic consequences.


title: Quality-aware Masked Diffusion Transformer for Enhanced Music Generation

abstract: In recent years, diffusion-based text-to-music (TTM) generation has gained prominence, offering a novel approach to synthesizing musical content from textual descriptions. Achieving high accuracy and diversity in this generation process requires extensive, high-quality data, which often constitutes only a fraction of available datasets. Within open-source datasets, the prevalence of issues like mislabeling, weak labeling, unlabeled data, and low-quality music waveform significantly hampers the development of music generation models. To overcome these challenges, we introduce a novel quality-aware masked diffusion transformer (QA-MDT) approach that enables generative models to discern the quality of input music waveform during training. Building on the unique properties of musical signals, we have adapted and implemented a MDT model for TTM task, while further unveiling its distinct capacity for quality control. Moreover, we address the issue of low-quality captions with a caption refinement data processing approach. Our demo page is shown in https://qa-mdt.github.io/. Code on https://github.com/ivcylc/qa-mdt


title: The Singlet-Triplet Gap of Cyclobutadiene: The CIPSI-Driven CC($P$;$Q$) Study

abstract: An accurate determination of singlet-triplet gaps in biradicals, including cyclobutadiene in the automerization barrier region where one has to balance the substantial nondynamical many-electron correlation effects characterizing the singlet ground state with the predominantly dynamical correlations of the lowest-energy triplet, remains a challenge for many quantum chemistry methods. High-level coupled-cluster (CC) approaches, such as the CC method with a full treatment of singly, doubly, and triply excited clusters (CCSDT), are often capable of providing reliable results, but the routine application of such methods is hindered by their high computational costs. We have recently proposed a practical alternative to converging the CCSDT energetics at small fractions of the computational effort, even when electron correlations become stronger and connected triply excited clusters are larger and nonperturbative, by merging the CC($P$;$Q$) moment expansions with the selected configuration interaction methodology abbreviated as CIPSI. We demonstrate that one can accurately approximate the highly accurate CCSDT potential surfaces characterizing the lowest singlet and triplet states of cyclobutadiene along the automerization coordinate and the gap between them using tiny fractions of triply excited cluster amplitudes identified with the help of relatively inexpensive CIPSI Hamiltonian diagonalizations.


title: Metallic bonding in close packed structures: structural frustration from a hidden gauge symmetry

abstract: Based on its simple valence electron configuration, we may expect lithium to have straightforward physical properties that are easily explained. However, solid lithium, when cooled below 77 K, develops a complex structure that has been debated for decades. A close parallel is found in sodium below 36 K where the crystal structure still remains unresolved. In this letter, we explore a possible driving force behind this complexity. We begin with the observation that Li and Na form close-packed structures at low temperatures. We demonstrate a gauge symmetry that forces \textit{all} close-packed structures to have the same electronic energy and, in fact, the very same band structure. This symmetry requires two conditions: (a) bands must arise from $s$ orbitals, and (b) hoppings beyond second-nearest neighbours must be negligible. We argue that both can be reasonably invoked in Li and Na. When these conditions are satisfied, we have extensive degeneracy with the number of competing iso-energetic structures growing exponentially with linear system size. Weak effects, such as $p$-orbital admixture, long-range hopping and phonon zero-point energy, can break this symmetry. These can play a decisive role in `selecting' one particular ordered structure. This point of view may explain the occurrence of ordered structures in Li and Na under pressure. Our results suggest that martensitic transitions may also occur in heavier alkali metals such as potassium.


title: Governing the Commons: Code Ownership and Code-Clones in Large-Scale Software Development

abstract: Context: In software development organizations employing weak or collective ownership, different teams are allowed and expected to autonomously perform changes in various components. This creates diversity both in the knowledge of, and in the responsibility for, individual components. Objective: Our objective is to understand how and why different teams introduce technical debt in the form of code clones as they change different components. Method: We collected data about change size and clone introductions made by ten teams in eight components which was part of a large industrial software system. We then designed a Multi-Level Generalized Linear Model (MLGLM), to illustrate the teams' differing behavior. Finally, the results were reported to the studied organization, responses were recorded and thematically coded. Results: The results show that teams do behave differently in different components, and the feedback from the teams indicates that this method of illustrating team behavior can be useful as a complement to traditional summary statistics of ownership. Conclusions: We find that our model-based approach produces useful visualizations of team introductions of code clones as they change different components. Practitioners stated that the visualizations gave them insights that were useful, and by comparing with an average team, inter-team comparisons can be avoided. Thus, this has the potential to be a useful feedback tool for teams in software development organizations that employ weak or collective ownership.


title: Improving Neutrino Energy Reconstruction with Machine Learning

abstract: Faithful energy reconstruction is foundational for precision neutrino experiments like DUNE, but is hindered by uncertainties in our understanding of neutrino--nucleus interactions. Here, we demonstrate that dense neural networks are very effective in overcoming these uncertainties by estimating inaccessible kinematic variables based on the observable part of the final state. We find improvements in the energy resolution by up to a factor of two compared to conventional reconstruction algorithms, which translates into an improved physics performance equivalent to a 10-30% increase in the exposure.


title: LLS: Local Learning Rule for Deep Neural Networks Inspired by Neural Activity Synchronization

abstract: Training deep neural networks (DNNs) using traditional backpropagation (BP) presents challenges in terms of computational complexity and energy consumption, particularly for on-device learning where computational resources are limited. Various alternatives to BP, including random feedback alignment, forward-forward, and local classifiers, have been explored to address these challenges. These methods have their advantages, but they can encounter difficulties when dealing with intricate visual tasks or demand considerable computational resources. In this paper, we propose a novel Local Learning rule inspired by neural activity Synchronization phenomena (LLS) observed in the brain. LLS utilizes fixed periodic basis vectors to synchronize neuron activity within each layer, enabling efficient training without the need for additional trainable parameters. We demonstrate the effectiveness of LLS and its variations, LLS-M and LLS-MxM, on multiple image classification datasets, achieving accuracy comparable to BP with reduced computational complexity and minimal additional parameters. Furthermore, the performance of LLS on the Visual Wake Word (VWW) dataset highlights its suitability for on-device learning tasks, making it a promising candidate for edge hardware implementations.


title: Dual topological insulator with mirror-symmetry-protected helical edge states

abstract: Dual topological insulators (DTIs) are simultaneously protected by time-reversal and crystal symmetries, representing advantageous alternatives to conventional topological insulators. By combining ab initio calculations and the $\mathbf{k}\cdot\mathbf{p}$ approach, here we investigate the electronic band structure of a Na$_2$CdSn tri-atomic layer and derive a low-energy $4\times 4$ effective model consistent with all the symmetries of this material class. We obtain the effective Hamiltonian using the L\"owdin perturbation theory, the folding down technique, and the theory of invariants, and determine its parameters by fitting our analytical dispersion relations to those of ab initio calculations. We then calculate the bulk topological invariants of the system and show that the Na$_2$CdSn tri-atomic layer is a giant-gap (hundreds of meV) quasi-2D DTI characterized by both spin and mirror Chern numbers $-2$. In agreement with the bulk-boundary correspondence theorem, we find that a finite-width strip of Na$_2$CdSn possesses two pairs of counter-propagating helical edge states per interface. We obtain analytical expressions for the edge states energy dispersions and wave functions, which are shown to agree with our numerical calculations. Our work opens a new avenue for further studies of Na$_2$CdSn as a potential DTI candidate with room-temperature applications in areas of technological interest, such as nanoelectronics and spintronics.


title: Extended Solitons of the Ambient Obstruction Flow

abstract: In this paper we expand on the work of the first author on ambient obstruction solitons, which are self-similar solutions to the ambient obstruction flow. Our main result is to show that any closed ambient obstruction soliton is ambient obstruction flat and has constant scalar curvature. We show, in fact, that the first part of this result is true for a more general extended soliton equation where we allow an arbitrary conformal factor to be added to the equation. We discuss how this implies that, on a compact manifold, the ambient obstruction flow has no fixed points up to conformal diffeomorphism other than ambient obstruction flat metrics. These results are the consequence of a general integral inequality that can be applied to the solitons to any geometric flow. Additionally, we use these results to obtain a generalization of the Bourguignon-Ezin identity on a closed Riemannian manifold and study the converse problem on a closed extended $q$-soliton. We also study this extended equation further in the case of homogeneous and product metrics.


title: CausalConceptTS: Causal Attributions for Time Series Classification using High Fidelity Diffusion Models

abstract: Despite the excelling performance of machine learning models, understanding the decisions of machine learning models remains a long-standing goal. While commonly used attribution methods in explainable AI attempt to address this issue, they typically rely on associational rather than causal relationships. In this study, within the context of time series classification, we introduce a novel framework to assess the causal effect of concepts, i.e., predefined segments within a time series, on specific classification outcomes. To achieve this, we leverage state-of-the-art diffusion-based generative models to estimate counterfactual outcomes. Our approach compares these causal attributions with closely related associational attributions, both theoretically and empirically. We demonstrate the insights gained by our approach for a diverse set of qualitatively different time series classification tasks. Although causal and associational attributions might often share some similarities, in all cases they differ in important details, underscoring the risks associated with drawing causal conclusions from associational data alone. We believe that the proposed approach is widely applicable also in other domains, particularly where predefined segmentations are available, to shed some light on the limits of associational attributions.


title: Extended Reality (XR) Codec Adaptation in 5G using Multi-Agent Reinforcement Learning with Attention Action Selection

abstract: Extended Reality (XR) services will revolutionize applications over 5th and 6th generation wireless networks by providing seamless virtual and augmented reality experiences. These applications impose significant challenges on network infrastructure, which can be addressed by machine learning algorithms due to their adaptability. This paper presents a Multi- Agent Reinforcement Learning (MARL) solution for optimizing codec parameters of XR traffic, comparing it to the Adjust Packet Size (APS) algorithm. Our cooperative multi-agent system uses an Optimistic Mixture of Q-Values (oQMIX) approach for handling Cloud Gaming (CG), Augmented Reality (AR), and Virtual Reality (VR) traffic. Enhancements include an attention mechanism and slate-Markov Decision Process (MDP) for improved action selection. Simulations show our solution outperforms APS with average gains of 30.1%, 15.6%, 16.5% 50.3% in XR index, jitter, delay, and Packet Loss Ratio (PLR), respectively. APS tends to increase throughput but also packet losses, whereas oQMIX reduces PLR, delay, and jitter while maintaining goodput.


title: Ramp from Replica Trick

abstract: We compute the spectral form factor of the modular Hamiltonian $K=-\ln\rho_A$ associated to the reduced density matrix of a Haar random state. A ramp is demonstrated and we find an analytic expression for its slope. Our method involves an application of the replica trick, where we first calculate the correlator $<\text{tr}\rho_A^n\;\text{tr}\rho_A^m>$ at large bond dimension and then analytically continue the indices $n,m$ from integers to arbitrary complex numbers. We use steepest descent methods at large modular times to extract the ramp. The large bond dimension limit of the replicated partition function is dominated by a sum over \emph{annular non-crossing permutations}. We explored the similarity between our results and calculations of the spectral form factor in low dimensional gravitational theories where the ramp is determined by the double trumpet geometry. We find there is an underlying resemblance in the two calculations, when we interpret the annular non-crossing permutations as representing a discretized version of the double trumpet. Similar results are found for an equilibrated pure state in place of the Haar random state.


title: Dark Energy Model in Einstein and Horava-Lifshitz Gravity with a new Parametrization of $\omega(z)$: Model Comparison, Analysis and Observational Constraint

abstract: We present a novel dynamical dark energy model within the frameworks of both Einstein gravity and Horava-Lifshitz gravity. Utilizing a new parametrization of the dark energy equation of state $\omega(z)$, we derive solutions to the field equations. By employing recent cosmological datasets, such as cosmic chronometer datasets, Type Ia Supernovae datasets, Baryonic Oscillation datasets, and the recent Hubble constant value measured by the Hubble Space Telescope and the SH0ES Team as an additional prior. We validate our model and determine optimal parameter values. Furthermore, we analyze the evolution of the Universe by showing the redshift dependence plots of key cosmological parameters through graphical representations. We also perform diagnostic analyses to compare our model with the standard model. Using the Akaike Information Criterion (AIC), we compare the three models and find that all of them are supported by the current data, making it impossible to discard any of them. Our model aligns well with recent observations and unveils intriguing features of the Universe, particularly the late-time behavior of the Universe.


title: Analysis of thermochemical non-equilibrium hypersonic flow over a waverider with uncertainty quantification

abstract: The objective of this work is to assess the impact of parameter uncertainty on hypersonic aerothermal surface heating predictions in Reynolds-Averaged Navier-Stokes (RANS) simulations using non-intrusive uncertainty quantification (UQ) techniques. RANS-based models are considered indispensable tools in computational fluid dynamics (CFD) analysis for the iterative and cost-effective exploration of innovative design concepts. However, these RANS models heavily rely on empirical constants that often require tuning due to the lack of physical knowledge and complexity of the problem, introducing significant uncertainties that hinder their predictive capabilities. Therefore, this research investigates the influence of the turbulent Prandtl number uncertainty, that governs the level of shear stress and heat flux present in the turbulent flow, on key output quantities of interest (QoIs). The US3D hypersonics solver is employed to simulate aeroheating over a hypersonic waverider configuration using the classical Menter Shear Stress Transport (SST) turbulence model. A polynomial chaos expansion (PEC) framework is presented that enables a global sensitivity analysis and forward propagation of uncertainty for a range of turbulent prandtl number, generating statistics including skewness and kurtosis of the QoIs. In addition, Sobol indices are calculated to quantify the relative contribution of the turbulent prandtl number to the overall uncertainty in the heat flux and surface pressure outputs. The results provide valuable insights into the underlying aeroheating behavior in RANS simulations under hypersonic non-equilibrium flow conditions over a waverider previously studied at the Arnold Engineering Development Center (AEDC) facility. These findings will inform future design processes and improve the reliability of RANS-based predictions in hypersonic applications.


title: Quantum Phase Transition in a Modified Jaynes-Cummings Model

abstract: We introduce a modified Jaynes-Cummings model with single-photon cavity radiation field but with the atomic system instead of exchanging a single photon as in the Jaynes-Cummings model, it exchanges instead a squeezed photon with squeezing parameter r. This allows us to interpolate between the Rabi model, r = infinity, and the Jaynes-Cummings model, r = 0, by varying r. The model exhibits a quantum phase transition. Accordingly, the quantum phase transition realized in the Rabi model, giving rise to superradiance, also occurs in the Jaynes-Cummings model


title: Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications

abstract: Large language models (LLMs) significantly enhance the performance of various applications, but they are computationally intensive and energy-demanding. This makes it challenging to deploy them on devices with limited resources, such as personal computers and mobile/wearable devices, and results in substantial inference costs in resource-rich environments like cloud servers. To extend the use of LLMs, we introduce a low-rank decomposition approach to effectively compress these models, tailored to the requirements of specific applications. We observe that LLMs pretrained on general datasets contain many redundant components not needed for particular applications. Our method focuses on identifying and removing these redundant parts, retaining only the necessary elements for the target applications. Specifically, we represent the weight matrices of LLMs as a linear combination of base components. We then prune the irrelevant bases and enhance the model with new bases beneficial for specific applications. Deep compression results on the Llama 2-7b and -13B models, conducted on target applications including mathematical reasoning and code generation, show that our method significantly reduces model size while maintaining comparable accuracy to state-of-the-art low-rank compression techniques.


title: Constraints on compact dark matter from the non-observation of gravitational-wave strong lensing

abstract: We use the non-observation of strong lensing of gravitational waves (GWs) in the first three observation runs of LIGO-Virgo detectors to constrain the fraction of dark matter in the form of compact objects in the mass range $10^{6}-10^{9}~{\mathrm{M}_\odot}$. Using a Bayesian formalism supplemented by astrophysical simulations of strong lensing of GWs, we constrain the compact dark matter fraction to $\lesssim 0.4-0.6$ with currently available data and show that they may get significantly tighter in the future. We find that multiple lensing -- i.e., GWs getting deflected by multiple compact objects on their way to us -- is possible. By ignoring this, we underestimate the constraints by a few percent.


title: Global Output-Feedback Extremum Seeking Control with Source Seeking Experiments

abstract: This paper discusses the design of an extremum seeking controller that relies on a monitoring function for a class of SISO uncertain nonlinear systems characterized by arbitrary and uncertain relative degree. Our demonstration illustrates the feasibility of achieving an arbitrarily small proximity to the desired optimal point through output feedback. The core concept involves integrating a monitoring function with a norm state observer for the unitary relative degree case and its expansion to arbitrary relative degrees by means of the employment of a time-scaling technique. Significantly, our proposed scheme attains the extremum of an unknown nonlinear mapping across the entire domain of initial conditions, ensuring global convergence and stability for the real-time optimization algorithm. Furthermore, we provide tuning rules to ensure convergence to the global maximum in the presence of local extrema. To validate the effectiveness of the proposed approach, we present a numerical example and apply it to a source-seeking problem involving a cart-track linear positioning servomechanism. Notably, the cart lacks the ability to sense its velocity or the source's position, but can detect the source of a light signal of unknown concentration field.


title: HYSYNTH: Context-Free LLM Approximation for Guiding Program Synthesis

abstract: Many structured prediction and reasoning tasks can be framed as program synthesis problems, where the goal is to generate a program in a domain-specific language (DSL) that transforms input data into the desired output. Unfortunately, purely neural approaches, such as large language models (LLMs), often fail to produce fully correct programs in unfamiliar DSLs, while purely symbolic methods based on combinatorial search scale poorly to complex problems. Motivated by these limitations, we introduce a hybrid approach, where LLM completions for a given task are used to learn a task-specific, context-free surrogate model, which is then used to guide program synthesis. We evaluate this hybrid approach on three domains, and show that it outperforms both unguided search and direct sampling from LLMs, as well as existing program synthesizers.


title: Scaling Diffusion Mamba with Bidirectional SSMs for Efficient Image and Video Generation

abstract: In recent developments, the Mamba architecture, known for its selective state space approach, has shown potential in the efficient modeling of long sequences. However, its application in image generation remains underexplored. Traditional diffusion transformers (DiT), which utilize self-attention blocks, are effective but their computational complexity scales quadratically with the input length, limiting their use for high-resolution images. To address this challenge, we introduce a novel diffusion architecture, Diffusion Mamba (DiM), which foregoes traditional attention mechanisms in favor of a scalable alternative. By harnessing the inherent efficiency of the Mamba architecture, DiM achieves rapid inference times and reduced computational load, maintaining linear complexity with respect to sequence length. Our architecture not only scales effectively but also outperforms existing diffusion transformers in both image and video generation tasks. The results affirm the scalability and efficiency of DiM, establishing a new benchmark for image and video generation techniques. This work advances the field of generative models and paves the way for further applications of scalable architectures.


title: Risk Factor Identification In Osteoporosis Using Unsupervised Machine Learning Techniques

abstract: In this study, the reliability of identified risk factors associated with osteoporosis is investigated using a new clustering-based method on electronic medical records. This study proposes utilizing a new CLustering Iterations Framework (CLIF) that includes an iterative clustering framework that can adapt any of the following three components: clustering, feature selection, and principal feature identification. The study proposes using Wasserstein distance to identify principal features, borrowing concepts from the optimal transport theory. The study also suggests using a combination of ANOVA and ablation tests to select influential features from a data set. Some risk factors presented in existing works are endorsed by our identified significant clusters, while the reliability of some other risk factors is weakened.


title: The estimation of parameters of generalized cosmic Chaplygin gas and viscous modified Chaplygin gas and Accretions around Black Hole in the background of Einstein-Aether gravity

abstract: In this paper, we have investigated the phenomenon of accelerated cosmic expansion in the late universe and the mass accretion process of a 4-dimensional Einstein-Aether black hole. Starting with the basics of Einstein-Aether gravity theory, we have first considered the field equations and two eminent models of Chaplygin gas, viz. generalized cosmic Chaplygin gas model and viscous modified Chaplygin gas model. Then, we obtained the energy density and Hubble parameters equations for these models in terms of some dimensionless density parameters and some unknown parameters. After finding the required parameters, we proceeded with the mass accretion process. For both models, we obtained the equation of mass in terms of the redshift function and represented the change of mass of the black hole graphically with redshift. At the same time, we have made a graphical comparison between the above-mentioned models and the $\Lambda$CDM model of the universe. Eventually, we have concluded that the mass of a 4-dimensional black hole will increase along the universe's evolution in the backdrop of Einstein-Aether gravity.


title: Charge pumping in hBN-encapsulated graphene driven by surface acoustic waves

abstract: Surface acoustic waves (SAWs) on piezoelectric insulators can generate dynamic periodic potentials inside one-dimensional and two-dimensional materials. These periodic potentials have been utilized or proposed for various applications, including acoustoelectric charge pumping. In this study, we investigate acoustoelectric charge pumping in graphene with very low electrostatic disorder. By employing a graphite top gate on boron-nitride-encapsulated graphene, we adjust the graphene carrier concentration over a broad range, enabling us to examine the acoustoelectric signal in both mixed-carrier and single-carrier regimes. We discuss the benefits of hBN-encapsulated graphene for charge pumping applications and introduce a model that describes the acoustoelectric signal across all carrier concentrations, including at the charge neutrality point. This quantitative model will support future SAW-enabled explorations of phenomena in low-dimensional materials and guide the design of novel SAW sensors.


title: Diffusion Bridge Implicit Models

abstract: Denoising diffusion bridge models (DDBMs) are a powerful variant of diffusion models for interpolating between two arbitrary paired distributions given as endpoints. Despite their promising performance in tasks like image translation, DDBMs require a computationally intensive sampling process that involves the simulation of a (stochastic) differential equation through hundreds of network evaluations. In this work, we present diffusion bridge implicit models (DBIMs) for accelerated sampling of diffusion bridges without extra training. We generalize DDBMs via a class of non-Markovian diffusion bridges defined on the discretized timesteps concerning sampling, which share the same training objective as DDBMs. These generalized diffusion bridges give rise to generative processes ranging from stochastic to deterministic (i.e., an implicit probabilistic model) while being up to 25$\times$ faster than the vanilla sampler of DDBMs. Moreover, the deterministic sampling procedure yielded by DBIMs enables faithful encoding and reconstruction by a booting noise used in the initial sampling step, and allows us to perform semantically meaningful interpolation in image translation tasks by regarding the booting noise as the latent variable.


title: A Neurosymbolic Framework for Bias Correction in CNNs

abstract: Recent efforts in interpreting Convolutional Neural Networks (CNNs) focus on translating the activation of CNN filters into stratified Answer Set Programming (ASP) rule-sets. The CNN filters are known to capture high-level image concepts, thus the predicates in the rule-set are mapped to the concept that their corresponding filter represents. Hence, the rule-set effectively exemplifies the decision-making process of the CNN in terms of the concepts that it learns for any image classification task. These rule-sets help expose and understand the biases in CNNs, although correcting the biases effectively remains a challenge. We introduce a neurosymbolic framework called NeSyBiCor for bias correction in a trained CNN. Given symbolic concepts that the CNN is biased towards, expressed as ASP constraints, we convert the undesirable and desirable concepts to their corresponding vector representations. Then, the CNN is retrained using our novel semantic similarity loss that pushes the filters away from the representations of concepts that are undesirable while pushing them closer to the concepts that are desirable. The final ASP rule-set obtained after retraining, satisfies the constraints to a high degree, thus showing the revision in the knowledge of the CNN for the image classification task. We demonstrate that our NeSyBiCor framework successfully corrects the biases of CNNs trained with subsets of classes from the Places dataset while sacrificing minimal accuracy and improving interpretability, by greatly decreasing the size of the final bias-corrected rule-set w.r.t. the initial rule-set.


title: Data-adaptive exposure thresholds for the Horvitz-Thompson estimator of the Average Treatment Effect in experiments with network interference

abstract: Randomized controlled trials often suffer from interference, a violation of the Stable Unit Treatment Values Assumption (SUTVA) in which a unit's treatment assignment affects the outcomes of its neighbors. This interference causes bias in naive estimators of the average treatment effect (ATE). A popular method to achieve unbiasedness is to pair the Horvitz-Thompson estimator of the ATE with a known exposure mapping: a function that identifies which units in a given randomization are not subject to interference. For example, an exposure mapping can specify that any unit with at least $h$-fraction of its neighbors having the same treatment status does not experience interference. However, this threshold $h$ is difficult to elicit from domain experts, and a misspecified threshold can induce bias. In this work, we propose a data-adaptive method to select the "$h$"-fraction threshold that minimizes the mean squared error of the Hortvitz-Thompson estimator. Our method estimates the bias and variance of the Horvitz-Thompson estimator under different thresholds using a linear dose-response model of the potential outcomes. We present simulations illustrating that our method improves upon non-adaptive choices of the threshold. We further illustrate the performance of our estimator by running experiments on a publicly-available Amazon product similarity graph. Furthermore, we demonstrate that our method is robust to deviations from the linear potential outcomes model.


title: Cross-polarized stimulated Brillouin scattering empowered photonics

abstract: This paper explores the integration of cross-polarized stimulated Brillouin scattering (XP-SBS) with Kerr and quadratic nonlinearities in lithium niobate (LN) to enhance photonic device performance. Three novel applications are demonstrated: (i) a reconfigurable stimulated Brillouin laser (SBL) with 0.7-Hz narrow linewidth and 40-nm tunability, enabled by XP-SBS's thermo-optic phase matching; (ii) an efficient coherent mode converter achieving 55% conversion efficiency via intracavity Brillouin-enhanced four-wave mixing; (iii) a Brillouin-quadratic laser and frequency comb operational in near-infrared and visible bands, benefiting from the interaction between XP-SBS and quadratic nonlinearity. These advancements promise significant improvements in photonic technologies, including narrow-linewidth laser, microcomb generation, and optical signal processing, paving the way for more robust and versatile applications.


title: Dual Inflation and Bounce Cosmologies Interpretation of Pulsar Timing Array Data

abstract: We explore a dual scenario of generalized inflation and bounce cosmologies, producing a scale-invariant curvature perturbation spectrum. Bayesian analysis with pulsar timing array data identifies, for the first time, viable regions from inflation and bounce that simultaneously explain stochastic gravitational wave background (SGWB) signals and CMB anisotropies. Bayes factor calculations strongly favor this dual scenario over conventional sources and provide initial evidence of a duality between inflation and bounce regarding SGWB, offering new insights for early universe model-building and future observations.


title: Conformal trajectories in 3-dimensional space form

abstract: We introduce the notion of conformal trajectories in three-dimensional Riemannian manifolds $M^3$. Given a conformal vector field $V\in\mathfrak{X}(M^3)$, a conformal trajectory of $V$ is a regular curve $\gamma$ in $M^3$ satisfying $\nabla_{\gamma'}\gamma'=q\, V\times\gamma'$, for some fixed non-zero constant $q\in {\mathbb{R}}$. In this paper, we study conformal trajectories in the space forms ${\mathbb{R}}^3$, ${\mathbb{S}}^3$ and ${\mathbb{H}}^3$. For (non-Killing) conformal vector fields in ${\mathbb{S}}^3$ (respectively in ${\mathbb{H}}^3$), we prove that conformal trajectories have constant curvature and its torsion is a linear combination of trigonometric (respectively hyperbolic) functions on the arc-length parameter. In the case of Euclidean space ${\mathbb{R}}^3$, we obtain the same result for the radial vector field and characterising all conformal trajectories.


title: Score Distillation via Reparametrized DDIM

abstract: While 2D diffusion models generate realistic, high-detail images, 3D shape generation methods like Score Distillation Sampling (SDS) built on these 2D diffusion models produce cartoon-like, over-smoothed shapes. To help explain this discrepancy, we show that the image guidance used in Score Distillation can be understood as the velocity field of a 2D denoising generative process, up to the choice of a noise term. In particular, after a change of variables, SDS resembles a high-variance version of Denoising Diffusion Implicit Models (DDIM) with a differently-sampled noise term: SDS introduces noise i.i.d. randomly at each step, while DDIM infers it from the previous noise predictions. This excessive variance can lead to over-smoothing and unrealistic outputs. We show that a better noise approximation can be recovered by inverting DDIM in each SDS update step. This modification makes SDS's generative process for 2D images almost identical to DDIM. In 3D, it removes over-smoothing, preserves higher-frequency detail, and brings the generation quality closer to that of 2D samplers. Experimentally, our method achieves better or similar 3D generation quality compared to other state-of-the-art Score Distillation methods, all without training additional neural networks or multi-view supervision, and providing useful insights into relationship between 2D and 3D asset generation with diffusion models.


title: Many-body systems with spurious modular commutators

abstract: Recently, it was proposed that the chiral central charge of a gapped, two-dimensional quantum many-body system is proportional to a bulk ground state entanglement measure known as the modular commutator. While there is significant evidence to support this relation, we show in this paper that it is not universal. We give examples of lattice systems that have vanishing chiral central charge which nevertheless give nonzero "spurious" values for the modular commutator for arbitrarily large system sizes, in both one and two dimensions. Our examples are based on cluster states and utilize the fact that they can generate nonlocal modular Hamiltonians.


title: Quantifying Influencer Effects on Affective Polarization

abstract: In an era where digital platforms increasingly mediate public discourse, grasping the complexities and nuances in affective polarization--especially as influenced by key figures on social media--has never been more vital. This study delves into the intricate web of interactions on Twitter, now rebranded as 'X', to unravel how influencer-led conversations catalyze shifts in public sentiment, laying bare the complex dynamics that underpin online polarization. Employing a novel methodological framework that includes counterfactual analysis, we analyze scenarios with and without specific influencer-led conversations. Our findings illuminate the significant role influencers play in shaping public discourse, offering insights into the mechanisms of online polarization and suggesting pathways for future research to mitigate divisiveness and explore new methods for quantifying affective polarization. This research contributes to the broader understanding of digital communication's impact on societal polarization, underscoring the importance of detailed analysis in developing strategies to foster a more cohesive digital public sphere.


title: Derivatives of Stochastic Gradient Descent

abstract: We consider stochastic optimization problems where the objective depends on some parameter, as commonly found in hyperparameter optimization for instance. We investigate the behavior of the derivatives of the iterates of Stochastic Gradient Descent (SGD) with respect to that parameter and show that they are driven by an inexact SGD recursion on a different objective function, perturbed by the convergence of the original SGD. This enables us to establish that the derivatives of SGD converge to the derivative of the solution mapping in terms of mean squared error whenever the objective is strongly convex. Specifically, we demonstrate that with constant step-sizes, these derivatives stabilize within a noise ball centered at the solution derivative, and that with vanishing step-sizes they exhibit $O(\log(k)^2 / k)$ convergence rates. Additionally, we prove exponential convergence in the interpolation regime. Our theoretical findings are illustrated by numerical experiments on synthetic tasks.


title: Predicting the Impact of Model Expansion through the Minima Manifold: A Loss Landscape Perspective

abstract: The optimal model for a given task is often challenging to determine, requiring training multiple models from scratch which becomes prohibitive as dataset and model sizes grow. A more efficient alternative is to reuse smaller pre-trained models by expanding them, however, this is not widely adopted as how this impacts training dynamics remains poorly understood. While prior works have introduced statistics to measure these effects, they remain flawed. To rectify this, we offer a new approach for understanding and quantifying the impact of expansion through the lens of the loss landscape, which has been shown to contain a manifold of linearly connected minima. Building on this new perspective, we propose a metric to study the impact of expansion by estimating the size of the manifold. Experimental results show a clear relationship between gains in performance and manifold size, enabling the comparison of candidate models and presenting a first step towards expanding models more reliably based on geometric properties of the loss landscape.


title: Enhancing Augmentative and Alternative Communication with Card Prediction and Colourful Semantics

abstract: This paper presents an approach to enhancing Augmentative and Alternative Communication (AAC) systems by integrating Colourful Semantics (CS) with transformer-based language models specifically tailored for Brazilian Portuguese. We introduce an adapted BERT model, BERTptCS, which incorporates the CS framework for improved prediction of communication cards. The primary aim is to enhance the accuracy and contextual relevance of communication card predictions, which are essential in AAC systems for individuals with complex communication needs (CCN). We compared BERTptCS with a baseline model, BERTptAAC, which lacks CS integration. Our results demonstrate that BERTptCS significantly outperforms BERTptAAC in various metrics, including top-k accuracy, Mean Reciprocal Rank (MRR), and Entropy@K. Integrating CS into the language model improves prediction accuracy and offers a more intuitive and contextual understanding of user inputs, facilitating more effective communication.


title: On the path ideals of chordal graphs

abstract: In this article, we give combinatorial formulas for the regularity and the projective dimension of $3$-path ideals of chordal graphs, extending the well-known formulas for the edge ideals of chordal graphs given in terms of the induced matching number and the big height, respectively. As a consequence, we get that the $3$-path ideal of a chordal graph is Cohen-Macaulay if and only if it is unmixed. Additionally, we show that the Alexander dual of the $3$-path ideal of a tree is vertex splittable, thereby resolving the $t=3$ case of a recent conjecture in [Internat. J. Algebra Comput., 33(3):481--498, 2023]. Also, we give examples of chordal graphs where the duals of their $t$-path ideals are not vertex splittable for $t\ge 3$. Furthermore, we extend the formula of the regularity of $3$-path ideals of chordal graphs to all $t$-path ideals of caterpillar graphs. We then provide some families of graphs to show that these formulas for the regularity and the projective dimension cannot be extended to higher $t$-path ideals of chordal graphs (even in the case of trees).


title: Thermodynamics of Sodium-Lead Alloys for Negative Electrodes from First-Principles

abstract: Metals, such as tin, antimony, and lead (Pb) have garnered renewed attention for their potential use as alloyant-negative electrode materials in sodium (Na)-ion batteries (NIBs). Despite Pb's toxicity and its high molecular weight, lead is one of the most commonly recycled metals, positioning Pb as a promising candidate for a cost-effective, high-capacity anode material. Understanding the miscibility of Na into Pb is crucial for the development of high-energy density negative electrode materials for NIBs. Using a first-principles multiscale approach, we analyze the thermodynamic properties and estimate the Na-alloying voltage of the Na-Pb system by constructing the compositional phase diagram. In the Pb-Na system, we elucidate the phase boundaries of important phases, such as Pb-rich face-centered cubic and $\beta$-NaPb$_3$, thereby improving our understanding of the phase diagram of the Na-Pb alloy. Due to the strong ordering tendencies of the Na-Pb intermetallics (such as NaPb, Na$_5$Pb$_2$, and Na$_{15}$Pb$_4$), we do not observe any solid-solution behavior at intermediate and high Na concentrations.


title: A new dynamic slip approach for wall-modeled Large Eddy Simulations in a Consistent Discontinuous Galerkin Framework

abstract: A wall-modeled large eddy simulation approach is proposed in a Discontinuous Galerkin (DG) setting, building on the slip-wall concept of Bae et al. (JFM'19) and the universal scaling relationship by Pradhan and Duraisamy (JFM'23). The effect of the order of the DG approximation is introduced via the length scales in the formulation. The level of under-resolution is represented by a slip Reynolds number and the model attempts to also incorporate the effects of the numerical discretization and the subgrid-scale model. The dynamic part of the new model is based on a modified form of Germano identity -- performed on the universal scaling parameter -- and is coupled with the dynamic Smagorinsky model. A sharp modal cut-off filter is used as the test filter for the dynamic procedure, and the dynamic model can be easily integrated into any DG solver. Numerical experiments on channel flows show that grid independence of the statistics is achievable and predictions for the mean velocity and Reynolds stress profiles agree well with the DNS, even with significant under-resolution. When applied to flows with separation and reattachment, the model also consistently predicts one-point statistics in the reverse flow and post-reattachment regions in good agreement with experiments. The performance of the model in accurately predicting equilibrium and separated flows using significantly under-resolved meshes can be attributed to several aspects that work synergistically: the optimal finite-element projection framework; the interplay of the scale-separation and numerical discretization within the DG framework; and the consistent dynamic procedures for subgrid and wall modeling.


title: Searching for groups related to pseudo-composition algebras

abstract: We study the class of idempotent-generated pseudo-composition algebras, which is a subclass of the family of axial algebras. More specifically, we utilise the group-algebra correspondence, natural to the axial framework in order to study some automorphism subgroups of such pseudo-composition algebras.


title: A Survey on Application Layer Protocols for IoT Networks

abstract: Nowadays, all sectors utilize devices that are part of the Internet of Things (IoT) for the purpose of connecting and exchanging information with other devices and systems over the Internet. This increases the diversity of devices and their working environments, which, in turn, creates new challenges, such as real-time interaction, security, interoperability, performance, and robustness of IoT systems. To address these, many applications protocols were adopted and developed for devices with constrained resources. This paper surveys communication protocols divided according to their goals along with their merits, demerits, and suitability towards IoT applications. We summarize the challenges of communication protocols as well as some relevant solutions.


title: Hacc-Man: An Arcade Game for Jailbreaking LLMs

abstract: The recent leaps in complexity and fluency of Large Language Models (LLMs) mean that, for the first time in human history, people can interact with computers using natural language alone. This creates monumental possibilities of automation and accessibility of computing, but also raises severe security and safety threats: When everyone can interact with LLMs, everyone can potentially break into the systems running LLMs. All it takes is creative use of language. This paper presents Hacc-Man, a game which challenges its players to "jailbreak" an LLM: subvert the LLM to output something that it is not intended to. Jailbreaking is at the intersection between creative problem solving and LLM security. The purpose of the game is threefold: 1. To heighten awareness of the risks of deploying fragile LLMs in everyday systems, 2. To heighten people's self-efficacy in interacting with LLMs, and 3. To discover the creative problem solving strategies, people deploy in this novel context.


title: UnitNorm: Rethinking Normalization for Transformers in Time Series

abstract: Normalization techniques are crucial for enhancing Transformer models' performance and stability in time series analysis tasks, yet traditional methods like batch and layer normalization often lead to issues such as token shift, attention shift, and sparse attention. We propose UnitNorm, a novel approach that scales input vectors by their norms and modulates attention patterns, effectively circumventing these challenges. Grounded in existing normalization frameworks, UnitNorm's effectiveness is demonstrated across diverse time series analysis tasks, including forecasting, classification, and anomaly detection, via a rigorous evaluation on 6 state-of-the-art models and 10 datasets. Notably, UnitNorm shows superior performance, especially in scenarios requiring robust attention mechanisms and contextual comprehension, evidenced by significant improvements by up to a 1.46 decrease in MSE for forecasting, and a 4.89% increase in accuracy for classification. This work not only calls for a reevaluation of normalization strategies in time series Transformers but also sets a new direction for enhancing model performance and stability. The source code is available at https://anonymous.4open.science/r/UnitNorm-5B84.


title: Generalized Ramsey numbers of cycles, paths, and hypergraphs

abstract: Given a $k$-uniform hypergraph $G$ and a set of $k$-uniform hypergraphs $\mathcal{H}$, the generalized Ramsey number $f(G,\mathcal{H},q)$ is the minimum number of colors needed to edge-color $G$ so that every copy of every hypergraph $H\in \mathcal{H}$ in $G$ receives at least $q$ different colors. In this note we obtain bounds, some asymptotically sharp, on several generalized Ramsey numbers, when $G=K_n$ or $G=K_{n,n}$ and $\mathcal{H}$ is a set of cycles or paths, and when $G=K_n^k$ and $\mathcal{H}$ contains a clique on $k+2$ vertices or a tight cycle.


title: Tangent space functional reconfigurations in individuals at risk for alcohol use disorder

abstract: Human brain function dynamically adjusts to ever-changing stimuli from the external environment. Studies characterizing brain functional reconfiguration are nevertheless scarce. Here we present a principled mathematical framework to quantify brain functional reconfiguration when engaging and disengaging from a stop signal task (SST). We apply tangent space projection (a Riemannian geometry mapping technique) to transform functional connectomes (FCs) and quantify functional reconfiguration using the correlation distance of the resulting tangent-FCs. Our goal was to compare functional reconfigurations in individuals at risk for alcohol use disorder (AUD). We hypothesized that functional reconfigurations when transitioning in/from a task would be influenced by family history of alcohol use disorder (FHA) and other AUD risk factors. Multilinear regression model results showed that engaging and disengaging functional reconfiguration were driven by different AUD risk factors. Functional reconfiguration when engaging in the SST was negatively associated with recent drinking. When disengaging from the SST, however, functional reconfiguration was negatively associated with FHA. In both models, several other factors contributed to the explanation of functional reconfiguration. This study demonstrates that tangent-FCs can characterize task-induced functional reconfiguration, and that it is related to AUD risk.


title: Vavilov-\v{C}erenkov radiation for parallel motion in three-dimensional topological insulators

abstract: Our study delves into the modifications observed in Vavilov-\v{C}erenkov radiation when its generating charged particle moves parallel to an interface formed by two generic magnetoelectric media, focusing on topological insulators. We compute the electromagnetic field through the Green's function. Applying the far-field approximation and the steepest descent method, we derive analytical expressions for the electric field, revealing contributions from spherical and lateral waves with topological origins. Subsequently, we analyze the angular distribution of the radiation, particularly focusing on parallel motions in close proximity to the interface. Our findings indicate that the radiation along the Vavilov-\v{C}erenkov cone is inhomogeneous and asymmetric. We analyze the radiated energy at both sides of the interface. Finally, we discuss the particle's retarding force, which is notably enhanced in the ultrarelativistic regime. We illustrate these results for the topological insulator TlBiSe$_2$ and the magnetoelectric TbPO$_4$.


title: Belief-State Query Policies for Planning With Preferences Under Partial Observability

abstract: Planning in real-world settings often entails addressing partial observability while aligning with users' preferences. We present a novel framework for expressing users' preferences about agent behavior in a partially observable setting using parameterized belief-state query (BSQ) preferences in the setting of goal-oriented partially observable Markov decision processes (gPOMDPs). We present the first formal analysis of such preferences and prove that while the expected value of a BSQ preference is not a convex function w.r.t its parameters, it is piecewise constant and yields an implicit discrete parameter search space that is finite for finite horizons. This theoretical result leads to novel algorithms that optimize gPOMDP agent behavior while guaranteeing user preference compliance. Theoretical analysis proves that our algorithms converge to the optimal preference-compliant behavior in the limit. Empirical results show that BSQ preferences provide a computationally feasible approach for planning with preferences in partially observable settings.


title: Knowledge-Informed Auto-Penetration Testing Based on Reinforcement Learning with Reward Machine

abstract: Automated penetration testing (AutoPT) based on reinforcement learning (RL) has proven its ability to improve the efficiency of vulnerability identification in information systems. However, RL-based PT encounters several challenges, including poor sampling efficiency, intricate reward specification, and limited interpretability. To address these issues, we propose a knowledge-informed AutoPT framework called DRLRM-PT, which leverages reward machines (RMs) to encode domain knowledge as guidelines for training a PT policy. In our study, we specifically focus on lateral movement as a PT case study and formulate it as a partially observable Markov decision process (POMDP) guided by RMs. We design two RMs based on the MITRE ATT\&CK knowledge base for lateral movement. To solve the POMDP and optimize the PT policy, we employ the deep Q-learning algorithm with RM (DQRM). The experimental results demonstrate that the DQRM agent exhibits higher training efficiency in PT compared to agents without knowledge embedding. Moreover, RMs encoding more detailed domain knowledge demonstrated better PT performance compared to RMs with simpler knowledge.


title: Investigating Turbulence Effects on Magnetic Reconnection Rates Through High-Resolution Three-Dimensional Resistive Magnetohydrodynamical Simulations

abstract: We investigate the impact of turbulence on magnetic reconnection through high-resolution 3D MHD simulations, covering Lundquist numbers from $S=10^3$ to $10^6$. Our simulations introduce small-scale perturbations injected into the system until $t=0.1\, t_A$. Even after the initial perturbation ceases, turbulence grows and persists, leading to sustained high reconnection rates of $V_\text{rec}/V_A \sim 0.03-0.08$, which surpass those generated solely by resistive tearing modes (plasmoids) observed in 2D and 3D PIC/MHD simulations by factors of 5 to 6. Our findings reveal that the achieved reconnection rates align with observations in solar phenomena and those reported in 3D MHD global simulations of accretion flows and relativistic jets. Notably, our simulations exhibit a steady-state reconnection rate coinciding with the full development of turbulence, showcasing the robustness and persistence of the reconnection in a turbulent environment. We establish the independence of the reconnection rate from the Lundquist number, consistent with the theory of turbulent reconnection proposed by Lazarian and Vishniac. Our results demonstrate a mild dependence of $V_\text{rec}$ on the plasma-$\beta$ parameter, the ratio between the thermal and magnetic pressure, illustrating a decrease from $0.036$ to $0.028$ as $\beta$ increases from $2$ to $64$ for simulations with $S=10^5$. Finally, we explore the influence of the magnetic Prandtl number ($\text{Pr}_m=\nu/\eta$) on the reconnection rate and find this influence to be negligible during the turbulent regime across the range tested, from $\text{Pr}_m=1$ to $60$. These findings carry significant implications for research into reconnection and particle acceleration within realistic magnetized space and astrophysical environments.


title: On asymptotic B-convexity and infratype

abstract: In this note, we introduce and study the notions of asymptotic B-convexity and asymptotic infratype $p$, and we prove asymptotic analogs of a series of results due to Giesy \cite{Giesy66} and Pisier \cite{Pisier74}. In particular, we give a simplified proof of an asymptotic version of Pisier's $\ell_1$-theorem that was originally proven by Causey, Draga, and Kochanek in \cite{CDK19}. We also briefly discuss the notion of asymptotic stable type.


title: Learning accurate and interpretable decision trees

abstract: Decision trees are a popular tool in machine learning and yield easy-to-understand models. Several techniques have been proposed in the literature for learning a decision tree classifier, with different techniques working well for data from different domains. In this work, we develop approaches to design decision tree learning algorithms given repeated access to data from the same domain. We propose novel parameterized classes of node splitting criteria in top-down algorithms, which interpolate between popularly used entropy and Gini impurity based criteria, and provide theoretical bounds on the number of samples needed to learn the splitting function appropriate for the data at hand. We also study the sample complexity of tuning prior parameters in Bayesian decision tree learning, and extend our results to decision tree regression. We further consider the problem of tuning hyperparameters in pruning the decision tree for classical pruning algorithms including min-cost complexity pruning. We also study the interpretability of the learned decision trees and introduce a data-driven approach for optimizing the explainability versus accuracy trade-off using decision trees. Finally, we demonstrate the significance of our approach on real world datasets by learning data-specific decision trees which are simultaneously more accurate and interpretable.


title: Uncertainty Quantification for Neurosymbolic Programs via Compositional Conformal Prediction

abstract: Machine learning has become an effective tool for automatically annotating unstructured data (e.g., images) with structured labels (e.g., object detections). As a result, a new programming paradigm called neurosymbolic programming has emerged where users write queries against these predicted annotations. However, due to the intrinsic fallibility of machine learning models, these programs currently lack any notion of correctness. In many domains, users may want some kind of conservative guarantee that the results of their queries contain all possibly relevant instances. Conformal prediction has emerged as a promising strategy for quantifying uncertainty in machine learning by modifying models to predict sets of labels instead of individual labels; it provides a probabilistic guarantee that the prediction set contains the true label with high probability. We propose a novel framework for adapting conformal prediction to neurosymbolic programs; our strategy is to represent prediction sets as abstract values in some abstract domain, and then to use abstract interpretation to propagate prediction sets through the program. Our strategy satisfies three key desiderata: (i) correctness (i.e., the program outputs a prediction set that contains the true output with high probability), (ii) compositionality (i.e., we can quantify uncertainty separately for different modules and then compose them together), and (iii) structured values (i.e., we can provide uncertainty quantification for structured values such as lists). When the full program is available ahead-of-time, we propose an optimization that incorporates conformal prediction at intermediate program points to reduce imprecision in abstract interpretation. We evaluate our approach on programs that take MNIST and MS-COCO images as input, demonstrating that it produces reasonably sized prediction sets while satisfying a coverage guarantee.


title: Scaling up the Banded Matrix Factorization Mechanism for Differentially Private ML

abstract: DP-BandMF offers a powerful approach to differentially private machine learning, balancing privacy amplification with noise correlation for optimal noise reduction. However, its scalability has been limited to settings where the number of training iterations is less than $10^4$. In this work, we present techniques that significantly extend DP-BandMF's reach, enabling use in settings with and over $10^6$ training iterations. Our enhanced implementation, coupled with extensive experiments, provides clear guidelines on selecting the optimal number of bands. These insights offer practitioners a deeper understanding of DP-BandMF's performance and how to maximize its utility for privacy-preserving machine learning.


title: ExactDreamer: High-Fidelity Text-to-3D Content Creation via Exact Score Matching

abstract: Text-to-3D content creation is a rapidly evolving research area. Given the scarcity of 3D data, current approaches often adapt pre-trained 2D diffusion models for 3D synthesis. Among these approaches, Score Distillation Sampling (SDS) has been widely adopted. However, the issue of over-smoothing poses a significant limitation on the high-fidelity generation of 3D models. To address this challenge, LucidDreamer replaces the Denoising Diffusion Probabilistic Model (DDPM) in SDS with the Denoising Diffusion Implicit Model (DDIM) to construct Interval Score Matching (ISM). However, ISM inevitably inherits inconsistencies from DDIM, causing reconstruction errors during the DDIM inversion process. This results in poor performance in the detailed generation of 3D objects and loss of content. To alleviate these problems, we propose a novel method named Exact Score Matching (ESM). Specifically, ESM leverages auxiliary variables to mathematically guarantee exact recovery in the DDIM reverse process. Furthermore, to effectively capture the dynamic changes of the original and auxiliary variables, the LoRA of a pre-trained diffusion model implements these exact paths. Extensive experiments demonstrate the effectiveness of ESM in text-to-3D generation, particularly highlighting its superiority in detailed generation.


title: From inverse-cascade to sub-diffusive dynamic scaling in driven disordered Bose fluids

abstract: We explore the emergence of universal dynamic scaling in an interacting Bose gas around the condensation transition, under the combined influence of an external driving force and spatial disorder. As time progresses, we find that the Bose gas crosses over three distinct dynamical regimes: (i) an inverse turbulent cascade where interactions dominate the drive, (ii) a stationary regime where the inverse cascade and the drive counterbalance one other, and (iii) a sub-diffusive cascade in energy space governed by the drive and disorder, a phenomenon recently observed experimentally. We show that all three dynamical regimes can be described by self-similar scaling laws.


title: Recasting Generic Pretrained Vision Transformers As Object-Centric Scene Encoders For Manipulation Policies

abstract: Generic re-usable pre-trained image representation encoders have become a standard component of methods for many computer vision tasks. As visual representations for robots however, their utility has been limited, leading to a recent wave of efforts to pre-train robotics-specific image encoders that are better suited to robotic tasks than their generic counterparts. We propose Scene Objects From Transformers, abbreviated as SOFT, a wrapper around pre-trained vision transformer (PVT) models that bridges this gap without any further training. Rather than construct representations out of only the final layer activations, SOFT individuates and locates object-like entities from PVT attentions, and describes them with PVT activations, producing an object-centric embedding. Across standard choices of generic pre-trained vision transformers PVT, we demonstrate in each case that policies trained on SOFT(PVT) far outstrip standard PVT representations for manipulation tasks in simulated and real settings, approaching the state-of-the-art robotics-aware representations. Code, appendix and videos: https://sites.google.com/view/robot-soft/


title: Increasingly global convergence of Hermite serie

abstract: We study the convergence of the Hermite series of measurable functions on the real line. We characterize the norm convergence of truncated partial Hermite sums in rearrangement invariant spaces provided that the truncations vanish sufficiently slowly. Moreover, we provide the necessary and sufficient conditions for convergence in the Orlicz modular.


title: Efficient Model Reduction and Prediction of Superharmonic Resonances in Frictional and Hysteretic Systems

abstract: Modern engineering structures exhibit nonlinear vibration behavior as designs are pushed to reduce weight and energy consumption. Of specific interest here, joints in assembled structures introduce friction, hysteresis, and unilateral contact resulting in nonlinear vibration effects. In many cases, it is impractical to remove jointed connections necessitating, the understanding of these behaviors. This work focuses on superharmonic and internal resonances in hysteretic and jointed systems. Superharmonic resonances occur when a nonlinear system is forced at an integer fraction of a natural frequency resulting in a large (locally maximal) response at an integer multiple of the forcing frequency. When a second vibration mode simultaneously responds in resonance at the forcing frequency, the combined phenomena is termed an internal resonance. First, variable phase resonance nonlinear modes (VPRNM) is extended to track superharmonic resonances in multiple degree of freedom systems exhibiting hysteresis. Then a novel reduced order model based on VPRNM (VPRNM ROM) is proposed to reconstruct frequency response curves faster than utilizing the harmonic balance method (HBM). The VPRNM ROM is demonstrated for a 3 degree of freedom system with a 3:1 internal resonance and for the jointed Half Brake-Reuss Beam (HBRB), which exhibits a 7:1 internal resonance. For the HBRB, new experimental results are used to validate the modeling approaches, and a previously developed physics-based friction model is further validated, achieving frequency predictions within 3%. For the considered cases, VPRNM ROM construction is up to 4 times faster than HBM, and the evaluation of the VPRNM ROM is up to 780,000 times faster than HBM. The modeling shows that both tangential slipping and normal direction clapping of the joint play important roles in exciting the superharmonic resonances in the HBRB.


title: The K2 Asteroseismic KEYSTONE sample of Dwarf and Subgiant Solar-Like Oscillators. I: Data and Asteroseismic parameters

abstract: The KEYSTONE project aims to enhance our understanding of solar-like oscillators by delivering a catalogue of global asteroseismic parameters (${\Delta\nu}$ and ${\nu_{\rm max}}$) for 173 stars, comprising mainly dwarfs and subgiants, observed by the K2 mission in its short-cadence mode during campaigns 6-19. We derive atmospheric parameters and luminosities using spectroscopic data from TRES, astrometric data from $\textit{Gaia}$, and the infrared flux method (IRFM) for a comprehensive stellar characterisation. Asteroseismic parameters are robustly extracted using three independent methods, complemented by an iterative refinement of the spectroscopic analyses using seismic ${\log g}$ values to enhance parameter accuracy. Our analysis identifies new detections of solar-like oscillations in 159 stars, providing an important complement to already published results from previous campaigns. The catalogue provides homogeneously derived atmospheric parameters and luminosities for the majority of the sample. Comparison between spectroscopic ${T_{\rm eff}}$ and those obtained from the IRFM demonstrates excellent agreement. The iterative approach to spectroscopic analysis significantly enhances the accuracy of the stellar properties derived.


title: SF-DQN: Provable Knowledge Transfer using Successor Feature for Deep Reinforcement Learning

abstract: This paper studies the transfer reinforcement learning (RL) problem where multiple RL problems have different reward functions but share the same underlying transition dynamics. In this setting, the Q-function of each RL problem (task) can be decomposed into a successor feature (SF) and a reward mapping: the former characterizes the transition dynamics, and the latter characterizes the task-specific reward function. This Q-function decomposition, coupled with a policy improvement operator known as generalized policy improvement (GPI), reduces the sample complexity of finding the optimal Q-function, and thus the SF \& GPI framework exhibits promising empirical performance compared to traditional RL methods like Q-learning. However, its theoretical foundations remain largely unestablished, especially when learning the successor features using deep neural networks (SF-DQN). This paper studies the provable knowledge transfer using SFs-DQN in transfer RL problems. We establish the first convergence analysis with provable generalization guarantees for SF-DQN with GPI. The theory reveals that SF-DQN with GPI outperforms conventional RL approaches, such as deep Q-network, in terms of both faster convergence rate and better generalization. Numerical experiments on real and synthetic RL tasks support the superior performance of SF-DQN \& GPI, aligning with our theoretical findings.


title: Remarks on potential mean field games

abstract: In this expository article, we give an overview of the concept of potential mean field games of first order. We give a new proof that minimizers of the potential are equilibria by using a Lagrangian formulation. We also provide criteria to determine whether or not a game has a potential. Finally, we discuss in some depth the selection problem in mean field games, which consists in choosing one out of multiple Nash equilibria.


title: Investigation of the burst phenomenon in SiPMs at liquid nitrogen temperature

abstract: Burst effect of Silicon Photomultiplier (SiPM) at cryogenic temperatures have been discovered few years ago looking at the dark count rate of SiPMs at liquid nitrogen temperatures. Bursts are trains of single signals that happen randomly and are clearly distinguishable from the primary DCR and correlated noise because of their particular time distribution. In this article we describe a detailed study related to both the external causes that triggers bursts and to the phenomenon, internal to the sensor, that produces this dark signals. We related the burst occurrence to the luminescence produced by some trapping centers in the SiPMs when they are excited by ionizing radiation that impinges on the sensor.


title: Spiketrum: An FPGA-based Implementation of a Neuromorphic Cochlea

abstract: This paper presents a novel FPGA-based neuromorphic cochlea, leveraging the general-purpose spike-coding algorithm, Spiketrum. The focus of this study is on the development and characterization of this cochlea model, which excels in transforming audio vibrations into biologically realistic auditory spike trains. These spike trains are designed to withstand neural fluctuations and spike losses while accurately encapsulating the spatial and precise temporal characteristics of audio, along with the intensity of incoming vibrations. Noteworthy features include the ability to generate real-time spike trains with minimal information loss and the capacity to reconstruct original signals. This fine-tuning capability allows users to optimize spike rates, achieving an optimal balance between output quality and power consumption. Furthermore, the integration of a feedback system into Spiketrum enables selective amplification of specific features while attenuating others, facilitating adaptive power consumption based on application requirements. The hardware implementation supports both spike-based and non-spike-based processors, making it versatile for various computing systems. The cochlea's ability to encode diverse sensory information, extending beyond sound waveforms, positions it as a promising sensory input for current and future spike-based intelligent computing systems, offering compact and real-time spike train generation.


title: SLIDE: A Framework Integrating Small and Large Language Models for Open-Domain Dialogues Evaluation

abstract: The long-standing one-to-many problem of gold standard responses in open-domain dialogue systems presents challenges for automatic evaluation metrics. Though prior works have demonstrated some success by applying powerful Large Language Models (LLMs), existing approaches still struggle with the one-to-many problem, and exhibit subpar performance in domain-specific scenarios. We assume the commonsense reasoning biases within LLMs may hinder their performance in domainspecific evaluations. To address both issues, we propose a novel framework SLIDE (Small and Large Integrated for Dialogue Evaluation), that leverages both a small, specialised model (SLM), and LLMs for the evaluation of open domain dialogues. Our approach introduces several techniques: (1) Contrastive learning to differentiate between robust and non-robust response embeddings; (2) A novel metric for semantic sensitivity that combines embedding cosine distances with similarity learned through neural networks, and (3) a strategy for incorporating the evaluation results from both the SLM and LLMs. Our empirical results demonstrate that our approach achieves state-of-the-art performance in both the classification and evaluation tasks, and additionally the SLIDE evaluator exhibits better correlation with human judgements. Our code is available at https:// github.com/hegehongcha/SLIDE-ACL2024.


title: MUCM-Net: A Mamba Powered UCM-Net for Skin Lesion Segmentation

abstract: Skin lesion segmentation is key for early skin cancer detection. Challenges in automatic segmentation from dermoscopic images include variations in color, texture, and artifacts of indistinct lesion boundaries. Deep learning methods like CNNs and U-Net have shown promise in addressing these issues. To further aid early diagnosis, especially on mobile devices with limited computing power, we present MUCM-Net. This efficient model combines Mamba State-Space Models with our UCM-Net architecture for improved feature learning and segmentation. MUCM-Net's Mamba-UCM Layer is optimized for mobile deployment, offering high accuracy with low computational needs. Tested on ISIC datasets, it outperforms other methods in accuracy and computational efficiency, making it a scalable tool for early detection in settings with limited resources. Our MUCM-Net source code is available for research and collaboration, supporting advances in mobile health diagnostics and the fight against skin cancer. In order to facilitate accessibility and further research in the field, the MUCM-Net source code is https://github.com/chunyuyuan/MUCM-Net


title: Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers

abstract: Despite the remarkable empirical performance of Transformers, their theoretical understanding remains elusive. Here, we consider a deep multi-head self-attention network, that is closely related to Transformers yet analytically tractable. We develop a statistical mechanics theory of Bayesian learning in this model, deriving exact equations for the network's predictor statistics under the finite-width thermodynamic limit, i.e., $N,P\rightarrow\infty$, $P/N=\mathcal{O}(1)$, where $N$ is the network width and $P$ is the number of training examples. Our theory shows that the predictor statistics are expressed as a sum of independent kernels, each one pairing different 'attention paths', defined as information pathways through different attention heads across layers. The kernels are weighted according to a 'task-relevant kernel combination' mechanism that aligns the total kernel with the task labels. As a consequence, this interplay between attention paths enhances generalization performance. Experiments confirm our findings on both synthetic and real-world sequence classification tasks. Finally, our theory explicitly relates the kernel combination mechanism to properties of the learned weights, allowing for a qualitative transfer of its insights to models trained via gradient descent. As an illustration, we demonstrate an efficient size reduction of the network, by pruning those attention heads that are deemed less relevant by our theory.

categories: cs.LG cond-mat.dis-nn cond-mat.stat-mech stat.ML


title: Application based Evaluation of an Efficient Spike-Encoder, "Spiketrum"

abstract: Spike-based encoders represent information as sequences of spikes or pulses, which are transmitted between neurons. A prevailing consensus suggests that spike-based approaches demonstrate exceptional capabilities in capturing the temporal dynamics of neural activity and have the potential to provide energy-efficient solutions for low-power applications. The Spiketrum encoder efficiently compresses input data using spike trains or code sets (for non-spiking applications) and is adaptable to both hardware and software implementations, with lossless signal reconstruction capability. The paper proposes and assesses Spiketrum's hardware, evaluating its output under varying spike rates and its classification performance with popular spiking and non-spiking classifiers, and also assessing the quality of information compression and hardware resource utilization. The paper extensively benchmarks both Spiketrum hardware and its software counterpart against state-of-the-art, biologically-plausible encoders. The evaluations encompass benchmarking criteria, including classification accuracy, training speed, and sparsity when using encoder outputs in pattern recognition and classification with both spiking and non-spiking classifiers. Additionally, they consider encoded output entropy and hardware resource utilization and power consumption of the hardware version of the encoders. Results demonstrate Spiketrum's superiority in most benchmarking criteria, making it a promising choice for various applications. It efficiently utilizes hardware resources with low power consumption, achieving high classification accuracy. This work also emphasizes the potential of encoders in spike-based processing to improve the efficiency and performance of neural computing systems.


title: PatchProt: Hydrophobic patch prediction using protein foundation models

abstract: Hydrophobic patches on protein surfaces play important functional roles in protein-protein and protein-ligand interactions. Large hydrophobic surfaces are also involved in the progression of aggregation diseases. Predicting exposed hydrophobic patches from a protein sequence has been shown to be a difficult task. Fine-tuning foundation models allows for adapting a model to the specific nuances of a new task using a much smaller dataset. Additionally, multi-task deep learning offers a promising solution for addressing data gaps, simultaneously outperforming single-task methods. In this study, we harnessed a recently released leading large language model ESM-2. Efficient fine-tuning of ESM-2 was achieved by leveraging a recently developed parameter-efficient fine-tuning method. This approach enabled comprehensive training of model layers without excessive parameters and without the need to include a computationally expensive multiple sequence analysis. We explored several related tasks, at local (residue) and global (protein) levels, to improve the representation of the model. As a result, our fine-tuned ESM-2 model, PatchProt, cannot only predict hydrophobic patch areas but also outperforms existing methods at predicting primary tasks, including secondary structure and surface accessibility predictions. Importantly, our analysis shows that including related local tasks can improve predictions on more difficult global tasks. This research sets a new standard for sequence-based protein property prediction and highlights the remarkable potential of fine-tuning foundation models enriching the model representation by training over related tasks.


title: Product Design Using Generative Adversarial Network: Incorporating Consumer Preference and External Data

abstract: The development of generative artificial intelligence (AI) enables large-scale product design automation. However, this automated process usually does not incorporate consumer preference information from the internal dataset of a company. Furthermore, external sources such as social media and user-generated content (UGC) websites often contain rich product design and consumer preference information, but such information is not utilized by companies when generating designs. We propose a semi-supervised deep generative framework that integrates consumer preferences and external data into the product design process, allowing companies to generate consumer-preferred designs in a cost-effective and scalable way. We train a predictor model to learn consumer preferences and use predicted popularity levels as additional input labels to guide the training procedure of a continuous conditional generative adversarial network (CcGAN). The CcGAN can be instructed to generate new designs with a certain popularity level, enabling companies to efficiently create consumer-preferred designs and save resources by avoiding the development and testing of unpopular designs. The framework also incorporates existing product designs and consumer preference information from external sources, which is particularly helpful for small or start-up companies that have limited internal data and face the "cold-start" problem. We apply the proposed framework to a real business setting by helping a large self-aided photography chain in China design new photo templates. We show that our proposed model performs well in terms of generating appealing template designs for the company.


title: ArguSense: Argument-Centric Analysis of Online Discourse

abstract: How can we model arguments and their dynamics in online forum discussions? The meteoric rise of online forums presents researchers across different disciplines with an unprecedented opportunity: we have access to texts containing discourse between groups of users generated in a voluntary and organic fashion. Most prior work so far has focused on classifying individual monological comments as either argumentative or not argumentative. However, few efforts quantify and describe the dialogical processes between users found in online forum discourse: the structure and content of interpersonal argumentation. Modeling dialogical discourse requires the ability to identify the presence of arguments, group them into clusters, and summarize the content and nature of clusters of arguments within a discussion thread in the forum. In this work, we develop ArguSense, a comprehensive and systematic framework for understanding arguments and debate in online forums. Our framework consists of methods for, among other things: (a) detecting argument topics in an unsupervised manner; (b) describing the structure of arguments within threads with powerful visualizations; and (c) quantifying the content and diversity of threads using argument similarity and clustering algorithms. We showcase our approach by analyzing the discussions of four communities on the Reddit platform over a span of 21 months. Specifically, we analyze the structure and content of threads related to GMOs in forums related to agriculture or farming to demonstrate the value of our framework.


title: Implementation of CU gates and its application in a remote-controlled quantum operation

abstract: Recently, remote-controlled quantum information processing has been proposed for its applications in secure quantum processing protocols and distributed quantum networks. For remote-controlled quantum gates, the experimental realization of controlled unitary (CU) gates between any quantum gates is an essential task. Here, we propose and experimentally demonstrate a scheme for implementing CU gates between arbitrary pairs of unitary gates using the polarization and time-bin degrees of freedom of single-photons. Then, we experimentally implement remote-controlled single-qubit unitary gates by controlling either the state preparation or measurement of the control qubit with high process fidelities. We believe that the proposed remote-controlled quantum gate model can pave the way for secure and efficient quantum information processing.


title: Steerable Transformers

abstract: In this work we introduce Steerable Transformers, an extension of the Vision Transformer mechanism that maintains equivariance to the special Euclidean group $\mathrm{SE}(d)$. We propose an equivariant attention mechanism that operates on features extracted by steerable convolutions. Operating in Fourier space, our network utilizes Fourier space non-linearities. Our experiments in both two and three dimensions show that adding a steerable transformer encoder layer to a steerable convolution network enhances performance.


title: New Higgses at the Electroweak Scale and Differential $t\bar t$ Distributions

abstract: Indications for new Higgs bosons at 95\,GeV and 152\,GeV with significance of 3.8$\sigma$ and $4.3\sigma$, respectively, have been obtained. While the former contains the inclusive $\gamma\gamma$ channel, the latter is obtained by combining several modes of associated di-photon production, i.e. $\gamma\gamma+X$ with $X=\ell,\,\ell b,\,{\rm MET},\,\tau,\,...$, within the $\Delta$SM (the Standard Model extended by a real triplet). Such a triplet predicts a positive definite shift in the $W$ mass, in agreement with the current global electroweak fit, and its neutral component decays dominantly to $W$ bosons (for small mixing angles). This offers a connection to $t\bar t$ differential distributions whose experimental signature is $WW b\bar b$: A simplified model with a new scalar $H$, produced via gluon fusion and decaying to $S$ and $S^\prime$ with subsequent (dominant) decays to $WW$ and $b\bar b$, respectively, has the same final state. In fact, adding this new physics polution to the Standard Model describes the leptonic $t\bar t$ distributions better by at least $5.8\sigma$. Furthermore, assuming that $S^\prime$ is an $SU(2)_L$ singlet, the resulting di-photon signal strength is compatible with the 95\,GeV $\gamma\gamma$ measurements. A possible UV completion of this simplified model is the $\Delta$2HDMS, i.e. a 2HDM supplemented with a singlet and a real triplet, which can successfully accommodate electroweak scale Baryogenesis.


title: Clustering Survival Data using a Mixture of Non-parametric Experts

abstract: Survival analysis aims to predict the timing of future events across various fields, from medical outcomes to customer churn. However, the integration of clustering into survival analysis, particularly for precision medicine, remains underexplored. This study introduces SurvMixClust, a novel algorithm for survival analysis that integrates clustering with survival function prediction within a unified framework. SurvMixClust learns latent representations for clustering while also predicting individual survival functions using a mixture of non-parametric experts. Our evaluations on five public datasets show that SurvMixClust creates balanced clusters with distinct survival curves, outperforms clustering baselines, and competes with non-clustering survival models in predictive accuracy, as measured by the time-dependent c-index and log-rank metrics.


title: Optimizing Secrecy Codes Using Gradient Descent

abstract: Recent theoretical developments in coset coding theory have provided continuous-valued functions which give the equivocation and maximum likelihood (ML) decoding probability of coset secrecy codes. In this work, we develop a method for incorporating these functions, along with a complex set of constraints, into a gradient descent optimization algorithm. This algorithm employs a movement cost function and trigonometric update step to ensure that the continuous-valued code definition vector ultimately reaches a value which yields a realizable coset code. This algorithm is used to produce coset codes with blocklength up to a few thousand. These codes were compared against published codes, including both short-blocklength and capacity-achieving constructions. For most code sizes, codes generated using gradient descent outperformed all others, especially capacity-achieving constructions, which performed significantly worse than randomly-generated codes at short blocklength.


title: Zero-Shot Spam Email Classification Using Pre-trained Large Language Models

abstract: This paper investigates the application of pre-trained large language models (LLMs) for spam email classification using zero-shot prompting. We evaluate the performance of both open-source (Flan-T5) and proprietary LLMs (ChatGPT, GPT-4) on the well-known SpamAssassin dataset. Two classification approaches are explored: (1) truncated raw content from email subject and body, and (2) classification based on summaries generated by ChatGPT. Our empirical analysis, leveraging the entire dataset for evaluation without further training, reveals promising results. Flan-T5 achieves a 90% F1-score on the truncated content approach, while GPT-4 reaches a 95% F1-score using summaries. While these initial findings on a single dataset suggest the potential for classification pipelines of LLM-based subtasks (e.g., summarisation and classification), further validation on diverse datasets is necessary. The high operational costs of proprietary models, coupled with the general inference costs of LLMs, could significantly hinder real-world deployment for spam filtering.


title: On 5D Black Brane Stabilities from M-theory on Three Parameter Calabi-Yau Threefolds

abstract: In this work, we reconsider the study of 5D black branes in M-theory compactifications by means of $\mathcal{N}=2$ supergravity formalism. Precisely, we provide a model relaying on a three parameter Calabi-Yau manifold in the $\mathbb{P}^{1}\times\mathbb{P}^{1}\times\mathbb{P}^{2}$ projective space factorization, referred to as economical model. First, we investigate the stability of 5D BPS and non-BPS black holes obtained from wrapped M2-branes on non-holomorphic two-cycles in such a Calabi-Yau manifold. Then, we approach the stability of 5D black strings derived from wrapped M5-branes on non-holomorphic four-cycles. Among others, we find various stable and unstable black brane solutions depending on the charge regions of the involved moduli space.


title: Optimized Signal Estimation in Nanomechanical Photothermal Sensing via Thermal Response Modelling and Kalman Filtering

abstract: We present an advanced thermal response model for micro- and nanomechanical systems in photothermal sensing, designed to balance speed and precision. Our model considers the two time constants of the nanomechanical element and the supporting chip, triggered by photothermal heating, enabling precise photothermal input signal estimation through Kalman filtering. By integrating heat transfer and noise models, we apply an adaptive Kalman filter optimized for FPGA systems in real-time or offline. This method, used for photothermal infrared (IR) spectroscopy with nanomechanical resonators and a quantum cascade laser (QCL) in step-scan mode, enhances response speed beyond standard low-pass filters, reducing the effects of drift and random walk. Analytical calculations show the significant impact of the thermal expansion coefficients' ratio on the frequency response. The adaptive Kalman filter, informed by the QCL's input characteristics, accelerates the system's response, allowing rapid and precise IR spectrum generation. The use of the Levenberg-Marquardt algorithm and PSD analysis for system identification further refines our approach, promising fast and accurate nanomechanical photothermal sensing.