title: Discovering Knowledge-Critical Subnetworks in Pretrained Language Models

abstract: Pretrained language models (LMs) encode implicit representations of knowledge in their parameters. However, localizing these representations and disentangling them from each other remains an open problem. In this work, we investigate whether pretrained language models contain various knowledge-critical subnetworks: particular sparse computational subgraphs responsible for encoding specific knowledge the model has memorized. We propose a multi-objective differentiable weight masking scheme to discover these subnetworks and show that we can use them to precisely remove specific knowledge from models while minimizing adverse effects on the behavior of the original language model. We demonstrate our method on multiple GPT2 variants, uncovering highly sparse subnetworks (98%+) that are solely responsible for specific collections of relational knowledge. When these subnetworks are removed, the remaining network maintains most of its initial capacity (modeling language and other memorized relational knowledge) but struggles to express the removed knowledge, and suffers performance drops on examples needing this removed knowledge on downstream tasks after finetuning.


title: Batch-less stochastic gradient descent for compressive learning of deep regularization for image denoising

abstract: We consider the problem of denoising with the help of prior information taken from a database of clean signals or images. Denoising with variational methods is very efficient if a regularizer well adapted to the nature of the data is available. Thanks to the maximum a posteriori Bayesian framework, such regularizer can be systematically linked with the distribution of the data. With deep neural networks (DNN), complex distributions can be recovered from a large training database.To reduce the computational burden of this task, we adapt the compressive learning framework to the learning of regularizers parametrized by DNN. We propose two variants of stochastic gradient descent (SGD) for the recovery of deep regularization parameters from a heavily compressed database. These algorithms outperform the initially proposed method that was limited to low-dimensional signals, each iteration using information from the whole database. They also benefit from classical SGD convergence guarantees. Thanks to these improvements we show that this method can be applied for patch based image denoising.}


title: Deep Learning in Computational Biology: Advancements, Challenges, and Future Outlook

abstract: Deep learning has become a powerful tool in computational biology, revolutionising the analysis and interpretation of biological data over time. In our article review, we delve into various aspects of deep learning in computational biology. Specifically, we examine its history, advantages, and challenges. Our focus is on two primary applications: DNA sequence classification and prediction, as well as protein structure prediction from sequence data. Additionally, we provide insights into the outlook for this field. To fully harness the potential of deep learning in computational biology, it is crucial to address the challenges that come with it. These challenges include the requirement for large, labelled datasets and the interpretability of deep learning models. The use of deep learning in the analysis of DNA sequences has brought about a significant transformation in the detection of genomic variants and the analysis of gene expression. This has greatly contributed to the advancement of personalised medicine and drug discovery. Convolutional neural networks (CNNs) have been shown to be highly accurate in predicting genetic variations and gene expression levels. Deep learning techniques are used for analysing epigenetic data, including DNA methylation and histone modifications. This provides valuable insights into metabolic conditions and gene regulation. The field of protein structure prediction has been significantly impacted by deep learning, which has enabled accurate determination of the three-dimensional shape of proteins and prediction of their interactions. The future of deep learning in computational biology looks promising. With the development of advanced deep learning models and interpretation techniques, there is potential to overcome current challenges and further our understanding of biological systems.


title: Hypertriton lifetime

abstract: Over the last decade, conflicting values of the hypertriton ${}_{\Lambda}^3\mathrm{H}$ lifetime $\tau({}_{\Lambda}^3\mathrm{H})$ were extracted from relativistic heavy-ion (RHI) collision experiments, ranging from values compatible with the free-$\Lambda$ lifetime $\tau_\Lambda$-as expected naively for a very weakly bound $\Lambda$ in ${}_{\Lambda}^3\mathrm{H}$-to lifetimes as short as $\tau({}_{\Lambda}^3\mathrm{H}) \approx (0.4-0.7)\,\tau_\Lambda$. In a recent work [Phys. Lett. B 811, 135916 (2020)] we studied this ${}_{\Lambda}^3\mathrm{H}$ lifetime puzzle theoretically using realistic three-body ${}_{\Lambda}^3\mathrm{H}$ and ${}^3\mathrm{He}$ wave functions computed within the ab initio no-core shell model approach with interactions derived from chiral effective field theory. In particular, $\tau({}_{\Lambda}^3\mathrm{H})$ was found to be strongly correlated with the $\Lambda$ separation energy $B_\Lambda$ in ${}_{\Lambda}^3\mathrm{H}$, the value of which is rather poorly known experimentally and, in addition, is known to suffer from sizable theoretical uncertainties inherent in the employed nuclear and hypernuclear interaction models. In the present work we find that these uncertainties propagate into $\tau({}_{\Lambda}^3\mathrm{H})$, and thus limit considerably the theoretical precision of its computed value. Although none of the conflicting RHI measured $\tau({}_{\Lambda}^3\mathrm{H})$ values can be excluded, but rather can be attributed to a poor knowledge of $B_\Lambda$, we note the good agreement between the lifetime value $\tau({}_{\Lambda}^3\mathrm{H})=238(27)$ ps computed at the lowest value $B_\Lambda=66$ keV reached by us and the very recent ALICE measured lifetime value $\tau^{\mathrm{ALICE}}({}_{\Lambda}^3\mathrm{H})=253(11)(6)$ ps associated with the ALICE measured $B_\Lambda$ value $B^{\mathrm{ALICE}}_\Lambda=102(63)(67)$ keV [Phys. Rev. Lett. 131, 102302 (2023)].


title: Physics-Informed Neural Networks for Accelerating Power System State Estimation

abstract: State estimation is the cornerstone of the power system control center since it provides the operating condition of the system in consecutive time intervals. This work investigates the application of physics-informed neural networks (PINNs) for accelerating power systems state estimation in monitoring the operation of power systems. Traditional state estimation techniques often rely on iterative algorithms that can be computationally intensive, particularly for large-scale power systems. In this paper, a novel approach that leverages the inherent physical knowledge of power systems through the integration of PINNs is proposed. By incorporating physical laws as prior knowledge, the proposed method significantly reduces the computational complexity associated with state estimation while maintaining high accuracy. The proposed method achieves up to 11% increase in accuracy, 75% reduction in standard deviation of results, and 30% faster convergence, as demonstrated by comprehensive experiments on the IEEE 14-bus system.


title: An adaptive stabilized trace finite element method for surface PDEs

abstract: The paper introduces an adaptive version of the stabilized Trace Finite Element Method (TraceFEM) designed to solve low-regularity elliptic problems on level-set surfaces using a shape-regular bulk mesh in the embedding space. Two stabilization variants, gradient-jump face and normal-gradient volume, are considered for continuous trace spaces of the first and second degrees, based on the polynomial families $Q_1$ and $Q_2$. We propose a practical error indicator that estimates the `jumps' of finite element solution derivatives across background mesh faces and it avoids integration of any quantities along implicitly defined curvilinear edges of the discrete surface elements. For the $Q_1$ family of piecewise trilinear polynomials on bulk cells, the solve-estimate-mark-refine strategy, combined with the suggested error indicator, achieves optimal convergence rates typical of two-dimensional problems. We also provide a posteriori error estimates, establishing the reliability of the error indicator for the $Q_1$ and $Q_2$ elements and for two types of stabilization. In numerical experiments, we assess the reliability and efficiency of the error indicator. While both stabilizations are found to deliver comparable performance,the lowest degree finite element space appears to be the more robust choice for the adaptive TraceFEM framework.


title: Characteristics of the Accelerated Electrons Moving along the Loop Derived from Cyclical Microwave Brightenings at the Footpoints

abstract: Many particles are accelerated during solar flares. To understand the acceleration and propagation processes of electrons, we require the pitch-angle distributions of the particles. The pitch angle of accelerated electrons has been estimated from the propagation velocity of a nonthermal microwave source archived in Nobeyama Radioheliograph data. We analyzed a flare event (an M-class flare on 2014 October 22) showing cyclical microwave brightenings at the two footpoint regions. Assuming that the brightenings were caused by the accelerated electrons, we approximated the velocity parallel to the magnetic field of the accelerated electrons as 77,000 and 90,000 km/s. The estimated pitch angle of the accelerated electrons is 69-80 degrees and the size of the loss cone at the footpoint (estimated from the magnetic field strength in the nonlinear force-free field model) is approximately 43 degrees. Most of the accelerated electrons could be reflected at the footpoint region. This feature can be interpreted as brightenings produced by bouncing motion of the accelerated electrons.


title: Privacy-preserving Multi-biometric Indexing based on Frequent Binary Patterns

abstract: The development of large-scale identification systems that ensure the privacy protection of enrolled subjects represents a major challenge. Biometric deployments that provide interoperability and usability by including efficient multi-biometric solutions are a recent requirement. In the context of privacy protection, several template protection schemes have been proposed in the past. However, these schemes seem inadequate for indexing (workload reduction) in biometric identification systems. More specifically, they have been used in identification systems that perform exhaustive searches, leading to a degradation of computational efficiency. To overcome these limitations, we propose an efficient privacy-preserving multi-biometric identification system that retrieves protected deep cancelable templates and is agnostic with respect to biometric characteristics and biometric template protection schemes. To this end, a multi-biometric binning scheme is designed to exploit the low intra-class variation properties contained in the frequent binary patterns extracted from different types of biometric characteristics. Experimental results reported on publicly available databases using state-of-the-art Deep Neural Network (DNN)-based embedding extractors show that the protected multi-biometric identification system can reduce the computational workload to approximately 57\% (indexing up to three types of biometric characteristics) and 53% (indexing up to two types of biometric characteristics), while simultaneously improving the biometric performance of the baseline biometric system at the high-security thresholds. The source code of the proposed multi-biometric indexing approach together with the composed multi-biometric dataset, will be made available to the research community once the article is accepted.


title: Theoretical Priors and the Dark Energy Equation of State

abstract: We revisit the theoretical priors used for inferring Dark Energy (DE) parameters. Any DE model must have some form of a tracker mechanism such that it behaved as matter or radiation in the past. Otherwise, the model is fine-tuned. We construct a model-independent parametrization that takes this prior into account and allows for a relatively sudden transition between radiation/matter to DE behavior. We match the parametrization with current data, and deduce that the adiabatic and effective sound speeds of DE play an important role in inferring the cosmological parameters. We find that there is a preferred transition redshift of $1+z\simeq 29-30$, and some reduction in the Hubble and Large Scale Structure tensions.


title: Photometric Redshift Estimation for Gamma-Ray Bursts from the Early Universe

abstract: Future detection of high-redshift gamma-ray bursts (GRBs) will be an important tool for studying the early Universe. Fast and accurate redshift estimation for detected GRBs is key for encouraging rapid follow-up observations by ground- and space-based telescopes. Low-redshift dusty interlopers pose the biggest challenge for GRB redshift estimation using broad photometric bands, as their high extinction can mimic a high-redshift GRB. To assess false alarms of high-redshift GRB photometric measurements, we simulate and fit a variety of GRBs using phozzy, a simulation code developed to estimate GRB photometric redshifts, and test the ability to distinguish between high- and low-redshift GRBs when using simultaneously observed photometric bands. We run the code with the wavelength bands and instrument parameters for the Photo-z Infrared Telescope (PIRT), an instrument designed for the Gamow mission concept. We explore various distributions of host galaxy extinction as a function of redshift, and their effect on the completeness and purity of a high-redshift GRB search with the PIRT. We find that for assumptions based on current observations, the completeness and purity range from $\sim 82$ to $88\%$ and from $\sim 84$ to $>99\%$, respectively. For the priors optimized to reduce false positives, only $\sim 0.6\%$ of low-redshift GRBs will be mistaken as a high-redshift one, corresponding to $\sim 1$ false alarm per 500 detected GRBs.


title: Large Language Model Cascades with Mixture of Thoughts Representations for Cost-efficient Reasoning

abstract: Large language models (LLMs) such as GPT-4 have exhibited remarkable performance in a variety of tasks, but this strong performance often comes with the high expense of using paid API services. In this paper, we are motivated to study building an LLM cascade to save the cost of using LLMs, particularly for performing reasoning (e.g., mathematical, causal) tasks. Our cascade pipeline follows the intuition that simpler questions can be addressed by a weaker but more affordable LLM, whereas only the challenging questions necessitate the stronger and more expensive LLM. To realize this decision-making, we consider the "answer consistency" of the weaker LLM as a signal of the question difficulty and propose several methods for the answer sampling and consistency checking, including one leveraging a mixture of two thought representations (i.e., Chain-of-Thought and Program-of-Thought). Through experiments on six reasoning benchmark datasets, with GPT-3.5-turbo and GPT-4 being the weaker and stronger LLMs, respectively, we demonstrate that our proposed LLM cascades can achieve performance comparable to using solely the stronger LLM but require only 40% of its cost.


title: Opinion Dynamics Optimization Through Noncooperative Differential Games

abstract: In this paper, I study optimizing the opinion formation of a social network of a population of individuals on a graph whose opinion evolves according to the Hegselmann-Krause model for opinion dynamics. I propose an optimization problem based on a differential game for a population of individuals who are not stubborn. The objective of each individual is to seek an optimal control policy for her own opinion evolution by optimizing a personal performance index. The Nash equilibrium actions and the associated opinion trajectory with the equilibrium actions are derived for the opinion optimization model using Pontryagin's principle. The game strategies were executed on the well-known Zachary's Karate Club social network. The resulting opinion trajectories associated with the game strategies showed that in non-stubborn Zachary's network, the opinions moved toward the average opinion of the network, but a consensus of final opinions did not necessarily emerge.


abstract: We propose a new Perturbation Theory framework that can be used to help with the projective solution of the Schr\"odinger equation for arbitrary wavefunctions. This Flexible Ansatz for N-body Perturbation Theory (FANPT) is based on our previously proposed Flexible Ansatz for N-body Configuration Interaction (FANCI). We derive recursive FANPT expressions including arbitrary orders in the perturbation hierarchy. We show that the FANPT equations are well-behaved across a wide range of conditions, including static correlation-dominated configurations and highly non-linear wavefunctions.


title: FRIED v2. A new grid of mass loss rates for externally irradiated protoplanetary discs

abstract: We present a new FRIED grid of mass loss rates for externally far-ultraviolet (FUV) irradiated protoplanetary discs. As a precursor to the new grid, we also explore the microphysics of external photoevaporation, determining the impact of polycyclic aromatic hydrocarbon (PAH) abundance, metallicity, coolant depletion (via freeze out and radial drift) and grain growth (depletion of small dust in the outer disc) on disc mass loss rates. We find that metallicity variations typically have a small effect on the mass loss rate, since the impact of changes in heating, cooling and optical depth to the disc approximately cancel out. The new FRIED grid therefore focuses on i) expanding the basic physical parameter space (disc mass, radius, UV field, stellar mass) ii) on enabling variation of the the PAH abundance and iii) including an option for grain growth to have occurred or not in the disc. What we suggest is the fiducial model is comparable to the original FRIED grid. When the PAH-to-dust ratio is lower, or the dust in the wind more abundant, the mass loss rate can be substantially lower. We demonstrate with a small set of illustrative disc evolutionary calculations that this in turn can have a significant impact on the disc mass/radius/ evolution and lifetime.


title: NOCAP: Near-Optimal Correlation-Aware Partitioning Joins

abstract: Storage-based joins are still commonly used today because the memory budget does not always scale with the data size. One of the many join algorithms developed that has been widely deployed and proven to be efficient is the Hybrid Hash Join (HHJ), which is designed to exploit any available memory to maximize the data that is joined directly in memory. However, HHJ cannot fully exploit detailed knowledge of the join attribute correlation distribution. In this paper, we show that given a correlation skew in the join attributes, HHJ partitions data in a suboptimal way. To do that, we derive the optimal partitioning using a new cost-based analysis of partitioning-based joins that is tailored for primary key - foreign key (PK-FK) joins, one of the most common join types. This optimal partitioning strategy has a high memory cost, thus, we further derive an approximate algorithm that has tunable memory cost and leads to near-optimal results. Our algorithm, termed NOCAP (Near-Optimal Correlation-Aware Partitioning) join, outperforms the state-of-the-art for skewed correlations by up to $30\%$, and the textbook Grace Hash Join by up to $4\times$. Further, for a limited memory budget, NOCAP outperforms HHJ by up to $10\%$, even for uniform correlation. Overall, NOCAP dominates state-of-the-art algorithms and mimics the best algorithm for a memory budget varying from below $\sqrt{\|\text{relation}\|}$ to more than $\|\text{relation}\|$.


title: Conley index for multivalued maps on finite topological spaces

abstract: We develop Conley's theory for multivalued maps on finite topological spaces. More precisely, for discrete-time dynamical systems generated by the iteration of a multivalued map which satisfies appropriate regularity conditions, we establish the notions of isolated invariant sets and index pairs, and use them to introduce a well-defined Conley index. In addition, we verify some of its fundamental properties such as the Wazewski property and continuation.


title: Quantization of causal diamonds in (2+1)-dimensional gravity -- Part II: Group-theoretic quantization

abstract: We develop the non-perturbative reduced phase space quantization of causal diamonds in (2+1)-dimensional gravity with a nonpositive cosmological constant. In Part I we described the classical reduction process and the reduced phase space, $\widetilde{\mathcal P} = T^*(\text{Diff}^+\!(S^1)/\text{PSL}(2, \mathbb R))$, while in Part II we discuss the quantization of the phase space and quantum aspects of the causal diamonds. Because the phase space does not have a natural linear structure, a generalization of the standard canonical (coordinate) quantization is required. In particular, as the configuration space is a homogeneous space for the $\text{Diff}^+\!(S^1)$ group, we apply Isham's group-theoretic quantization scheme. We propose a quantization based on (projective) unitary irreducible representations of the $\text{BMS}_3$ group, which is obtained from a natural prescription for extending $\text{Diff}^+\!(S^1)$ into a transitive group of symplectic symmetries of the phase space. We find a class of suitable quantum theories labelled by a choice of a coadjoint orbit of the Virasoro group and an irreducible unitary representation of the corresponding little group. The most natural choice, justified by a Casimir matching principle, corresponds to a Hilbert space realized by wavefunctions on $\text{Diff}^+\!(S^1)/\text{PSL}(2, \mathbb R)$ valued in some unitary irreducible representation of $\text{SL}(2, \mathbb R)$. A surprising result is that the twist of the diamond corner loop is quantized in terms of the ratio of the Planck length to the corner perimeter.


title: Wave Measurements using Open Source Ship Mounted Ultrasonic Altimeter and Motion Correction System during the One Ocean Expedition

abstract: This study reviews the design and signal processing of ship borne ultrasonic altimeter wave measurements. The system combines a downward facing ultrasonic altimeter to capture the sea surface elevation as a time series, and an inertial measurement unit to compensate for the ship's motion. The methodology is cost-effective, open source, and adaptable to various ships and platforms. The system was installed on the barque Statsraad Lehmkuhl and recorded data continuously during the 20-month One Ocean Expedition. Results from 1-month crossing of the Tropical Atlantic are presented here. The one-dimensional wave spectrum and associated wave parameters are obtained from the sea surface elevation time series. The observed significant wave height agrees well with satellite altimetry and a spectral wave model. The agreement between observations and the spectral wave model is better for the mean wave period than the peak period. We perform Doppler shift corrections to improve wave period estimates by accounting for the speed of the ship relative to the waves. This correction enhances the accuracy of the mean period, but not the peak period. We suggest that the Doppler correction could be improved by complementing the data sources with directional wave measurements from a marine X-band radar.


title: Tunneling of fluxons via a Josephson resonant level

abstract: Fluxons in a superconducting loop can be coherently coupled by quantum phase slips occurring at a weak link such as a Josephson junction. If Cooper pair tunneling at the junction occurs through a resonant level, $2\pi$ quantum phase slips are suppressed, and fluxons are predominantly coupled by $4\pi$ quantum phase slips. We analyze this scenario by computing the coupling between fluxons as the level is brought into resonance with the superconducting condensate. The results indicate that the $4\pi$-dominated regime can be observed directly in the transition spectrum for circuit parameters typical of a fluxonium qubit. We also show that, if the inductive energy of the loop is much smaller than the plasma frequency of the junction, the low-energy Hamiltonian of the circuit is dual to that of a topological superconducting island. These findings can inform experiments on bifluxon qubits as well as the design of novel types of protected qubits.


title: Dual Prompt Tuning for Domain-Aware Federated Learning

abstract: Federated learning is a distributed machine learning paradigm that allows multiple clients to collaboratively train a shared model with their local data. Nonetheless, conventional federated learning algorithms often struggle to generalize well due to the ubiquitous domain shift across clients. In this work, we consider a challenging yet realistic federated learning scenario where the training data of each client originates from different domains. We address the challenges of domain shift by leveraging the technique of prompt learning, and propose a novel method called Federated Dual Prompt Tuning (Fed-DPT). Specifically, Fed-DPT employs a pre-trained vision-language model and then applies both visual and textual prompt tuning to facilitate domain adaptation over decentralized data. Extensive experiments of Fed-DPT demonstrate its significant effectiveness in domain-aware federated learning. With a pre-trained CLIP model (ViT-Base as image encoder), the proposed Fed-DPT attains 68.4% average accuracy over six domains in the DomainNet dataset, which improves the original CLIP by a large margin of 14.8%.


title: DP-SGD for non-decomposable objective functions

abstract: Unsupervised pre-training is a common step in developing computer vision models and large language models. In this setting, the absence of labels requires the use of similarity-based loss functions, such as contrastive loss, that favor minimizing the distance between similar inputs and maximizing the distance between distinct inputs. As privacy concerns mount, training these models using differential privacy has become more important. However, due to how inputs are generated for these losses, one of their undesirable properties is that their $L_2$ sensitivity can grow with increasing batch size. This property is particularly disadvantageous for differentially private training methods, such as DP-SGD. To overcome this issue, we develop a new DP-SGD variant for similarity based loss functions -- in particular the commonly used contrastive loss -- that manipulates gradients of the objective function in a novel way to obtain a senstivity of the summed gradient that is $O(1)$ for batch size $n$. We test our DP-SGD variant on some preliminary CIFAR-10 pre-training and CIFAR-100 finetuning tasks and show that, in both tasks, our method's performance comes close to that of a non-private model and generally outperforms DP-SGD applied directly to the contrastive loss.


title: Efficiency of the Generalized Second-Price Auction for Value Maximizers

abstract: We study the price of anarchy of the generalized second-price auction where bidders are value maximizers (i.e., autobidders). We show that in general the price of anarchy can be as bad as $0$. For comparison, the price of anarchy of running VCG is $1/2$ in the autobidding world. We further show a fined-grained price of anarchy with respect to the discount factors (i.e., the ratios of click probabilities between lower slots and the highest slot in each auction) in the generalized second-price auction, which highlights the qualitative relation between the smoothness of the discount factors and the efficiency of the generalized second-price auction.


title: Creating an Atlas of Normal Tissue for Pruning WSI Patching Through Anomaly Detection

abstract: Patching gigapixel whole slide images (WSIs) is an important task in computational pathology. Some methods have been proposed to select a subset of patches as WSI representation for downstream tasks. While most of the computational pathology tasks are designed to classify or detect the presence of pathological lesions in each WSI, the confounding role and redundant nature of normal histology in tissue samples are generally overlooked in WSI representations. In this paper, we propose and validate the concept of an "atlas of normal tissue" solely using samples of WSIs obtained from normal tissue biopsies. Such atlases can be employed to eliminate normal fragments of tissue samples and hence increase the representativeness collection of patches. We tested our proposed method by establishing a normal atlas using 107 normal skin WSIs and demonstrated how established indexes and search engines like Yottixel can be improved. We used 553 WSIs of cutaneous squamous cell carcinoma (cSCC) to show the advantage. We also validated our method applied to an external dataset of 451 breast WSIs. The number of selected WSI patches was reduced by 30% to 50% after utilizing the proposed normal atlas while maintaining the same indexing and search performance in leave-one-patinet-out validation for both datasets. We show that the proposed normal atlas shows promise for unsupervised selection of the most representative patches of the abnormal/malignant WSI lesions.


title: Universal Hyperuniformity in Active Field Theories

abstract: We show that dry scalar-order active field theories (AFTs) are universally hyperuniform, i.e., density fluctuations are anomalously suppressed in the long-time limit regardless of the integrability or functional form of the active contributions up to third order in gradient terms. These AFTs include Active model B, Active model B+, and effective Cahn-Hilliard models. Moreover, density variances and spectral densities are virtually indistinguishable from that of passive phase-separated hyperuniform fields. Higher moments of the density fluctuations, however, reveal activity-dependent higher-order correlations that are not captured by conventional two-point measures that characterize hyperuniformity.


title: Reinforcement Learning-based Mixture of Vision Transformers for Video Violence Recognition

abstract: Video violence recognition based on deep learning concerns accurate yet scalable human violence recognition. Currently, most state-of-the-art video violence recognition studies use CNN-based models to represent and categorize videos. However, recent studies suggest that pre-trained transformers are more accurate than CNN-based models on various video analysis benchmarks. Yet these models are not thoroughly evaluated for video violence recognition. This paper introduces a novel transformer-based Mixture of Experts (MoE) video violence recognition system. Through an intelligent combination of large vision transformers and efficient transformer architectures, the proposed system not only takes advantage of the vision transformer architecture but also reduces the cost of utilizing large vision transformers. The proposed architecture maximizes violence recognition system accuracy while actively reducing computational costs through a reinforcement learning-based router. The empirical results show the proposed MoE architecture's superiority over CNN-based models by achieving 92.4% accuracy on the RWF dataset.


title: $^{40}$Ca transverse response function from coupled-cluster theory

abstract: We present calculations of the $^{40}$Ca transverse response function obtained from coupled-cluster theory used in conjunction with the Lorentz integral transform method. We employ nuclear forces derived at next-to-next-to leading order in chiral effective field theory with and without $\Delta$ degrees of freedom. We first benchmark this approach on the $^4$He nucleus and compare both the transverse sum rule and the response function to earlier calculations based on different methods. As expected from the power counting of the chiral expansion of electromagnetic currents and from previous studies, our results retaining only one-body term underestimate the experimental data for $^4$He by about $20\%$. However, when the method is applied to $^{40}$Ca at the same order of the expansion, response functions do not lack strength and agree well with the world electron scattering data. We discuss various sources of theoretical uncertainties and comment on the comparison of our results with the available experiments.


title: Dual mode multispectral imaging system for food and agricultural product quality estimation

abstract: Multispectral imaging coupled with Artificial Intelligence, Machine Learning and Signal Processing techniques work as a feasible alternative for laboratory testing, especially in food quality control. Most of the recent related research has been focused on reflectance multispectral imaging but a system with both reflectance, transmittance capabilities would be ideal for a wide array of specimen types including solid and liquid samples. In this paper, a device which includes a dedicated reflectance mode and a dedicated transmittance mode is proposed. Dual mode operation where fast switching between two modes is facilitated. An innovative merged mode is introduced in which both reflectance and transmittance information of a specimen are combined to form a higher dimensional dataset with more features. Spatial and temporal variations of measurements are analyzed to ensure the quality of measurements. The concept is validated using a standard color palette and specific case studies are done for standard food samples such as turmeric powder and coconut oil proving the validity of proposed contributions. The classification accuracy of standard color palette testing was over 90% and the accuracy of coconut oil adulteration was over 95%. while the merged mode was able to provide the best accuracy of 99% for the turmeric adulteration. A linear functional mapping was done for coconut oil adulteration with an R2 value of 0.9558.


title: Multi-modal Gaussian Process Variational Autoencoders for Neural and Behavioral Data

abstract: Characterizing the relationship between neural population activity and behavioral data is a central goal of neuroscience. While latent variable models (LVMs) are successful in describing high-dimensional time-series data, they are typically only designed for a single type of data, making it difficult to identify structure shared across different experimental data modalities. Here, we address this shortcoming by proposing an unsupervised LVM which extracts temporally evolving shared and independent latents for distinct, simultaneously recorded experimental modalities. We do this by combining Gaussian Process Factor Analysis (GPFA), an interpretable LVM for neural spiking data with temporally smooth latent space, with Gaussian Process Variational Autoencoders (GP-VAEs), which similarly use a GP prior to characterize correlations in a latent space, but admit rich expressivity due to a deep neural network mapping to observations. We achieve interpretability in our model by partitioning latent variability into components that are either shared between or independent to each modality. We parameterize the latents of our model in the Fourier domain, and show improved latent identification using this approach over standard GP-VAE methods. We validate our model on simulated multi-modal data consisting of Poisson spike counts and MNIST images that scale and rotate smoothly over time. We show that the multi-modal GP-VAE (MM-GPVAE) is able to not only identify the shared and independent latent structure across modalities accurately, but provides good reconstructions of both images and neural rates on held-out trials. Finally, we demonstrate our framework on two real world multi-modal experimental settings: Drosophila whole-brain calcium imaging alongside tracked limb positions, and Manduca sexta spike train measurements from ten wing muscles as the animal tracks a visual stimulus.


title: Leveraging Model-based Trees as Interpretable Surrogate Models for Model Distillation

abstract: Surrogate models play a crucial role in retrospectively interpreting complex and powerful black box machine learning models via model distillation. This paper focuses on using model-based trees as surrogate models which partition the feature space into interpretable regions via decision rules. Within each region, interpretable models based on additive main effects are used to approximate the behavior of the black box model, striking for an optimal balance between interpretability and performance. Four model-based tree algorithms, namely SLIM, GUIDE, MOB, and CTree, are compared regarding their ability to generate such surrogate models. We investigate fidelity, interpretability, stability, and the algorithms' capability to capture interaction effects through appropriate splits. Based on our comprehensive analyses, we finally provide an overview of user-specific recommendations.


title: Jointly Estimating Subnational Mortality for Multiple Populations

abstract: Understanding patterns in mortality across subpopulations is essential for local health policy decision making. One of the key challenges of subnational mortality rate estimation is the presence of small populations and zero or near zero death counts. When studying differences between subpopulations, this challenge is compounded as the small populations are further divided along socioeconomic or demographic lines. In this paper, we build on principal component-based Bayesian hierarchical approaches for subnational mortality rate estimation to model correlations across subpopulations. The principal components identify structural differences between subpopulations, and coefficient and error models track the correlations between subpopulations over time. We illustrate the use of the model in a simulation study as well as on county-level sex-specific US mortality data. We find that results from the model are reasonable and that it successfully extracts meaningful patterns in US sex-specific mortality. Additionally, we show that ancillary correlation parameters are a useful tool for studying the convergence and divergence of mortality patterns over time.


title: Bayesian Parameter Inference for Partially Observed Stochastic Volterra Equations

abstract: In this article we consider Bayesian parameter inference for a type of partially observed stochastic Volterra equation (SVE). SVEs are found in many areas such as physics and mathematical finance. In the latter field they can be used to represent long memory in unobserved volatility processes. In many cases of practical interest, SVEs must be time-discretized and then parameter inference is based upon the posterior associated to this time-discretized process. Based upon recent studies on time-discretization of SVEs (e.g. Richard et al. 2021), we use Euler-Maruyama methods for the afore-mentioned discretization. We then show how multilevel Markov chain Monte Carlo (MCMC) methods (Jasra et al. 2018) can be applied in this context. In the examples we study, we give a proof that shows that the cost to achieve a mean square error (MSE) of $\mathcal{O}(\epsilon^2)$, $\epsilon>0$, is {$\mathcal{O}(\epsilon^{-\tfrac{4}{2H+1}})$, where $H$ is the Hurst parameter. If one uses a single level MCMC method then the cost is $\mathcal{O}(\epsilon^{-\tfrac{2(2H+3)}{2H+1}})$} to achieve the same MSE. We illustrate these results in the context of state-space and stochastic volatility models, with the latter applied to real data.


title: The Necker cube surface

abstract: We study geodesics on the Necker cube surface, $\mathbf N$, an infinite periodic Euclidean cone surface that is homeomorphic to the plane and is tiled by squares meeting three or six to a vertex. We ask: When does a geodesic on the surface close? When does a geodesic drift away periodically? We show that both questions can be answered only using knowledge about the initial direction of a geodesic. Further, there is a natural projection from $\mathbf N$ to the plane, and we show that regions related to simple closed geodesics tile the plane periodically. We also describe the full affine symmetry group of the half-translation cover and use this to study dynamical properties of the geodesic flow on $\mathbf N$. We prove results related to recurrence, ergodicity, and divergence rates.


title: A Systematic Study of Planetary Envelope Growth with 3D Radiation-Hydrodynamics Simulations

abstract: In the core accretion model of planet formation, envelope cooling regulates the accretion of material and ultimately sets the timescale to form a giant planet. Given the diversity of planet-forming environments, opacity uncertainties, and the advective transport of energy by 3-dimensional recycling flows, it is unclear whether 1D models can adequately describe envelope structure and accretion in all regimes. Even in 3D models, it is unclear whether approximate radiative transfer methods sufficiently model envelope cooling particularly at the planetary photosphere. To address these uncertainties, we present a suite of 3D radiation hydrodynamics simulations employing methods that directly solve the transfer equation. We perform a parameter space study, formulated in terms of dimensionless parameters, for a variety of envelope optical depths and cooling times. We find that the thermodynamic structure of the envelope ranges from adiabatic to isothermal based on the cooling time and by extension, the background disk temperature and density. Our models show general agreement with 1D static calculations, suggesting a limited role of recycling flows in determining envelope structure. By adopting a dimensionless framework, these models can be applied to a wide range of formation conditions and assumed opacities. In particular, we dimensionalize them to the case of a super-Earth and proto-Jupiter and place upper limits on the 3D mass accretion rates prior to runaway growth. Finally, we evaluate the fidelity of approximate radiative transfer methods and find that even in the most challenging cases, more approximate methods are sufficiently accurate and worth their savings in computational cost.


title: Growing Planet Envelopes in Spite of Recycling Flows

abstract: The hydrodynamic exchange of a protoplanet's envelope material with the background protoplanetary disk has been proposed as one mechanism to account for the diversity of observed planet envelopes which range in mass fractions of ~1% for super-Earths to ~90% for giants. Here we present and analyze 3D radiation-hydrodynamics models of protoplanet envelopes to understand how the exchange of mass and energy between the protoplanet and background disk influences the formation process. Our protoplanet envelope simulations show an exchange of material bringing the outer <0.4Rbondi envelope to steady state. This exchange provides a continuous source of energy, which acts to increase the observed luminosity beyond that inferred from the binding energy liberated from Kelvin-Helmholtz contraction alone -- a finding important for potential protoplanet observations. The inner <0.4Rbondi, on the other hand, appears insulated -- growing in accordance with 1D quasi-static theory. We incorporate these 3D hydrodynamic effects into an extensible 1D framework with a physically motivated three-layer recycling parameterization. Specializing to the case of Jupiter, recycling produces minimal changes to the growth rate with the planet still entering runaway accretion and becoming a gas giant in ~1 Myr. Even in the inner disk (0.1 AU), our 1D models suggest that recycling is not so robust and ubiquitous as to stop all cores from becoming giants. At the same time however, this recycling can delay a runaway phase by an order-of-magnitude depending on the inner disk conditions and core mass.


title: Blind CT Image Quality Assessment Using DDPM-derived Content and Transformer-based Evaluator

abstract: Lowering radiation dose per view and utilizing sparse views per scan are two common CT scan modes, albeit often leading to distorted images characterized by noise and streak artifacts. Blind image quality assessment (BIQA) strives to evaluate perceptual quality in alignment with what radiologists perceive, which plays an important role in advancing low-dose CT reconstruction techniques. An intriguing direction involves developing BIQA methods that mimic the operational characteristic of the human visual system (HVS). The internal generative mechanism (IGM) theory reveals that the HVS actively deduces primary content to enhance comprehension. In this study, we introduce an innovative BIQA metric that emulates the active inference process of IGM. Initially, an active inference module, implemented as a denoising diffusion probabilistic model (DDPM), is constructed to anticipate the primary content. Then, the dissimilarity map is derived by assessing the interrelation between the distorted image and its primary content. Subsequently, the distorted image and dissimilarity map are combined into a multi-channel image, which is inputted into a transformer-based image quality evaluator. Remarkably, by exclusively utilizing this transformer-based quality evaluator, we won the second place in the MICCAI 2023 low-dose computed tomography perceptual image quality assessment grand challenge. Leveraging the DDPM-derived primary content, our approach further improves the performance on the challenge dataset.


title: Crossed-IoT device portability of Electromagnetic Side Channel Analysis: Challenges and Dataset

abstract: IoT (Internet of Things) refers to the network of interconnected physical devices, vehicles, home appliances, and other items embedded with sensors, software, and connectivity, enabling them to collect and exchange data. IoT Forensics is collecting and analyzing digital evidence from IoT devices to investigate cybercrimes, security breaches, and other malicious activities that may have taken place on these connected devices. In particular, EM-SCA has become an essential tool for IoT forensics due to its ability to reveal confidential information about the internal workings of IoT devices without interfering these devices or wiretapping their networks. However, the accuracy and reliability of EM-SCA results can be limited by device variability, environmental factors, and data collection and processing methods. Besides, there is very few research on these limitations that affects significantly the accuracy of EM-SCA approaches for the crossed-IoT device portability as well as limited research on the possible solutions to address such challenge. Therefore, this empirical study examines the impact of device variability on the accuracy and reliability of EM-SCA approaches, in particular machine-learning (ML) based approaches for EM-SCA. We firstly presents the background, basic concepts and techniques used to evaluate the limitations of current EM-SCA approaches and datasets. Our study then addresses one of the most important limitation, which is caused by the multi-core architecture of the processors (SoC). We present an approach to collect the EM-SCA datasets and demonstrate the feasibility of using transfer learning to obtain more meaningful and reliable results from EM-SCA in IoT forensics of crossed-IoT devices. Our study moreover contributes a new dataset for using deep learning models in analysing Electromagnetic Side-Channel data with regards to the cross-device portability matter.


title: Remarks on the Complex Euler Equations

abstract: We consider a complexification of the Euler equations introduced by \v{S}ver\'ak which conserves energy. We prove that these complex Euler equations are nonlinearly ill-posed below analytic regularity and, moreover, we exhibit solutions which lose analyticity in finite time. Our examples are complex shear flows and, hence, one-dimensional. This motivates us to consider fully nonlinear systems in one spatial dimension which are non-hyperbolic near a constant equilibrium. We prove nonlinear ill-posedness and finite-time singularity for these models. Our approach is to construct an infinite-dimensional unstable manifold to capture the high frequency instability at the nonlinear level.


title: OpenMM 8: Molecular Dynamics Simulation with Machine Learning Potentials

abstract: Machine learning plays an important and growing role in molecular simulation. The newest version of the OpenMM molecular dynamics toolkit introduces new features to support the use of machine learning potentials. Arbitrary PyTorch models can be added to a simulation and used to compute forces and energy. A higher-level interface allows users to easily model their molecules of interest with general purpose, pretrained potential functions. A collection of optimized CUDA kernels and custom PyTorch operations greatly improves the speed of simulations. We demonstrate these features on simulations of cyclin-dependent kinase 8 (CDK8) and the green fluorescent protein (GFP) chromophore in water. Taken together, these features make it practical to use machine learning to improve the accuracy of simulations at only a modest increase in cost.


title: SPH-based framework for modelling fluid-structure interaction problems with finite deformation and fracturing

abstract: Understanding crack propagation in structures subjected to fluid loads is crucial in various engineering applications, ranging from underwater pipelines to aircraft components. This study investigates the dynamic response of structures, including their damage and fracture behaviour under hydrodynamic load, emphasizing the fluid-structure interaction (FSI) phenomena by applying Smoothed Particle Hydrodynamics (SPH). The developed framework employs weakly compressible SPH (WCSPH) to model the fluid flow and a pseudo-spring-based SPH solver for modelling the structural response. For improved accuracy in FSI modelling, the $\delta$-SPH technique is implemented to enhance pressure calculations within the fluid phase. The pseudo-spring analogy is employed for modelling material damage, where particle interactions are confined to their immediate neighbours. These particles are linked by springs, which don't contribute to system stiffness but determine the interaction strength between connected pairs. It is assumed that a crack propagates through a spring connecting a particle pair when the damage indicator of that spring exceeds a predefined threshold. The developed framework is extensively validated through a dam break case, oscillation of a deformable solid beam, dam break through a deformable elastic solid, and breaking dam impact on a deformable solid obstacle. Numerical outcomes are subsequently compared with the findings from existing literature. The ability of the framework to accurately depict material damage and fracture is showcased through a simulation of water impact on a deformable solid obstacle with an initial notch.


title: Efficient Federated Prompt Tuning for Black-box Large Pre-trained Models

abstract: With the blowout development of pre-trained models (PTMs), the efficient tuning of these models for diverse downstream applications has emerged as a pivotal research concern. Although recent investigations into prompt tuning have provided promising avenues, three salient challenges persist: (1) memory constraint: the continuous growth in the size of open-source PTMs renders fine-tuning, even a fraction of their parameters, challenging for many practitioners. (2) model privacy: existing PTMs often function as public API services, with their parameters inaccessible for effective or tailored fine-tuning. (3) data privacy: the fine-tuning of PTMs necessitates high-quality datasets, which are typically localized and not shared to public. To optimally harness each local dataset while navigating memory constraints and preserving privacy, we propose Federated Black-Box Prompt Tuning (Fed-BBPT). This innovative approach eschews reliance on parameter architectures and private dataset access, instead capitalizing on a central server that aids local users in collaboratively training a prompt generator through regular aggregation. Local users leverage API-driven learning via a zero-order optimizer, obviating the need for PTM deployment. Relative to extensive fine-tuning, Fed-BBPT proficiently sidesteps memory challenges tied to PTM storage and fine-tuning on local machines, tapping into comprehensive, high-quality, yet private training datasets. A thorough evaluation across 40 datasets spanning CV and NLP tasks underscores the robustness of our proposed model.


title: A Dynkin Game with Independent Processes and Incomplete Information

abstract: We analyze a two-player, nonzero-sum Dynkin game of stopping with incomplete information. We assume that each player observes his own Brownian motion, which is not only independent of the other player's Brownian motion but also not observable by the other player. The player who stops first receives a payoff that depends on the stopping position. Under appropriate growth conditions on the payoff function, we show that there are infinitely many Nash equilibria in which both players have infinite expected payoffs. In contrast, the only equilibrium with finite expected payoffs mandates immediate stopping by at least one of the players.


title: Shielding the Unseen: Privacy Protection through Poisoning NeRF with Spatial Deformation

abstract: In this paper, we introduce an innovative method of safeguarding user privacy against the generative capabilities of Neural Radiance Fields (NeRF) models. Our novel poisoning attack method induces changes to observed views that are imperceptible to the human eye, yet potent enough to disrupt NeRF's ability to accurately reconstruct a 3D scene. To achieve this, we devise a bi-level optimization algorithm incorporating a Projected Gradient Descent (PGD)-based spatial deformation. We extensively test our approach on two common NeRF benchmark datasets consisting of 29 real-world scenes with high-quality images. Our results compellingly demonstrate that our privacy-preserving method significantly impairs NeRF's performance across these benchmark datasets. Additionally, we show that our method is adaptable and versatile, functioning across various perturbation strengths and NeRF architectures. This work offers valuable insights into NeRF's vulnerabilities and emphasizes the need to account for such potential privacy risks when developing robust 3D scene reconstruction algorithms. Our study contributes to the larger conversation surrounding responsible AI and generative machine learning, aiming to protect user privacy and respect creative ownership in the digital age.


title: Functoriality for groupoid and Fell bundle $C^*$-algebras

abstract: We define a class of morphisms between \'etale groupoids and show that there is a functor from the category with these morphisms to the category of $C^*$-algebras. We show that all homomorphisms between Cartan pairs of $C^*$-algebras that preserve the Cartan structure arise from such morphisms between the underlying Weyl groupoids and twists, and attain an equivalence of categories between Cartan pairs with structure preserving homomorphisms and a their associated twists. We define analogous morphisms for Fell bundles over $C^*$-algebras and show these functorially induce ${}^*$-homomorphisms between the Fell bundle $C^*$-algebras. We also construct colimit groupoids and Fell bundles for inductive systems of such morphisms, and show that the functor to $C^*$-algebras preserves these colimits.


title: Revisiting the $A_L$ Lensing Anomaly in Planck 2018 Temperature Data

abstract: We revisit the lensing anomaly in the Planck 2018 temperature (TT) data and examine its robustness to frequency selection and additional sky masking. Our main findings are: (1) The phenomenological lensing amplitude parameter, $A_L$, varies with ecliptic latitude, with a $2.9\sigma$ preference for $A_L>1$ near the ecliptic, and $1.0\sigma$ preference near the ecliptic poles, compared to $2.5\sigma$ on the original masks. This behavior is largely or solely from 217 GHz and suggestive of some non-random effect given the Planck scan strategy. (2) The 217 GHz TT data also show a stronger preference for $A_L>1$ than the lower frequencies. The shifts in $A_L$ from 217 GHz with additional Galactic dust masking are too large to be explained solely by statistical fluctuations, indicating some connection with the foreground treatment. Overall, the Planck $A_L$ anomaly does not have a single simple cause. Removing the 217 GHz TT data leaves a $1.8\sigma$ preference for $A_L>1$. The low-multipole ($\ell<30$) TT data contribute to the preference for $A_L>1$ through correlations with $\Lambda$CDM parameters. The 100 and 143 GHz data at $\ell\geq30$ prefer $A_L>1$ at $1.3\sigma$, and this appears robust to the masking tests we performed. The lensing anomaly may impact fits to alternative cosmological models. Marginalizing over $A_L$, optionally applied only to Planck TT spectra, can check this. Models proposed to address cosmological tensions should be robust to removal of the Planck 217 GHz TT data.


title: MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use

abstract: Large language models (LLMs) have garnered significant attention due to their impressive natural language processing (NLP) capabilities. Recently, many studies have focused on the tool utilization ability of LLMs. They primarily investigated how LLMs effectively collaborate with given specific tools. However, in scenarios where LLMs serve as intelligent agents, as seen in applications like AutoGPT and MetaGPT, LLMs are expected to engage in intricate decision-making processes that involve deciding whether to employ a tool and selecting the most suitable tool(s) from a collection of available tools to fulfill user requests. Therefore, in this paper, we introduce MetaTool, a benchmark designed to evaluate whether LLMs have tool usage awareness and can correctly choose tools. Specifically, we create a dataset called ToolE within the benchmark. This dataset contains various types of user queries in the form of prompts that trigger LLMs to use tools, including both single-tool and multi-tool scenarios. Subsequently, we set the tasks for both tool usage awareness and tool selection. We define four subtasks from different perspectives in tool selection, including tool selection with similar choices, tool selection in specific scenarios, tool selection with possible reliability issues, and multi-tool selection. We conduct experiments involving eight popular LLMs and find that the majority of them still struggle to effectively select tools, highlighting the existing gaps between LLMs and genuine intelligent agents. However, through the error analysis, we found there is still significant room for improvement. Finally, we conclude with insights for tool developers -- we strongly recommend that tool developers choose an appropriate rewrite model for generating new descriptions based on the downstream LLM the tool will apply to. Our code is in https://github.com/HowieHwong/MetaTool.


title: On the Hopf Problem and a Conjecture of Liu-Maxim-Wang

abstract: We discuss an approach towards the Hopf problem for aspherical smooth projective varieties recently proposed by Liu, Maxim, and Wang in [LMW21]. In complex dimension two, we point out that this circle of ideas suggests an intriguing conjecture regarding the geography of aspherical surfaces of general type.


title: Machine learning for efficient generation of universal hybrid quantum computing resources

abstract: We present numerical simulations of deep reinforcement learning on a measurement-based quantum processor--a time-multiplexed optical circuit sampled by photon-number-resolving detection--and find it generates squeezed cat states with an average success rate of 98%, far outperforming all other similar proposals.


title: Axiomatic Aggregations of Abductive Explanations

abstract: The recent criticisms of the robustness of post hoc model approximation explanation methods (like LIME and SHAP) have led to the rise of model-precise abductive explanations. For each data point, abductive explanations provide a minimal subset of features that are sufficient to generate the outcome. While theoretically sound and rigorous, abductive explanations suffer from a major issue -- there can be several valid abductive explanations for the same data point. In such cases, providing a single abductive explanation can be insufficient; on the other hand, providing all valid abductive explanations can be incomprehensible due to their size. In this work, we solve this issue by aggregating the many possible abductive explanations into feature importance scores. We propose three aggregation methods: two based on power indices from cooperative game theory and a third based on a well-known measure of causal strength. We characterize these three methods axiomatically, showing that each of them uniquely satisfies a set of desirable properties. We also evaluate them on multiple datasets and show that these explanations are robust to the attacks that fool SHAP and LIME.


title: Application-Oriented Co-Design of Motors and Motions for a 6DOF Robot Manipulator

abstract: This work investigates an application-driven co-design problem where the motion and motors of a six degrees of freedom robotic manipulator are optimized simultaneously, and the application is characterized by a set of tasks. Unlike the state-of-the-art which selects motors from a product catalogue and performs co-design for a single task, this work designs the motor geometry as well as motion for a specific application. Contributions are made towards solving the proposed co-design problem in a computationally-efficient manner. First, a two-step process is proposed, where multiple motor designs are identified by optimizing motions and motors for multiple tasks one by one, and then are reconciled to determine the final motor design. Second, magnetic equivalent circuit modeling is exploited to establish the analytic mapping from motor design parameters to dynamic models and objective functions to facilitate the subsequent differentiable simulation. Third, a direct-collocation-based differentiable simulator of motor and robotic arm dynamics is developed to balance the computational complexity and numerical stability. Simulation verifies that higher performance for a specific application can be achieved with the multi-task method, compared to several benchmark co-design methods.


title: Weinstein presentations for high-dimensional antisurgery

abstract: In this paper, we give an algorithm for describing the Weinstein presentation of Weinstein subdomains obtained by carving out regular Lagrangians. Our work generalizes previous work in dimension three and requires a novel Legendrian isotopy move (the ``boat move") that changes the local index of Reeb chords in a front projection. As applications, we describe presentations for certain exotic Weinstein subdomains and give explicit descriptions of $P$-loose Legendrians.


title: Optical penetration depth and periodic motion of a photomechanical strip

abstract: Liquid crystal elastomers (LCEs) containing light-sensitive molecules exhibit large reversible deformation when subjected to illumination. Here, we investigate the role of optical penetration depth on this photomechanical response. We present a model of the photomechanical behavior of photoactive LCE strips under illumination that goes beyond the common assumption of shallow penetration. This model reveals how the optical penetration depth and the consequent photomechanically induced deformation can depend on the concentration of photoactive molecules, their absorption cross-sections, and the intensity of illumination. Through a series of examples, we show that the penetration depth can quantitatively and qualitatively affect the photomechanical response of a strip. Shallow illumination leads to monotone curvature change while deep penetration can lead to non-monotone response with illumination duration. Further, the flapping behavior (a cyclic wave-like motion) of doubly clamped and buckled strips that has been proposed for locomotion can reverse direction with sufficiently large penetration depth. This opens the possibility of creating wireless light-driven photomechanical actuators and swimmers whose direction of motion can be controlled by light intensity and frequency.


title: Relationship of peak fluxes of solar radio bursts and X-ray class of solar flares: Application to early great solar flares

abstract: Large solar flares occasionally trigger significant space-weather disturbances that affect the technological infrastructures of modern civilization, and therefore require further investigation. Although these solar flares have been monitored by satellite observations since the 1970s, large solar flares occur only infrequently and restrict systematic statistical research owing to data limitations. However, Toyokawa Observatory has operated solar radio observations at low frequencies (at 3.75 and 9.4 GHz) since 1951 and captured the early great flares as solar radio bursts. To estimate the magnitudes of flares that occurred before the start of solar X-ray (SXR) observations with the Geostationary Operational Environmental Satellite (GOES) satellites, we show the relationship between microwave fluxes at 3.75 and 9.4 GHz and X-ray fluxes of flares that occurred after 1988. In total, we explored 341 solar flares observed with the Nobeyama Radio Polarimeters and Toyokawa Observatory from 1988-2014 and compared them with the SXR observations recorded by the GOES satellites. The correlation coefficient was approximately 0.7. Therefore, the GOES X-ray class can be estimated from the peak flux at 3.75 and 9.4 GHz with a large variance and an error of factor of 3 (1 sigma). Thus, for the first time, we quantitatively estimated the light curves of two early solar flares observed in 1956 February by the Toyokawa solar radio observations using the relationship between SXR thermal radiation and microwave nonthermal radiation (Neupert, 1968, ApJ, 153, 59).


title: Reconstructing the distortion function of non-local cosmology: a model-independent approach

abstract: We consider non-local modifications of General Relativity given by a distortion function in terms of the inverse of the d'Alembert operator. The inclusion of these terms is motivated by the possibility of reproducing the current accelerated expansion of the Universe starting from non-local gravity. In particular, we propose a model-independent method, based on current observations, to reconstruct the shape of the distortion function, without resorting to a specific cosmological history. We describe a numerical procedure based on Pad\'e polynomials that allows us to study the time evolution of the auxiliary scalar fields introduced to localize non-local gravity action. Thus, adopting suitable boundary conditions, we reconstruct the form of the non-local Lagrangian and infer the best analytical approximation of the numerical outcome. Furthermore, the distortion function turns on during the matter-dominated era, and its effects are delayed to the most recent cosmic times. This provides a natural explanation for the late cosmic acceleration, avoiding any fine-tuning problem of the cosmological constant. Finally, we compare our predictions with previous findings based on enforcing the standard $\Lambda$CDM background in the reconstruction process.


title: Speech-Based Human-Exoskeleton Interaction for Lower Limb Motion Planning

abstract: This study presents a speech-based motion planning strategy (SBMP) developed for lower limb exoskeletons to facilitate safe and compliant human-robot interaction. A speech processing system, finite state machine, and central pattern generator are the building blocks of the proposed strategy for online planning of the exoskeleton's trajectory. According to experimental evaluations, this speech-processing system achieved low levels of word and intent errors. Regarding locomotion, the completion time for users with voice commands was 54% faster than that using a mobile app interface. With the proposed SBMP, users are able to maintain their postural stability with both hands-free. This supports its use as an effective motion planning method for the assistance and rehabilitation of individuals with lower-limb impairments.


title: Magneto-Thermal Thin Shell Approximation for 3D Finite Element Analysis of No-Insulation Coils

abstract: For finite element (FE) analysis of no-insulation (NI) high-temperature superconducting (HTS) pancake coils, the high aspect ratio of the turn-to-turn contact layer (T2TCL) leads to meshing difficulties which result in either poor quality mesh elements resulting in a decrease of the solution accuracy or a high number of degrees of freedom. We proposed to mitigate this issue by collapsing the T2TCL volume into a surface and using a so-called thin shell approximation (TSA). Previously, two TSA have been introduced, one to solve the heat equation and the other for an $\vec{H}-\phi$ magnetodynamic formulation. In this work, we propose to combine the magnetodynamic and thermal TSA to create a coupled magneto-thermal TSA for three-dimensional FE analysis. Particular attention is paid to the detailed derivation of the coupling terms. In the context of NI HTS pancake coils, the TSA represents the electric and thermal contact resistance of the T2TCL. For the HTS coated conductor (CC) itself, an anisotropic homogenization is used which represents its multi-layered structure. In axial and azimuthal direction, it resolves the current sharing between the HTS and other layers of the CC. The coupled TSA formulation is verified against a reference model with volumetric T2TCL. The coupled TSA is shown to significantly reduce the solution time as well as the manual effort required for high-quality meshes of the T2TCL. The implementation is open-source and a reference implementation is made publicly available.


title: A polarization study of jets interacting with turbulent magnetic fields

abstract: We investigate the effect of the jet's immediate surroundings on the non-thermal synchrotron emission and its polarization properties. The ambient medium is equipped with a turbulent magnetic field, which is compressed and amplified by the jets as they progress. This leads to high polarization at the forward shock surface. The randomness in the magnetic polarities of the external fields in the shocked ambient medium (SAM) results in vector cancellation of the polarized components from the jet, thereby causing depolarization of the radiation from the cocoon. We find that due to the slow decay of the fields in the SAM, such depolarization by the fields with large correlation lengths is more prominent when compared to the small-scale fields. Also, the low-power jets, which have magnetic fields comparable in strength to those in the SAM, are more severely affected by the SAM's depolarizing effect, than the high-power ones. The turbulent backflows in the cocoon, as well as the shearing of fields near the contact discontinuity, strengthen the poloidal component in the jet. This causes internal depolarization due to the cancellation of the orthogonally polarized components along the Line of Sight as the field transitions from ordered toroidal to poloidal. The synchrotron maps display high-emission filaments in the cocoon with magnetic fields aligned along them. The kink instability leads to the wiggling motion of the jet's spine, resulting in hotspot complexes in low-power sources.


title: ViFiT: Reconstructing Vision Trajectories from IMU and Wi-Fi Fine Time Measurements

abstract: Tracking subjects in videos is one of the most widely used functions in camera-based IoT applications such as security surveillance, smart city traffic safety enhancement, vehicle to pedestrian communication and so on. In the computer vision domain, tracking is usually achieved by first detecting subjects with bounding boxes, then associating detected bounding boxes across video frames. For many IoT systems, images captured by cameras are usually sent over the network to be processed at a different site that has more powerful computing resources than edge devices. However, sending entire frames through the network causes significant bandwidth consumption that may exceed the system bandwidth constraints. To tackle this problem, we propose ViFiT, a transformer-based model that reconstructs vision bounding box trajectories from phone data (IMU and Fine Time Measurements). It leverages a transformer ability of better modeling long-term time series data. ViFiT is evaluated on Vi-Fi Dataset, a large-scale multimodal dataset in 5 diverse real world scenes, including indoor and outdoor environments. To fill the gap of proper metrics of jointly capturing the system characteristics of both tracking quality and video bandwidth reduction, we propose a novel evaluation framework dubbed Minimum Required Frames (MRF) and Minimum Required Frames Ratio (MRFR). ViFiT achieves an MRFR of 0.65 that outperforms the state-of-the-art approach for cross-modal reconstruction in LSTM Encoder-Decoder architecture X-Translator of 0.98, resulting in a high frame reduction rate as 97.76%.


title: The galaxy cluster AC114 -- II. Stellar populations and the mass-metallicity relation

abstract: We investigate the mass-metallicity relation for galaxies in the Abell cluster AC114 from 7 hours of VIMOS/MR data collected at the ESO-VLT telescope in 2009. The dynamical analysis completed in our previous paper allowed us to select cluster members, whose spectra are here analyzed with stellar population synthesis models. Active and passive galaxies are identified based on the presence/absence of the [\ion{O}{II}]\lambda3727, [\ion{O}{III}]\lambda\lambda4959,5007 and/or H\beta emission lines, depending on the galaxy redshift. We find that active galaxies have lower average masses than passive ones, and have lower average metallicities. The mass-metallicity relation (MZR) of the cluster is found to be steeper than that for galaxies in the local universe.


title: Design and Optimization of Heterogeneous Coded Distributed Computing with Nonuniform File Popularity

abstract: This paper studies MapReduce-based heterogeneous coded distributed computing (CDC) where, besides different computing capabilities at workers, input files to be accessed by computing jobs have nonuniform popularity. We propose a file placement strategy that can handle an arbitrary number of input files. Furthermore, we design a nested coded shuffling strategy that can efficiently manage the nonuniformity of file popularity to maximize the coded multicasting opportunity. We then formulate the joint optimization of the proposed file placement and nested shuffling design variables to optimize the proposed CDC scheme. To reduce the high computational complexity in solving the resulting mixed-integer linear programming (MILP) problem, we propose a simple two-file-group-based file placement approach to obtain an approximate solution. Numerical results show that the optimized CDC scheme outperforms other alternatives. Also, the proposed two-file-group-based approach achieves nearly the same performance as the conventional branch-and-cut method in solving the MILP problem but with substantially lower computational complexity that is scalable over the number of files and workers. For computing jobs with aggregate target functions that commonly appear in machine learning applications, we propose a heterogeneous compressed CDC (C-CDC) scheme to further improve the shuffling efficiency. The C-CDC scheme uses a local data aggregation technique to compress the data to be shuffled for the shuffling load reduction. We again optimize the proposed C-CDC scheme and explore the two-file-group-based low-complexity approach for an approximate solution. Numerical results show the proposed C-CDC scheme provides a considerable shuffling load reduction over the CDC scheme, and also, the two-file-group-based file placement approach maintains good performance.


title: One-Dimensional Crystallographic Etching of Few-Layer WS$_2$

abstract: Layer number-dependent band structures and symmetry are vital for the electrical and optical characteristics of two-dimensional (2D) transition metal dichalcogenides (TMDCs). Harvesting 2D TMDCs with tunable thickness and properties can be achieved through top-down etching and bottom-up growth strategies. In this study, we report a pioneering technique that utilizes the migration of in-situ generated Na-W-S-O droplets to etch out one-dimensional (1D) nanotrenches in few-layer WS$_2$. 1D WS$_2$ nanotrenches were successfully fabricated on the optically inert bilayer WS$_2$, showing pronounced photoluminescence and second harmonic generation signals. Additionally, we demonstrate the modulation of inkjet-printed Na$_2$WO$_4$-Na$_2$SO$_4$ particles to switch between the etching and growth modes by manipulating the sulfur supply. This versatile approach enables the creation of 1D nanochannels on 2D TMDCs. Our research presents exciting prospects for the top-down and bottom-up fabrication of 1D-2D mixed-dimensional TMDC nanostructures, expanding their use for photonic and optoelectronic applications.


title: Implementation of atmospheric proton spectrum in GEANT4 simulations for space applications

abstract: A major part of cosmic rays consists of the primary protons, and this portion plays a crucial role in the space applications such as shielding of spacecrafts. In this study, the proton flux values measured at the top of the atmosphere through the BESS-TeV spectrometer in 2004 are introduced into the GEANT4 simulations by using a probability grid that generates the corresponding discrete kinetic energies with a certain discrete probability. The introduced scheme is tested over a set of the shielding materials such as aluminum, polypropylene, Kevlar, polyethylene, and water by computing the total absorbed dose, which is the measure of the cumulative energy deposited in the investigated target volumes by protons per unit mass in Gy. It is shown that the present recipe provides the opportunity to use the discrete energy values together with the experimental flux values, thereby demonstrating a beneficial capability in the GEANT4 simulations for diverse space applications.


title: Collective depinning and sliding of a quantum Wigner solid in a 2D electron system

abstract: We report the observation of two-threshold voltage-current characteristics accompanied by a peak of broadband current noise between the two threshold voltages in the insulating state at low densities in the 2D electron system in ultra-high mobility SiGe/Si/SiGe heterostructures. The observed results can be described by a phenomenological theory of the collective depinning of elastic structures, which naturally generates a peak of a broadband current noise between the dynamic and static thresholds and changes to sliding of the solid over a pinning barrier above the static threshold. This gives compelling evidence for the electron solid formation in this electron system and shows the generality of the effect for different classes of electron systems.


title: Fairness-enhancing mixed effects deep learning improves fairness on in- and out-of-distribution clustered (non-iid) data

abstract: Traditional deep learning (DL) suffers from two core problems. Firstly, it assumes training samples are independent and identically distributed. However, numerous real-world datasets group samples by shared measurements (e.g., study participants or cells), violating this assumption. In these scenarios, DL can show compromised performance, limited generalization, and interpretability issues, coupled with cluster confounding causing Type 1 and 2 errors. Secondly, models are typically trained for overall accuracy, often neglecting underrepresented groups and introducing biases in crucial areas like loan approvals or determining health insurance rates, such biases can significantly impact one's quality of life. To address both of these challenges simultaneously, we present a mixed effects deep learning (MEDL) framework. MEDL separately quantifies cluster-invariant fixed effects (FE) and cluster-specific random effects (RE) through the introduction of: 1) a cluster adversary which encourages the learning of cluster-invariant FE, 2) a Bayesian neural network which quantifies the RE, and a mixing function combining the FE an RE into a mixed-effect prediction. We marry this MEDL with adversarial debiasing, which promotes equality-of-odds fairness across FE, RE, and ME predictions for fairness-sensitive variables. We evaluated our approach using three datasets: two from census/finance focusing on income classification and one from healthcare predicting hospitalization duration, a regression task. Our framework notably enhances fairness across all sensitive variables-increasing fairness up to 82% for age, 43% for race, 86% for sex, and 27% for marital-status. Besides promoting fairness, our method maintains the robust performance and clarity of MEDL. It's versatile, suitable for various dataset types and tasks, making it broadly applicable. Our GitHub repository houses the implementation.


title: Context-Based Tweet Engagement Prediction

abstract: Twitter is currently one of the biggest social media platforms. Its users may share, read, and engage with short posts called tweets. For the ACM Recommender Systems Conference 2020, Twitter published a dataset around 70 GB in size for the annual RecSys Challenge. In 2020, the RecSys Challenge invited participating teams to create models that would predict engagement likelihoods for given user-tweet combinations. The submitted models predicting like, reply, retweet, and quote engagements were evaluated based on two metrics: area under the precision-recall curve (PRAUC) and relative cross-entropy (RCE). In this diploma thesis, we used the RecSys 2020 Challenge dataset and evaluation procedure to investigate how well context alone may be used to predict tweet engagement likelihood. In doing so, we employed the Spark engine on TU Wien's Little Big Data Cluster to create scalable data preprocessing, feature engineering, feature selection, and machine learning pipelines. We manually created just under 200 additional features to describe tweet context. The results indicate that features describing users' prior engagement history and the popularity of hashtags and links in the tweet were the most informative. We also found that factors such as the prediction algorithm, training dataset size, training dataset sampling method, and feature selection significantly affect the results. After comparing the best results of our context-only prediction models with content-only models and with models developed by the Challenge winners, we identified that the context-based models underperformed in terms of the RCE score. This work thus concludes by situating this discrepancy and proposing potential improvements to our implementation, which is shared in a public git repository.


title: Multi-Task Learning For Reduced Popularity Bias In Multi-Territory Video Recommendations

abstract: Various data imbalances that naturally arise in a multi-territory personalized recommender system can lead to a significant item bias for globally prevalent items. A locally popular item can be overshadowed by a globally prevalent item. Moreover, users' viewership patterns/statistics can drastically change from one geographic location to another which may suggest to learn specific user embeddings. In this paper, we propose a multi-task learning (MTL) technique, along with an adaptive upsampling method to reduce popularity bias in multi-territory recommendations. Our proposed framework is designed to enrich training examples with active users representation through upsampling, and capable of learning geographic-based user embeddings by leveraging MTL. Through experiments, we demonstrate the effectiveness of our framework in multiple territories compared to a baseline not incorporating our proposed techniques.~Noticeably, we show improved relative gain of up to $65.27\%$ in PR-AUC metric. A case study is presented to demonstrate the advantages of our methods in attenuating the popularity bias of global items.


title: Attributing Learned Concepts in Neural Networks to Training Data

abstract: By now there is substantial evidence that deep learning models learn certain human-interpretable features as part of their internal representations of data. As having the right (or wrong) concepts is critical to trustworthy machine learning systems, it is natural to ask which inputs from the model's original training set were most important for learning a concept at a given layer. To answer this, we combine data attribution methods with methods for probing the concepts learned by a model. Training network and probe ensembles for two concept datasets on a range of network layers, we use the recently developed TRAK method for large-scale data attribution. We find some evidence for convergence, where removing the 10,000 top attributing images for a concept and retraining the model does not change the location of the concept in the network nor the probing sparsity of the concept. This suggests that rather than being highly dependent on a few specific examples, the features that inform the development of a concept are spread in a more diffuse manner across its exemplars, implying robustness in concept formation.


title: Federated Fine-Tuning of LLMs on the Very Edge: The Good, the Bad, the Ugly

abstract: Large Language Models (LLM) and foundation models are popular as they offer new opportunities for individuals and businesses to improve natural language processing, interact with data, and retrieve information faster. However, training or fine-tuning LLMs requires a vast amount of data, which can be challenging to access due to legal or technical restrictions and may require private computing resources. Federated Learning (FL) is a solution designed to overcome these challenges and expand data access for deep learning applications. This paper takes a hardware-centric approach to explore how LLMs can be brought to modern edge computing systems. Our study fine-tunes the FLAN-T5 model family, ranging from 80M to 3B parameters, using FL for a text summarization task. We provide a micro-level hardware benchmark, compare the model FLOP utilization to a state-of-the-art data center GPU, and study the network utilization in realistic conditions. Our contribution is twofold: First, we evaluate the current capabilities of edge computing systems and their potential for LLM FL workloads. Second, by comparing these systems with a data-center GPU, we demonstrate the potential for improvement and the next steps toward achieving greater computational efficiency at the edge.


title: Dynamic Changes of Brain Network during Epileptic Seizure

abstract: Epilepsy is a neurological disorder identified by sudden and recurrent seizures, which are believed to be accompanied by distinct changes in brain dynamics. Exploring the dynamic changes of brain network states during seizures can pave the way for improving the diagnosis and treatment of patients with epilepsy. In this paper, the connectivity brain network is constructed using the phase lag index (PLI) measurement within five frequency bands, and graph-theoretic techniques are employed to extract topological features from the brain network. Subsequently, an unsupervised clustering approach is used to examine the state transitions of the brain network during seizures. Our findings demonstrate that the level of brain synchrony during the seizure period is higher than the pre-seizure and post-seizure periods in the theta, alpha, and beta bands, while it decreases in the gamma bands. These changes in synchronization also lead to alterations in the topological features of functional brain networks during seizures. Additionally, our results suggest that the dynamics of the brain during seizures are more complex than the traditional three-state model (pre-seizure, seizure, and post-seizure) and the brain network state exhibits a slower rate of change during the seizure period compared to the pre-seizure and post-seizure periods.


title: Towards out-of-distribution generalizable predictions of chemical kinetics properties

abstract: Machine Learning (ML) techniques have found applications in estimating chemical kinetic properties. With the accumulated drug molecules identified through "AI4drug discovery", the next imperative lies in AI-driven design for high-throughput chemical synthesis processes, with the estimation of properties of unseen reactions with unexplored molecules. To this end, the existing ML approaches for kinetics property prediction are required to be Out-Of-Distribution (OOD) generalizable. In this paper, we categorize the OOD kinetic property prediction into three levels (structure, condition, and mechanism), revealing unique aspects of such problems. Under this framework, we create comprehensive datasets to benchmark (1) the state-of-the-art ML approaches for reaction prediction in the OOD setting and (2) the state-of-the-art graph OOD methods in kinetics property prediction problems. Our results demonstrated the challenges and opportunities in OOD kinetics property prediction. Our datasets and benchmarks can further support research in this direction.


title: Quantum category O vs affine Hecke category

abstract: The goal of this paper is to relate the quantum category $\mathcal{O}$ (known also as the category of modules over the mixed quantum group) at an odd root of unity to the affine Hecke category. Namely, we prove equivalences of highest weight categories between integral blocks of the affine category $\mathcal{O}$ and the heart of the so called ``new'' t-structure on the affine Hecke category. In order to do this we deform our categories over the formal neighborhood of $0$ in the dual affine Cartan and show that the categories of standardly filtered objects in the deformations are equivalent. For this, we construct functors from the deformed categories to the category of bimodules over the formal power series on the affine Cartan. Then we use what we call the Rouquier-Soergel theory, also developed in this paper, to show that on the categories of standardly filtered objects, these functors are full embeddings with the same image.


title: Search for stealth supersymmetry in final states with two photons, jets, and low missing transverse momentum in proton-proton collisions at $\sqrt{s}$ = 13 TeV

abstract: The results of a search for stealth supersymmetry in final states with two photons and jets, targeting a phase space region with low missing transverse momentum ($p_\text{T}^\text{miss}$), are reported. The study is based on a sample of proton-proton collisions at $\sqrt{s}$ = 13 TeV collected by the CMS experiment, corresponding to an integrated luminosity of 138 fb$^{-1}$. As LHC results continue to constrain the parameter space of the minimal supersymmetric standard model, the low $p_\text{T}^\text{miss}$ regime is increasingly valuable to explore. To estimate the backgrounds due to standard model processes in such events, we apply corrections derived from simulation to an estimate based on a control selection in data. The results are interpreted in the context of simplified stealth supersymmetry models with gluino and squark pair production. The observed data are consistent with the standard model predictions, and gluino (squark) masses of up to 2150 (1850) GeV are excluded at the 95% confidence level.


title: Large-Scale Modular and Uniformly Thick Origami-Inspired Adaptable and Load-Carrying Structures

abstract: Existing Civil Engineering structures have limited capability to adapt their configurations for new functions, non-stationary environments, or future reuse. Although origami principles provide capabilities of dense packaging and reconfiguration, existing origami systems have not achieved deployable metre-scale structures that can support large loads. Here, we established modular and uniformly thick origami-inspired structures that can deploy into metre-scale structures, adapt into different shapes, and carry remarkably large loads. This work first derives general conditions for degree-N origami vertices to be flat foldable, developable, and uniformly thick, and uses these conditions to create the proposed origami-inspired structures. We then show that these origami-inspired structures can utilize high modularity for rapid repair and adaptability of shapes and functions; can harness multi-path folding motions to reconfigure between storage and structural states; and can exploit uniform thickness to carry large loads. We believe concepts of modular and uniformly thick origami-inspired structures will challenge traditional practice in Civil Engineering by enabling large-scale, adaptable, deployable, and load-carrying structures, and offer broader applications in aerospace systems, space habitats, robotics, and more.


title: FedHyper: A Universal and Robust Learning Rate Scheduler for Federated Learning with Hypergradient Descent

abstract: The theoretical landscape of federated learning (FL) undergoes rapid evolution, but its practical application encounters a series of intricate challenges, and hyperparameter optimization is one of these critical challenges. Amongst the diverse adjustments in hyperparameters, the adaptation of the learning rate emerges as a crucial component, holding the promise of significantly enhancing the efficacy of FL systems. In response to this critical need, this paper presents FedHyper, a novel hypergradient-based learning rate adaptation algorithm specifically designed for FL. FedHyper serves as a universal learning rate scheduler that can adapt both global and local rates as the training progresses. In addition, FedHyper not only showcases unparalleled robustness to a spectrum of initial learning rate configurations but also significantly alleviates the necessity for laborious empirical learning rate adjustments. We provide a comprehensive theoretical analysis of FedHyper's convergence rate and conduct extensive experiments on vision and language benchmark datasets. The results demonstrate that FEDHYPER consistently converges 1.1-3x faster than FedAvg and the competing baselines while achieving superior final accuracy. Moreover, FedHyper catalyzes a remarkable surge in accuracy, augmenting it by up to 15% compared to FedAvg under suboptimal initial learning rate settings.


title: A Formal Transaction Cost-Based Analysis of the Economic Feasibility of Ecosystems

abstract: Ecosystems enjoy increasing attention due to their flexibility and innovative power. It is well known, however, that this type of network-based economic governance structures occupies a potentially unstable position between the two stable (governance) endpoints, namely the firm (i.e., hierarchical governance) and the (open) market (i.e., coordination through the monetary system). This paper develops a formal (mathematical) theory of the economic value of (generic) ecosystem by extending transaction costs economics using certain elements from service-dominant logic. Within a first-best setting of rational actors, we derive analytical solutions for the hub-and-spoke and generic ecosystem configurations under some uniformity assumptions of ecosystem participants. Additionally, we are able to infer a generic condition for the welfare-maximizing and utility-maximizing price of the hub-and-spoke configuration in the familiar form of Lerner indices and elasticities. Relinquishing a first-best rational actors approach, we additionally derive several general propositions on (i) necessary conditions for the economic feasibility of ecosystem-based transactions, (ii) scaling requirements for ecosystem stability, and (iii) a generic feasibility condition for arbitrary provider-consumer ecosystems. Finally, we present an algebraic definition of business ecosystems and relate it to existing informal definition attempts. Thereby we demonstrate that the property of "being an ecosystem" of a network of transacting actors cannot be decided on structural grounds alone.


title: Assessment of Prediction Intervals Using Uncertainty Characteristics Curves

abstract: Accurate quantification of model uncertainty has long been recognized as a fundamental requirement for trusted AI. In regression tasks, uncertainty is typically quantified using prediction intervals calibrated to an ad-hoc operating point, making evaluation and comparison across different studies relatively difficult. Our work leverages: (1) the concept of operating characteristics curves and (2) the notion of a gain over a null reference, to derive a novel operating point agnostic assessment methodology for prediction intervals. The paper defines the Uncertainty Characteristics Curve and demonstrates its utility in selected scenarios. We argue that the proposed method addresses the current need for comprehensive assessment of prediction intervals and thus represents a valuable addition to the uncertainty quantification toolbox.


title: New Auction Algorithms for the Assignment Problem and Extensions

abstract: We consider the classical linear assignment problem, and we introduce new auction algorithms for its optimal and suboptimal solution. The algorithms are founded on duality theory, and are related to ideas of competitive bidding by persons for objects and the attendant market equilibrium, which underlie real-life auction processes. We distinguish between two fundamentally different types of bidding mechanisms: aggressive and cooperative. Mathematically, aggressive bidding relies on a notion of approximate coordinate descent in dual space, an epsilon-complementary slackness condition to regulate the amount of descent approximation, and the idea of epsilon-scaling to resolve efficiently the price wars that occur naturally as multiple bidders compete for a smaller number of valuable objects. Cooperative bidding avoids price wars through detection and cooperative resolution of any competitive impasse that involves a group of persons. We discuss the relations between the aggressive and the cooperative bidding approaches, we derive new algorithms and variations that combine ideas from both of them, and we also make connections with other primal-dual methods, including the Hungarian method. Furthermore, our discussion points the way to algorithmic extensions that apply more broadly to network optimization, including shortest path, max-flow, transportation, and minimum cost flow problems with both linear and convex cost functions.