title: 2nd Place Solution for PVUW Challenge 2024: Video Panoptic Segmentation

abstract: Video Panoptic Segmentation (VPS) is a challenging task that is extends from image panoptic segmentation.VPS aims to simultaneously classify, track, segment all objects in a video, including both things and stuff. Due to its wide application in many downstream tasks such as video understanding, video editing, and autonomous driving. In order to deal with the task of video panoptic segmentation in the wild, we propose a robust integrated video panoptic segmentation solution. We use DVIS++ framework as our baseline to generate the initial masks. Then,we add an additional image semantic segmentation model to further improve the performance of semantic classes.Finally, our method achieves state-of-the-art performance with a VPQ score of 56.36 and 57.12 in the development and test phases, respectively, and ultimately ranked 2nd in the VPS track of the PVUW Challenge at CVPR2024.


title: Diffusion-based Image Generation for In-distribution Data Augmentation in Surface Defect Detection

abstract: In this study, we show that diffusion models can be used in industrial scenarios to improve the data augmentation procedure in the context of surface defect detection. In general, defect detection classifiers are trained on ground-truth data formed by normal samples (negative data) and samples with defects (positive data), where the latter are consistently fewer than normal samples. For these reasons, state-of-the-art data augmentation procedures add synthetic defect data by superimposing artifacts to normal samples. This leads to out-of-distribution augmented data so that the classification system learns what is not a normal sample but does not know what a defect really is. We show that diffusion models overcome this situation, providing more realistic in-distribution defects so that the model can learn the defect's genuine appearance. We propose a novel approach for data augmentation that mixes out-of-distribution with in-distribution samples, which we call In&Out. The approach can deal with two data augmentation setups: i) when no defects are available (zero-shot data augmentation) and ii) when defects are available, which can be in a small number (few-shot) or a large one (full-shot). We focus the experimental part on the most challenging benchmark in the state-of-the-art, i.e., the Kolektor Surface-Defect Dataset 2, defining the new state-of-the-art classification AP score under weak supervision of .782. The code is available at https://github.com/intelligolabs/in_and_out.


title: Non-geodesically-convex optimization in the Wasserstein space

abstract: We study a class of optimization problems in the Wasserstein space (the space of probability measures) where the objective function is \emph{nonconvex} along generalized geodesics. When the regularization term is the negative entropy, the optimization problem becomes a sampling problem where it minimizes the Kullback-Leibler divergence between a probability measure (optimization variable) and a target probability measure whose logarithmic probability density is a nonconvex function. We derive multiple convergence insights for a novel {\em semi Forward-Backward Euler scheme} under several nonconvex (and possibly nonsmooth) regimes. Notably, the semi Forward-Backward Euler is just a slight modification of the Forward-Backward Euler whose convergence is -- to our knowledge -- still unknown in our very general non-geodesically-convex setting.


title: Schr\"{o}dinger Bridge with Quadratic State Cost is Exactly Solvable

abstract: Schr\"odinger bridge is a diffusion process that steers a given distribution to another in a prescribed time while minimizing the effort to do so. It can be seen as the stochastic dynamical version of the optimal mass transport, and has growing applications in generative diffusion models and stochastic optimal control. In this work, we propose a regularized variant of the Schr\"odinger bridge with a quadratic state cost-to-go that incentivizes the optimal sample paths to stay close to a nominal level. Unlike the conventional Schr\"odinger bridge, the regularization induces a state-dependent rate of killing and creation of probability mass, and its solution requires determining the Markov kernel of a reaction-diffusion partial differential equation. We derive this Markov kernel in closed form. Our solution recovers the heat kernel in the vanishing regularization (i.e., diffusion without reaction) limit, thereby recovering the solution of the conventional Schr\"odinger bridge. Our results enable the use of dynamic Sinkhorn recursion for computing the Schr\"odinger bridge with a quadratic state cost-to-go, which would otherwise be challenging to use in this setting. We deduce properties of the new kernel and explain its connections with certain exactly solvable models in quantum mechanics.

categories: math.OC cs.LG cs.SY eess.SY math-ph math.MP stat.ML


title: Research on an Autonomous UAV Search and Rescue System Based on the Improved

abstract: The demand is to solve the issue of UAV (unmanned aerial vehicle) operating autonomously and implementing practical functions such as search and rescue in complex unknown environments. This paper proposes an autonomous search and rescue UAV system based on an EGO-Planner algorithm, which is improved by innovative UAV body application and takes the methods of inverse motor backstepping to enhance the overall flight efficiency of the UAV and miniaturization of the whole machine. At the same time, the system introduced the EGO-Planner planning tool, which is optimized by a bidirectional A* algorithm along with an object detection algorithm. It solves the issue of intelligent obstacle avoidance and search and rescue. Through the simulation and field verification work, and compared with traditional algorithms, this method shows more efficiency and reliability in the task. In addition, due to the existing algorithm's improved robustness, this application shows good prospection.


title: Improving Text Generation on Images with Synthetic Captions

abstract: The recent emergence of latent diffusion models such as SDXL and SD 1.5 has shown significant capability in generating highly detailed and realistic images. Despite their remarkable ability to produce images, generating accurate text within images still remains a challenging task. In this paper, we examine the validity of fine-tuning approaches in generating legible text within the image. We propose a low-cost approach by leveraging SDXL without any time-consuming training on large-scale datasets. The proposed strategy employs a fine-tuning technique that examines the effects of data refinement levels and synthetic captions. Moreover, our results demonstrate how our small scale fine-tuning approach can improve the accuracy of text generation in different scenarios without the need of additional multimodal encoders. Our experiments show that with the addition of random letters to our raw dataset, our model's performance improves in producing well-formed visual text.


title: Dynamics of the transitions epochs in cosmological evolution

abstract: We study two transition periods in cosmology: radiation-to-matter and matter-to-dark energy. In each case, we define a new parameter $\chi$ given by the ratios of the two energy densities involved in the transition. Our study of the second epoch is motivated by the need to understand cosmic acceleration. Assuming a dynamic dark energy is the driving force for cosmic acceleration, we formulate a new equation of state for the dark energy given in terms of the ratio $\chi$ and the deceleration parameter, $q$. We have analysed the resultant system of equations, where we vary different parameters and examine the effect on the universe's evolution. For cosmic acceleration to occur, the EoS of the dynamic dark energy must lie in the interval $\omega_{DDE}<-2/3$ at matter-dynamic dark energy equality( equivalently $\omega_{DDE}<-0.47$ today)


title: Prompt Chaining or Stepwise Prompt? Refinement in Text Summarization

abstract: Large language models (LLMs) have demonstrated the capacity to improve summary quality by mirroring a human-like iterative process of critique and refinement starting from the initial draft. Two strategies are designed to perform this iterative process: Prompt Chaining and Stepwise Prompt. Prompt chaining orchestrates the drafting, critiquing, and refining phases through a series of three discrete prompts, while Stepwise prompt integrates these phases within a single prompt. However, the relative effectiveness of the two methods has not been extensively studied. This paper is dedicated to examining and comparing these two methods in the context of text summarization to ascertain which method stands out as the most effective. Experimental results show that the prompt chaining method can produce a more favorable outcome. This might be because stepwise prompt might produce a simulated refinement process according to our various experiments. Since refinement is adaptable to diverse tasks, our conclusions have the potential to be extrapolated to other applications, thereby offering insights that may contribute to the broader development of LLMs.


title: FlowIE: Efficient Image Enhancement via Rectified Flow

abstract: Image enhancement holds extensive applications in real-world scenarios due to complex environments and limitations of imaging devices. Conventional methods are often constrained by their tailored models, resulting in diminished robustness when confronted with challenging degradation conditions. In response, we propose FlowIE, a simple yet highly effective flow-based image enhancement framework that estimates straight-line paths from an elementary distribution to high-quality images. Unlike previous diffusion-based methods that suffer from long-time inference, FlowIE constructs a linear many-to-one transport mapping via conditioned rectified flow. The rectification straightens the trajectories of probability transfer, accelerating inference by an order of magnitude. This design enables our FlowIE to fully exploit rich knowledge in the pre-trained diffusion model, rendering it well-suited for various real-world applications. Moreover, we devise a faster inference algorithm, inspired by Lagrange's Mean Value Theorem, harnessing midpoint tangent direction to optimize path estimation, ultimately yielding visually superior results. Thanks to these designs, our FlowIE adeptly manages a diverse range of enhancement tasks within a concise sequence of fewer than 5 steps. Our contributions are rigorously validated through comprehensive experiments on synthetic and real-world datasets, unveiling the compelling efficacy and efficiency of our proposed FlowIE. Code is available at https://github.com/EternalEvan/FlowIE.


title: Empirical influence functions to understand the logic of fine-tuning

abstract: Understanding the process of learning in neural networks is crucial for improving their performance and interpreting their behavior. This can be approximately understood by asking how a model's output is influenced when we fine-tune on a new training sample. There are desiderata for such influences, such as decreasing influence with semantic distance, sparseness, noise invariance, transitive causality, and logical consistency. Here we use the empirical influence measured using fine-tuning to demonstrate how individual training samples affect outputs. We show that these desiderata are violated for both for simple convolutional networks and for a modern LLM. We also illustrate how prompting can partially rescue this failure. Our paper presents an efficient and practical way of quantifying how well neural networks learn from fine-tuning stimuli. Our results suggest that popular models cannot generalize or perform logic in the way they appear to.


title: Learning Background Prompts to Discover Implicit Knowledge for Open Vocabulary Object Detection

abstract: Open vocabulary object detection (OVD) aims at seeking an optimal object detector capable of recognizing objects from both base and novel categories. Recent advances leverage knowledge distillation to transfer insightful knowledge from pre-trained large-scale vision-language models to the task of object detection, significantly generalizing the powerful capabilities of the detector to identify more unknown object categories. However, these methods face significant challenges in background interpretation and model overfitting and thus often result in the loss of crucial background knowledge, giving rise to sub-optimal inference performance of the detector. To mitigate these issues, we present a novel OVD framework termed LBP to propose learning background prompts to harness explored implicit background knowledge, thus enhancing the detection performance w.r.t. base and novel categories. Specifically, we devise three modules: Background Category-specific Prompt, Background Object Discovery, and Inference Probability Rectification, to empower the detector to discover, represent, and leverage implicit object knowledge explored from background proposals. Evaluation on two benchmark datasets, OV-COCO and OV-LVIS, demonstrates the superiority of our proposed method over existing state-of-the-art approaches in handling the OVD tasks.


title: Clinical utility of automatic treatment planning for proton therapy of head-and-neck cancer patients using JulianA

abstract: Background: Automatic treatment planning promises many benefits for both research and clinical environments. For clinics, autoplanning promises to reduce planning time and achieve more comparable treatment plans and thereby reduce inter-planner variability. Further, it can assist clinicians in quality assurance by providing a minimum plan quality standard. Finally, autoplanning is an essential part of patient selection, which is crucial for the advancement of proton therapy itself. Methods: A retrospective planning study using a cohort of 17 head-and-neck cancer patients treated at our institute. The clinically accepted plans created by dosimetrists (d-plans) were compared to automatically generated JulianA plans (j-plans). Both methods used the same beam arrangement. The plans were analysed by two expert reviewers without knowing how each plan was created. They assessed the plan quality and stated a preference. Results: All of the j-plans were deemed rather or clearly acceptable, resulting in a higher acceptability than the d-plans. The j-plan was considered superior in 14 (82.4%) cases, of equal quality for 1 (5.9%) and inferior to the d-plan for only 2 (11.8%) of the cases. The reviewers concluded that JulianA achieves more conformal dose distributions for the 15 (88.2%) cases where the j-plans were at least as good as the d-plans. Conclusions: The results show that the JulianA is ready to be used as a clinical quality assurance tool and research platform at our institute. While these results are encouraging, further research is needed to reduce the number of spots further and introduce robustness considerations into the optimisation algorithm in order to employ it on a daily basis for patient treatment.


title: On the use of first and second derivative approximations for biometric online signature recognition

abstract: This paper investigates the impact of different approximation methods in feature extraction for pattern recognition applications, specifically focused on delta and delta-delta parameters. Using MCYT330 online signature data-base, our experiments show that 11-point approximation outperforms 1-point approximation, resulting in a 1.4% improvement in identification rate, 36.8% reduction in random forgeries and 2.4% reduction in skilled forgeries


title: Kernel-based Minimal Distributed Charges: A Conformationally Dependent ESP-Model for Molecular Simulations

abstract: A kernel-based method (kernelized minimal distributed charge model - kMDCM) to represent the molecular electrostatic potential (ESP) in terms of off-center point charges whose positions adapts to the molecular geometry. Using Gaussian kernels and atom-atom distances as the features, the ESP for water and methanol is shown to improve by at least a factor of two compared with point charge models fit to an ensemble of structures. Combining kMDCM for the electrostatics and reproducing kernels for the bonded terms allows energy-conserving simulation of 2000 water molecules with periodic boundary conditions on the nanosecond time scale.


title: Evolution of the rotating Rayleigh-Taylor instability under the influence of magnetic fields

abstract: The combined effects of imposed vertical mean magnetic field (B0) and rotation on heat transfer phenomenon driven by the Rayleigh-Taylor instability are investigated using DNS. In the hydrodynamic (HD) case (B0 = 0), as the rotation rate f increases from 4 to 8, the Coriolis force suppresses the growth of mixing layer height (h) and u3', leading to a reduction in heat transport. The imposed B0 forms vertically elongated thermal plumes that exhibit larger u3' and efficiently transport heat between hot and cold fluid. Therefore, we observe an enhancement in heat transfer in the initial regime of unbroken elongated plumes in f=0 MHD cases compared to the corresponding HD case. In the mixing regime, the flow is collimated along the vertical magnetic field lines due to imposed B0, resulting in a decrease in u3' and an increase in growth of h compared to f=0 HD case. This increase in h enhances heat transfer in the mixing regime of f=0 MHD over the corresponding HD case. When rotation is added along with imposed B0, the growth and breakdown of vertically elongated plumes are inhibited by the Coriolis force, reducing h and u3'. Consequently, heat transfer is also reduced in rotating MHD cases compared to corresponding f=0 MHD cases. The heat transfer in rotating MHD cases remains higher than in corresponding rotating HD cases. This also suggests that B0 mitigates the instability-suppressing effect of the Coriolis force. The t.k.e. budget reveals the conversion of t.k.e., generated by the buoyancy flux, into t.m.e..


title: A Survey on Large Language Models for Code Generation

abstract: Large Language Models (LLMs) have garnered remarkable advancements across diverse code-related tasks, known as Code LLMs, particularly in code generation that generates source code with LLM from natural language descriptions. This burgeoning field has captured significant interest from both academic researchers and industry professionals due to its practical significance in software development, e.g., GitHub Copilot. Despite the active exploration of LLMs for a variety of code tasks, either from the perspective of natural language processing (NLP) or software engineering (SE) or both, there is a noticeable absence of a comprehensive and up-to-date literature review dedicated to LLM for code generation. In this survey, we aim to bridge this gap by providing a systematic literature review that serves as a valuable reference for researchers investigating the cutting-edge progress in LLMs for code generation. We introduce a taxonomy to categorize and discuss the recent developments in LLMs for code generation, covering aspects such as data curation, latest advances, performance evaluation, and real-world applications. In addition, we present a historical overview of the evolution of LLMs for code generation and offer an empirical comparison using the widely recognized HumanEval and MBPP benchmarks to highlight the progressive enhancements in LLM capabilities for code generation. We identify critical challenges and promising opportunities regarding the gap between academia and practical development. Furthermore, we have established a dedicated resource website (https://codellm.github.io) to continuously document and disseminate the most recent advances in the field.


title: Deep Learning based Performance Testing for Analog Integrated Circuits

abstract: In this paper, we propose a deep learning based performance testing framework to minimize the number of required test modules while guaranteeing the accuracy requirement, where a test module corresponds to a combination of one circuit and one stimulus. First, we apply a deep neural network (DNN) to establish the mapping from the response of the circuit under test (CUT) in each module to all specifications to be tested. Then, the required test modules are selected by solving a 0-1 integer programming problem. Finally, the predictions from the selected test modules are combined by a DNN to form the specification estimations. The simulation results validate the proposed approach in terms of testing accuracy and cost.


title: The Complex Star Formation History of the Halo of NGC 5128 (Cen A)

abstract: NGC 5128 (Cen A) is the nearest giant elliptical galaxy and one of the brightest extragalactic radio sources in the sky, boasting a prominent dust lane and jets emanating from its nuclear supermassive black hole. In this paper, we construct the star formation history (SFH) of two small fields in the halo of NGC 5128: a northeastern field (Field 1) at a projected distance of $\sim 18.8$ kpc from the center, and a southern field (Field 2) $\sim 9.9$ kpc from the center. Our method is based on identifying long period variable (LPV) stars that trace their sibling stellar population and hence historical star formation due to their high luminosity and strong variability; we identified 395 LPVs in Field 1 and 671 LPVs in Field 2. Even though the two fields are $\sim 28$ kpc apart on opposite sides from the center, they show similar SFHs. In Field 1, star formation rates (SFRs) increased significantly around $t\sim 800$ Myr and $t\sim 3.8$ Gyr; and in Field 2, SFRs increased considerably around $t\sim 800$ Myr, $t\sim 3.8$ Gyr, and $t\sim 6.3$ Gyr, where $t$ is look--back time. The increase in SFR $\sim 800$ Myr ago agrees with previous suggestions that the galaxy experienced a merger around that time. The SFH reconstructed from LPVs supports a scenario in which multiple episodes of nuclear activity lead to episodic jet-induced star formation. While there is no catalog of LPVs for the central part of NGC 5128, applying our method to the outer regions (for the first time in a galaxy outside the Local Group) has enabled us to put constraints on the complex evolution of this cornerstone galaxy.


title: Learning to Play Air Hockey with Model-Based Deep Reinforcement Learning

abstract: In the context of addressing the Robot Air Hockey Challenge 2023, we investigate the applicability of model-based deep reinforcement learning to acquire a policy capable of autonomously playing air hockey. Our agents learn solely from sparse rewards while incorporating self-play to iteratively refine their behaviour over time. The robotic manipulator is interfaced using continuous high-level actions for position-based control in the Cartesian plane while having partial observability of the environment with stochastic transitions. We demonstrate that agents are prone to overfitting when trained solely against a single playstyle, highlighting the importance of self-play for generalization to novel strategies of unseen opponents. Furthermore, the impact of the imagination horizon is explored in the competitive setting of the highly dynamic game of air hockey, with longer horizons resulting in more stable learning and better overall performance.


title: Learning Discrete Concepts in Latent Hierarchical Models

abstract: Learning concepts from natural high-dimensional data (e.g., images) holds potential in building human-aligned and interpretable machine learning models. Despite its encouraging prospect, formalization and theoretical insights into this crucial task are still lacking. In this work, we formalize concepts as discrete latent causal variables that are related via a hierarchical causal model that encodes different abstraction levels of concepts embedded in high-dimensional data (e.g., a dog breed and its eye shapes in natural images). We formulate conditions to facilitate the identification of the proposed causal model, which reveals when learning such concepts from unsupervised data is possible. Our conditions permit complex causal hierarchical structures beyond latent trees and multi-level directed acyclic graphs in prior work and can handle high-dimensional, continuous observed variables, which is well-suited for unstructured data modalities such as images. We substantiate our theoretical claims with synthetic data experiments. Further, we discuss our theory's implications for understanding the underlying mechanisms of latent diffusion models and provide corresponding empirical evidence for our theoretical insights.


title: The temporal evolution of non-neutralized electric currents and the complexity of solar active regions

abstract: We study the evolution of electric currents during the emergence of magnetic flux in the solar photosphere and the differences exhibited between solar active regions of different Hale complexity classes. A sample of 59 active regions was analyzed using a method based on image segmentation and error analysis to determine the total amount of non-neutralized electric current along their magnetic polarity inversion lines. The time series of the total unsigned non-neutralized electric current, $I_{NN,tot}$, exhibit intricate structure in the form of distinct peaks and valleys. This information is largely missing in the respective time series of the total unsigned vertical electric current $I_z$. Active regions with $\delta$- spots stand out, exhibiting 1.9 times higher flux emergence rate and 2.6 times higher $I_{NN,tot}$ increase. The median value of their peak $I_{NN,tot}$ is equal to $3.6\cdot10^12$ A, which is more than three times higher than that of the other regions of the sample. An automated detection algorithm was also developed to pinpoint the injection events of non-neutralized electric current. The injection rates and duration of these events were higher with increasing complexity of active regions, with regions containing $\delta$-spots exhibiting the strongest and longest events. These events do not necessarily coincide with increasing magnetic flux, although they exhibit moderate correlation. We conclude that net electric currents are injected during flux emergence, but are also shaped drastically by the incurred photospheric evolution, as active regions grow and evolve.


title: Chaos controlled and disorder driven phase transitions by breaking permutation symmetry

abstract: Introducing disorder in a system typically breaks symmetries and can introduce dramatic changes in its properties such as localization. At the same time, the clean system can have distinct many-body features depending on how chaotic it is. In this work the effect of permutation symmetry breaking by disorder is studied in a system which has a controllable and deterministic regular to chaotic transition. Results indicate a continuous phase transition from an area-law to a volume-law entangled phase irrespective of whether there is chaos or not, as the strength of the disorder is increased. The critical disorder strength obtained by finite size scaling, indicate a strong dependence on whether the clean system is regular or chaotic to begin with. In the process, we also obtain the critical exponents associated with this phase transition. Additionally, we find that a relatively small disorder is seen to be sufficient to delocalize a chaotic system.


title: Wav2Prompt: End-to-End Speech Prompt Generation and Tuning For LLM in Zero and Few-shot Learning

abstract: Wav2Prompt is proposed which allows straightforward integration between spoken input and a text-based large language model (LLM). Wav2Prompt uses a simple training process with only the same data used to train an automatic speech recognition (ASR) model. After training, Wav2Prompt learns continuous representations from speech and uses them as LLM prompts. To avoid task over-fitting issues found in prior work and preserve the emergent abilities of LLMs, Wav2Prompt takes LLM token embeddings as the training targets and utilises a continuous integrate-and-fire mechanism for explicit speech-text alignment. Therefore, a Wav2Prompt-LLM combination can be applied to zero-shot spoken language tasks such as speech translation (ST), speech understanding (SLU), speech question answering (SQA) and spoken-query-based QA (SQQA). It is shown that for these zero-shot tasks, Wav2Prompt performs similarly to an ASR-LLM cascade and better than recent prior work. If relatively small amounts of task-specific paired data are available in few-shot scenarios, the Wav2Prompt-LLM combination can be end-to-end (E2E) fine-tuned. The Wav2Prompt-LLM combination then yields greatly improved results relative to an ASR-LLM cascade for the above tasks. For instance, for English-French ST with the BLOOMZ-7B1 LLM, a Wav2Prompt-LLM combination gave a 8.5 BLEU point increase over an ASR-LLM cascade.


title: Stealing Trust: Unveiling Vulnerabilities in Web3 Authentication

abstract: As the field of Web3 continues its rapid expansion, the security of Web3 authentication, often the gateway to various Web3 applications, becomes increasingly crucial. Despite its widespread use as a login method by numerous Web3 applications, the security risks of Web3 authentication have not received much attention. This paper investigates the vulnerabilities in the Web3 authentication process and proposes a new type of attack. In attacks, attackers trick users into blindly signing messages from target applications by exploiting users' inability to verify the source of messages, thereby achieving unauthorized access to the target application. We have developed Web3AuthChecker, a dynamic detection tool that interacts with Web3 authentication-related APIs to identify vulnerabilities. Our evaluation of real-world Web3 applications shows that a staggering 75.8\% (22/29) of Web3 authentication deployments are at risk of attacks. In response to this alarming situation, we implemented Web3AuthGuard on the open-source wallet MetaMask to alert users of potential attacks. Our evaluation results show that Web3AuthGuard can successfully raise alerts in 80\% of the tested Web3 authentications. We have responsibly reported our findings to vulnerable websites and have been assigned two CVE IDs.


title: Adaptive boosting with dynamic weight adjustment

abstract: Adaptive Boosting with Dynamic Weight Adjustment is an enhancement of the traditional Adaptive boosting commonly known as AdaBoost, a powerful ensemble learning technique. Adaptive Boosting with Dynamic Weight Adjustment technique improves the efficiency and accuracy by dynamically updating the weights of the instances based on prediction error where the weights are updated in proportion to the error rather than updating weights uniformly as we do in traditional Adaboost. Adaptive Boosting with Dynamic Weight Adjustment performs better than Adaptive Boosting as it can handle more complex data relations, allowing our model to handle imbalances and noise better, leading to more accurate and balanced predictions. The proposed model provides a more flexible and effective approach for boosting, particularly in challenging classification tasks.


title: Majorana mass generation, gravitational waves and cosmological tensions

abstract: A neutrino Majorana mass generation in the early universe might have left imprints in cosmological observables. It can source the production of a detectable stochastic background of primordial gravitational waves with a spectrum that combines a contribution from a first order phase transition production and from the vibration of global cosmic strings. An intriguing possibility is given by the split seesaw model. In this case, in addition to the traditional high scale seesaw, a low scale neutrino Majorana mass generation can solve a potential primordial deuterium problem and ameliorate the cosmological tensions of the $\Lambda$CDM model. At the same time, it can also produce subdominant contribution to the NANOGrav signal of a stochastic background of gravitational waves (GWs), in addition to the astrophysical dominant contribution from supermassive black hole mergers.


title: Early-time small-scale structures in hot-exoplanet atmosphere simulations

abstract: We report on the critical influence of small-scale flow structures (e.g., fronts, vortices, and waves) that immediately arise in hot-exoplanet atmosphere simulations initialized with a resting state. A hot, 1:1 spin-orbit synchronized Jupiter is used here as a clear example; but, the phenomenon is generic and important for any type of hot synchronized planet--gaseous, oceanic, or telluric. When the early-time structures are not captured in simulations (due to, e.g., poor resolution and/or too much dissipation), the flow behavior is markedly different at later times--in an observationally significant way; for example, the flow at large-scale is smoother and much less dynamic. This results in the temperature field, and its corresponding thermal flux, to be incorrectly predicted in numerical simulations, even when the quantities are spatially averaged.


title: Estimating the Number of Street Vendors in New York City

abstract: We estimate the number of street vendors in New York City. We first summarize the process by which vendors receive licenses and permits to legally operate in New York City. We then describe a survey that was administered by the Street Vendor Project while distributing Coronavirus relief aid to vendors operating in New York City both with and without a license or permit. Finally, we calculate the total number of vendors using ratio estimation. We find that approximately 23,000 street vendors operate in New York City: 20,500 mobile food vendors and 2,300 general merchandise vendors. One third are located in just six ZIP Codes: 11368 (16%), 11372 (3%), and 11354 (3%) in North and West Queens and 10036 (5%), 10019 (4%), and 10001 (3%) in the Chelsea and Clinton neighborhoods of Manhattan. We also provide a theoretical justification of our estimates based on the theory of point processes and a discussion of their accuracy and implications. In particular, our estimates suggest the American Community Survey fails to cover the majority of New York City street vendors.


title: The Firefighter Algorithm: A Hybrid Metaheuristic for Optimization Problems

abstract: This paper presents the Firefighter Optimization (FFO) algorithm as a new hybrid metaheuristic for optimization problems. This algorithm stems inspiration from the collaborative strategies often deployed by firefighters in firefighting activities. To evaluate the performance of FFO, extensive experiments were conducted, wherein the FFO was examined against 13 commonly used optimization algorithms, namely, the Ant Colony Optimization (ACO), Bat Algorithm (BA), Biogeography-Based Optimization (BBO), Flower Pollination Algorithm (FPA), Genetic Algorithm (GA), Grey Wolf Optimizer (GWO), Harmony Search (HS), Particle Swarm Optimization (PSO), Simulated Annealing (SA), Tabu Search (TS), and Whale Optimization Algorithm (WOA), and across 24 benchmark functions of various dimensions and complexities. The results demonstrate that FFO achieves comparative performance and, in some scenarios, outperforms commonly adopted optimization algorithms in terms of the obtained fitness, time taken for exaction, and research space covered per unit of time.


title: On the Use of Anchoring for Training Vision Models

abstract: Anchoring is a recent, architecture-agnostic principle for training deep neural networks that has been shown to significantly improve uncertainty estimation, calibration, and extrapolation capabilities. In this paper, we systematically explore anchoring as a general protocol for training vision models, providing fundamental insights into its training and inference processes and their implications for generalization and safety. Despite its promise, we identify a critical problem in anchored training that can lead to an increased risk of learning undesirable shortcuts, thereby limiting its generalization capabilities. To address this, we introduce a new anchored training protocol that employs a simple regularizer to mitigate this issue and significantly enhances generalization. We empirically evaluate our proposed approach across datasets and architectures of varying scales and complexities, demonstrating substantial performance gains in generalization and safety metrics compared to the standard training protocol.


title: A Near Quantum Limited Sub-GHz TiN Kinetic Inductance Traveling Wave Parametric Amplifier Operating in a Frequency Translating Mode

abstract: We present the design and experimental characterization of a kinetic-inductance traveling-wave parametric amplifier (KI-TWPA) for sub-GHz frequencies. KI-TWPAs amplify signals through nonlinear mixing processes supported by the nonlinear kinetic inductance of a superconducting transmission line. The device described here utilizes a compactly meandered TiN microstrip transmission line to achieve the length needed to amplify sub-GHz signals. It is operated in a frequency translating mode where the amplified signal tone is terminated at the output of the amplifier, and the idler tone at approximately 2.5~GHz is brought out of the cryostat. By varying the pump frequency, a gain of up to 22 dB was achieved in a tunable range from about 450 to 850~MHz. Use of TiN as the nonlinear element allows for a reduction of the required pump power by roughly an order of magnitude relative to NbTiN, which has been used for previous KI-TWPA implementations. This amplifier has the potential to enable high-sensitivity and high-speed measurements in a wide range of applications, such as quantum computing, astrophysics, and dark matter detection.


title: Neutrino oscillation with minimal length uncertainty relation via wave packet approach

abstract: Theories of Quantum Gravity as well as string theory suggest the existence of a minimal measurable length and the related Generalized Uncertainty Principle (GUP). The universality of Quantum Gravity implies that the GUP influences every quantum mechanical process. Neutrino oscillation as a quantum phenomenon exhibits quantumness at macroscopic distances and could provide potentially a suitable room for quantum foundation explorations. In this paper, we perturbatively derive the neutrino oscillation probability based on the GUP and by treating neutrinos as wave packets. We see that the GUP modifications are dependent on the effective position width of the transition amplitude $\sigma_x$ such that with the smaller $\sigma_x$ we can obtain a stronger bound on the minimal length scale in comparison to what is expected from standard model interactions. More explicitly, one can obtain an upper bound about $5\times 10^{25}$ for the deformation parameter, $\beta_0$, with accelerator neutrino experiments such as MINOS, provided that $\sigma_x\sim 10^{-15}\text{m}$ which is reasonable since the energy of these neutrinos is of the order of a few GeV.


title: Breast Cancer Diagnosis: A Comprehensive Exploration of Explainable Artificial Intelligence (XAI) Techniques

abstract: Breast cancer (BC) stands as one of the most common malignancies affecting women worldwide, necessitating advancements in diagnostic methodologies for better clinical outcomes. This article provides a comprehensive exploration of the application of Explainable Artificial Intelligence (XAI) techniques in the detection and diagnosis of breast cancer. As Artificial Intelligence (AI) technologies continue to permeate the healthcare sector, particularly in oncology, the need for transparent and interpretable models becomes imperative to enhance clinical decision-making and patient care. This review discusses the integration of various XAI approaches, such as SHAP, LIME, Grad-CAM, and others, with machine learning and deep learning models utilized in breast cancer detection and classification. By investigating the modalities of breast cancer datasets, including mammograms, ultrasounds and their processing with AI, the paper highlights how XAI can lead to more accurate diagnoses and personalized treatment plans. It also examines the challenges in implementing these techniques and the importance of developing standardized metrics for evaluating XAI's effectiveness in clinical settings. Through detailed analysis and discussion, this article aims to highlight the potential of XAI in bridging the gap between complex AI models and practical healthcare applications, thereby fostering trust and understanding among medical professionals and improving patient outcomes.


title: Generation of tripartite entangled states with fermionic systems

abstract: We propose a protocol based on a tunneling plus particle-detection process aimed at generating tripartite entanglement in a system of 3 indistinguishable fermions in a triple-well potential, initially prepared in a state exhibiting only exchange correlations. Particular attention is paid to the generation of fermionic ghz- and w-type states, which are analogous to the usual ghz- and w-type states defined in composites of distinguishable qubits. The protocol succeeds in generating fermionic w-type states, and the ensuing state becomes effectively equivalent to a 3-distinguishable-qubit w-type state shared among three localized parties. The protocol, however, is unable to generate ghz-type states, a result that highlights the fundamental inequivalence between these two types of states, and throws light into the characterization of processes that guarantee the emergence of specific kinds of multipartite entanglement in systems of identical parties. Our findings suggest new paths for the exploration, generation and exploitation of multipartite entanglement in composites of indistinguishable particles, as a useful resource for quantum information processing.


title: Spectral scheme for atomic structure calculations in density functional theory

abstract: We present a spectral scheme for atomic structure calculations in pseudopotential Kohn-Sham density functional theory. In particular, after applying an exponential transformation of the radial coordinates, we employ global polynomial interpolation on a Chebyshev grid, with derivative operators approximated using the Chebyshev differentiation matrix, and integrations using Clenshaw-Curtis quadrature. We demonstrate the accuracy and efficiency of the scheme through spin-polarized and unpolarized calculations for representative atoms, while considering local, semilocal, and hybrid exchange-correlation functionals. In particular, we find that $\mathcal{O}$(200) grid points are sufficient to achieve an accuracy of 1 microhartree in the eigenvalues for optimized norm conserving Vanderbilt pseudopotentials spanning the periodic table from atomic number $Z = 1$ to $83$.


title: Causal Contrastive Learning for Counterfactual Regression Over Time

abstract: Estimating treatment effects over time holds significance in various domains, including precision medicine, epidemiology, economy, and marketing. This paper introduces a unique approach to counterfactual regression over time, emphasizing long-term predictions. Distinguishing itself from existing models like Causal Transformer, our approach highlights the efficacy of employing RNNs for long-term forecasting, complemented by Contrastive Predictive Coding (CPC) and Information Maximization (InfoMax). Emphasizing efficiency, we avoid the need for computationally expensive transformers. Leveraging CPC, our method captures long-term dependencies in the presence of time-varying confounders. Notably, recent models have disregarded the importance of invertible representation, compromising identification assumptions. To remedy this, we employ the InfoMax principle, maximizing a lower bound of mutual information between sequence data and its representation. Our method achieves state-of-the-art counterfactual estimation results using both synthetic and real-world data, marking the pioneering incorporation of Contrastive Predictive Encoding in causal inference.


title: A characterization of the $L^2$-range of the generalized spectral projections related to the Hodge-de Rham Laplacian

abstract: Let $H^n(\mathbb R)$ be the real hyperbolic space. In this paper, we present a characterization of the $L^2$-range of the generalized spectral projections on the bundle of differential forms over $H^n(\mathbb R)$. As an underlying result we show a characterization of the $L^2$-range of the Poisson transform on the bundle of differential forms on the boundary $\partial H^n(\mathbb R)$. This gives a positive answer to a conjecture of Strichartz on differential forms.


title: Towards an ontology of portions of matter to support multi-scale analysis and provenance tracking

abstract: This paper presents an ontology of portions of matter with practical implications across scientific and industrial domains. The ontology is developed under the Unified Foundational Ontology (UFO), which uses the concept of quantity to represent topologically maximally self-connected portions of matter. The proposed ontology introduces the granuleOf parthood relation, holding between objects and portions of matter. It also discusses the constitution of quantities by collections of granules, the representation of sub-portions of matter, and the tracking of matter provenance between quantities using historical relations. Lastly, a case study is presented to demonstrate the use of the portion of matter ontology in the geology domain for an Oil & Gas industry application. In the case study, we model how to represent the historical relation between an original portion of rock and the sub-portions created during the industrial process. Lastly, future research directions are outlined, including investigating granularity levels and defining a taxonomy of events.


title: Cost-Effectiveness Analysis and Design of Cost-Efficient Cell-Free Massive MIMO Systems

abstract: Cell-free massive multi-input multi-output (MIMO) has recently attracted much attention, attributed to its potential to deliver uniform service quality. However, the adoption of a cell-free architecture raises concerns about the high implementation costs associated with deploying numerous distributed access points (APs) and the need for fronthaul network installation. To ensure the sustainability of next-generation wireless networks, it is crucial to improve cost-effectiveness, alongside achieving high performance. To address this, we conduct a cost analysis of cell-free massive MIMO and build a unified model with varying numbers of antennas per AP. Our objective is to explore whether employing multi-antenna APs could reduce system costs while maintaining performance. The analysis and evaluation result in the identification of a cost-effective design for cell-free massive MIMO, providing valuable insights for practical implementation.


title: CONFINE: Conformal Prediction for Interpretable Neural Networks

abstract: Deep neural networks exhibit remarkable performance, yet their black-box nature limits their utility in fields like healthcare where interpretability is crucial. Existing explainability approaches often sacrifice accuracy and lack quantifiable measures of prediction uncertainty. In this study, we introduce Conformal Prediction for Interpretable Neural Networks (CONFINE), a versatile framework that generates prediction sets with statistically robust uncertainty estimates instead of point predictions to enhance model transparency and reliability. CONFINE not only provides example-based explanations and confidence estimates for individual predictions but also boosts accuracy by up to 3.6%. We define a new metric, correct efficiency, to evaluate the fraction of prediction sets that contain precisely the correct label and show that CONFINE achieves correct efficiency of up to 3.3% higher than the original accuracy, matching or exceeding prior methods. CONFINE's marginal and class-conditional coverages attest to its validity across tasks spanning medical image classification to language understanding. Being adaptable to any pre-trained classifier, CONFINE marks a significant advance towards transparent and trustworthy deep learning applications in critical domains.


title: Optimal Transmission Power Scheduling for Networked Control System under DoS Attack

abstract: Designing networked control systems that are reliable and resilient against adversarial threats, is essential for ensuring the security of cyber-physical systems. This paper addresses the communication-control co-design problem for networked control systems under denial-of-service (DoS) attacks. In the wireless channel, a transmission power scheduler periodically determines the power level for sensory data transmission. Yet DoS attacks render data packets unavailable by disrupting the communication channel. This paper co-designs the control and power scheduling laws in the presence of DoS attacks and aims to minimize the sum of regulation control performance and transmission power consumption. Both finite- and infinite-horizon discounted cost criteria are addressed, respectively. By delving into the information structure between the controller and the power scheduler under attack, the original co-design problem is divided into two subproblems that can be solved individually without compromising optimality. The optimal control is shown to be certainty equivalent, and the optimal transmission power scheduling is solved using a dynamic programming approach. Moreover, in the infinite-horizon scenario, we analyze the performance of the designed scheduling policy and develop an upper bound of the total costs. Finally, a numerical example is provided to demonstrate the theoretical results.


title: Bishop-like theorems for non-subnormal operators

abstract: The celebrated Bishop theorem states that an operator is subnormal if and only if it is the strong limit of a net (or a sequence) of normal operators. By the Agler-Stankus theorem, $2$-isometries behave similarly to subnormal operator in the sense that the role of subnormal operators is played by $2$-isometries, while the role of normal operators is played by Brownian unitaries. In this paper we give Bishop-like theorems for $2$-isometries. Two methods are involved, the first of which goes back to Bishop's original idea and the second refers to Conway and Hadwin's result of general nature. We also investigate the strong and $*$-strong closedness of the class of Brownian unitaries.


title: An Automated Validation Framework for Power Management and Data Retention Logic Kits of Standard Cell Library

abstract: The development of a standard cell library involves characterization of a number of gate-level circuits at various cell-level abstractions. Verifying the behavior of these cells largely depends on the manual skills of the circuit designers. Especially challenging are the power management and data retention cells which must be checked thoroughly for voltage and power configurations in addition to their logic functionality. Also, when standard cells are extracted into various models, any inconsistencies in these models typically goes unchecked during library development. Thus, validating these cells exhaustively prior to customer delivery is highly advantageous to not only improve customer satisfaction but also to reduce design costs. We address this challenge by presenting a methodology to validate the power management and data retention cells that are used in the logical design flow of low-power chips. For a quick adoption by standard cell library design teams, the framework is fully automated and runs out-of-the-box. The proposed framework has been implemented and deployed within the Samsung Foundry ecosystem to enhance the overall quality of library design kit deliverables.


title: Cherenkov Telescope Arrays for High-Energy Neutrino Detection in Mountain Ranges

abstract: The present study investigates the feasibility of employing Cherenkov Telescope Array (CTA) technology for the detection of ultra-high-energy (UHE) neutrino-tau particles. By observing the Cherenkov light produced by charged particles resulting from neutrino-tau interactions within mountainous regions, the research seeks to assess the viability of detecting neutrinos within the PeV to EeV energy range. The present paper details the methodology used to calculate the effective detection area and the interaction probabilities of neutrino-tau within the mountains, as well as the flux of Cherenkov photons generated by tau leptons. Furthermore, the present paper addresses the selection of optimal parameters for the telescopes, including mountain dimensions, telescope height, the distance between telescopes, and the distance from the telescopes to the mountain. Strategic placement of the telescopes and the identification of mountain ranges in Algeria that are most suitable for detecting these elusive particles are also discussed. The findings and recommendations for the optimal distribution of telescopes across the selected mountain range are presented, aiming to enhance the detection capabilities for high-energy neutrino-tau particles.


title: Leveraging Knowlegde Graphs for Interpretable Feature Generation

abstract: The quality of Machine Learning (ML) models strongly depends on the input data, as such Feature Engineering (FE) is often required in ML. In addition, with the proliferation of ML-powered systems, especially in critical contexts, the need for interpretability and explainability becomes increasingly important. Since manual FE is time-consuming and requires case specific knowledge, we propose KRAFT, an AutoFE framework that leverages a knowledge graph to guide the generation of interpretable features. Our hybrid AI approach combines a neural generator to transform raw features through a series of transformations and a knowledge-based reasoner to evaluate features interpretability using Description Logics (DL). The generator is trained through Deep Reinforcement Learning (DRL) to maximize the prediction accuracy and the interpretability of the generated features. Extensive experiments on real datasets demonstrate that KRAFT significantly improves accuracy while ensuring a high level of interpretability.


title: Memory-guided Network with Uncertainty-based Feature Augmentation for Few-shot Semantic Segmentation

abstract: The performance of supervised semantic segmentation methods highly relies on the availability of large-scale training data. To alleviate this dependence, few-shot semantic segmentation (FSS) is introduced to leverage the model trained on base classes with sufficient data into the segmentation of novel classes with few data. FSS methods face the challenge of model generalization on novel classes due to the distribution shift between base and novel classes. To overcome this issue, we propose a class-shared memory (CSM) module consisting of a set of learnable memory vectors. These memory vectors learn elemental object patterns from base classes during training whilst re-encoding query features during both training and inference, thereby improving the distribution alignment between base and novel classes. Furthermore, to cope with the performance degradation resulting from the intra-class variance across images, we introduce an uncertainty-based feature augmentation (UFA) module to produce diverse query features during training for improving the model's robustness. We integrate CSM and UFA into representative FSS works, with experimental results on the widely-used PASCAL-5$^i$ and COCO-20$^i$ datasets demonstrating the superior performance of ours over state of the art.


title: Optomechanics driven by noisy and narrowband fields

abstract: We report a study of a cavity optomechanical system driven by narrow-band electromagnetic fields, which are applied either in the form of uncorrelated noise, or as a more structured spectrum. The bandwidth of the driving spectra is smaller than the mechanical resonant frequency, and thus we can describe the resulting physics using concepts familiar from regular cavity optomechanics in the resolved-sideband limit. With a blue-detuned noise driving, the noise-induced interaction leads to anti-damping of the mechanical oscillator, and a self-oscillation threshold at an average noise power that is comparable to that of a coherent driving tone. This process can be seen as noise-induced dynamical amplification of mechanical motion. However, when the noise bandwidth is reduced down to the order of the mechanical damping, we discover a large shift of the power threshold of self-oscillation. This is due to the oscillator adiabatically following the instantaneous noise profile. In addition to blue-detuned noise driving, we investigate narrow-band driving consisting of two coherent drive tones nearby in frequency. Also in these cases, we observe deviations from a naive optomechanical description relying only on the tones' frequencies and powers.


title: Cassiop\'ee, towards technological development for XAO on ELT: the e-APD infrared detector

abstract: The Cassiop\'ee project aims to develop the key technologies that will be used to deploy very high-performance Adaptive Optics for future ELTs. The ultimate challenge is to detect earth-like planets and characterize the composition of their atmosphere. For this, imaging contrasts of the order of 109 are required, implying a leap forward in adaptive optics performance, with high density deformable mirrors (120x120 actuators), low-noise cameras and the control of the loop at few kHz. The project brings together 2 industrial partners: First Light Imaging and ALPAO, and 2 academic partners: ONERA and LAM, who will work together to develop a new camera for wavefront sensing, a new deformable mirror and their implementation in an adaptive optics loop. This paper will present the development of the fast large infrared e-APD camera which will be used in the wavefront sensor of the system. The camera will integrate the latest 512x512 Leonardo e-APD array and will benefit from the heritage of the first-light imaging's C-RED One camera. The most important challenges for the application are the autonomous operation, vibration control, background limitation, compactness, acquisition speed and latency.


title: LIDAO: Towards Limited Interventions for Debiasing (Large) Language Models

abstract: Large language models (LLMs) have achieved impressive performance on various natural language generation tasks. Nonetheless, they suffer from generating negative and harmful contents that are biased against certain demographic groups (e.g., female), raising severe fairness concerns. As remedies, prior works intervened the generation by removing attitude or demographic information, inevitably degrading the generation quality and resulting in notable \textit{fairness-fluency} trade-offs. However, it is still under-explored to what extent the fluency \textit{has to} be affected in order to achieve a desired level of fairness. In this work, we conduct the first formal study from an information-theoretic perspective. We show that previous approaches are excessive for debiasing and propose LIDAO, a general framework to debias a (L)LM at a better fluency provably. We further robustify LIDAO in adversarial scenarios, where a carefully-crafted prompt may stimulate LLMs exhibiting instruction-following abilities to generate texts with fairness issue appears only when the prompt is also taken into account. Experiments on three LMs ranging from 0.7B to 7B parameters demonstrate the superiority of our method.


title: Zero Inflation as a Missing Data Problem: a Proxy-based Approach

abstract: A common type of zero-inflated data has certain true values incorrectly replaced by zeros due to data recording conventions (rare outcomes assumed to be absent) or details of data recording equipment (e.g. artificial zeros in gene expression data). Existing methods for zero-inflated data either fit the observed data likelihood via parametric mixture models that explicitly represent excess zeros, or aim to replace excess zeros by imputed values. If the goal of the analysis relies on knowing true data realizations, a particular challenge with zero-inflated data is identifiability, since it is difficult to correctly determine which observed zeros are real and which are inflated. This paper views zero-inflated data as a general type of missing data problem, where the observability indicator for a potentially censored variable is itself unobserved whenever a zero is recorded. We show that, without additional assumptions, target parameters involving a zero-inflated variable are not identified. However, if a proxy of the missingness indicator is observed, a modification of the effect restoration approach of Kuroki and Pearl allows identification and estimation, given the proxy-indicator relationship is known. If this relationship is unknown, our approach yields a partial identification strategy for sensitivity analysis. Specifically, we show that only certain proxy-indicator relationships are compatible with the observed data distribution. We give an analytic bound for this relationship in cases with a categorical outcome, which is sharp in certain models. For more complex cases, sharp numerical bounds may be computed using methods in Duarte et al.[2023]. We illustrate our method via simulation studies and a data application on central line-associated bloodstream infections (CLABSIs).


title: Demystifying Object-based Big Data Storage Systems

abstract: Today's era is the digitized era. Managing such generated big data is an important factor for data scientists. Day by day, it increases the demand for big data storage systems. Different organizations are involved in providing storage-related services. They follow the different architectures or storage models for storing big data. In this survey paper, our target is to highlight such storage architectures which provided by different renowned storage service providers. On an architectural basis, we divide the big data storage systems into five parts, Distributed file systems (DFS), Clustered File Systems (CFS), Cloud Storage, Archive Storage, and Object Storage Systems (OSS). Also, we reveal a detailed architectural view of the big data storage systems provided by the different organizations under these parts.


title: Strategic Linear Contextual Bandits

abstract: Motivated by the phenomenon of strategic agents gaming a recommender system to maximize the number of times they are recommended to users, we study a strategic variant of the linear contextual bandit problem, where the arms can strategically misreport their privately observed contexts to the learner. We treat the algorithm design problem as one of mechanism design under uncertainty and propose the Optimistic Grim Trigger Mechanism (OptGTM) that incentivizes the agents (i.e., arms) to report their contexts truthfully while simultaneously minimizing regret. We also show that failing to account for the strategic nature of the agents results in linear regret. However, a trade-off between mechanism design and regret minimization appears to be unavoidable. More broadly, this work aims to provide insight into the intersection of online learning and mechanism design.


title: Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch

abstract: Graph Neural Networks (GNNs) have gained significant attention in recent years due to their ability to learn representations of graph structured data. Two common methods for training GNNs are mini-batch training and full-graph training. Since these two methods require different training pipelines and systems optimizations, two separate categories of GNN training systems emerged, each tailored for one method. Works that introduce systems belonging to a particular category predominantly compare them with other systems within the same category, offering limited or no comparison with systems from the other category. Some prior work also justifies its focus on one specific training method by arguing that it achieves higher accuracy than the alternative. The literature, however, has incomplete and contradictory evidence in this regard. In this paper, we provide a comprehensive empirical comparison of full-graph and mini-batch GNN training systems to get a clearer picture of the state of the art in the field. We find that the mini-batch training systems we consider consistently converge faster than the full-graph training ones across multiple datasets, GNN models, and system configurations, with speedups between 2.4x - 15.2x. We also find that both training techniques converge to similar accuracy values, so comparing systems across the two categories in terms of time-to-accuracy is a sound approach.


title: Voronoi topology in two dimensions: theory, algorithms, and applications

abstract: This paper introduces a new approach toward characterizing local structural features of two-dimensional particle systems. The approach can accurately identify and characterize defects in high-temperature crystals, distinguish a wide range of nominally disordered systems, and robustly describe complex structures such as grain boundaries. This paper also introduces two-dimensional functionality into the open-source software program VoroTop which automates this analysis. This software package is built on a recently-introduced multithreaded version of VORO++, enabling the analysis of systems with billions of particles on high-performance computer architectures.


title: Guiding and Diversifying LLM-Based Story Generation via Answer Set Programming

abstract: Instruction-tuned large language models (LLMs) are capable of generating stories in response to open-ended user requests, but the resulting stories tend to be limited in their diversity. Older, symbolic approaches to story generation (such as planning) can generate substantially more diverse plot outlines, but are limited to producing stories that recombine a fixed set of hand-engineered character action templates. Can we combine the strengths of these approaches while mitigating their weaknesses? We propose to do so by using a higher-level and more abstract symbolic specification of high-level story structure -- implemented via answer set programming (ASP) -- to guide and diversify LLM-based story generation. Via semantic similarity analysis, we demonstrate that our approach produces more diverse stories than an unguided LLM, and via code excerpts, we demonstrate the improved compactness and flexibility of ASP-based outline generation over full-fledged narrative planning.


title: Length-scale study in deep learning prediction for non-small cell lung cancer brain metastasis

abstract: Deep learning assisted digital pathology has the potential to impact clinical practice in significant ways. In recent studies, deep neural network (DNN) enabled analysis outperforms human pathologists. Increasing sizes and complexity of the DNN architecture generally improves performance at the cost of DNN's explainability. For pathology, this lack of DNN explainability is particularly problematic as it hinders the broader clinical interpretation of the pathology features that may provide physiological disease insights. To better assess the features that DNN uses in developing predictive algorithms to interpret digital microscopic images, we sought to understand the role of resolution and tissue scale and here describe a novel method for studying the predictive feature length-scale that underpins a DNN's predictive power. We applied the method to study a DNN's predictive capability in the case example of brain metastasis prediction from early-stage non-small-cell lung cancer biopsy slides. The study highlights the DNN attention in the brain metastasis prediction targeting both cellular scale (resolution) and tissue scale features on H&E-stained histological whole slide images. At the cellular scale, we see that DNN's predictive power is progressively increased at higher resolution (i.e., lower resolvable feature length) and is largely lost when the resolvable feature length is longer than 5 microns. In addition, DNN uses more macro-scale features (maximal feature length) associated with tissue organization/architecture and is optimized when assessing visual fields larger than 41 microns. This study for the first time demonstrates the length-scale requirements necessary for optimal DNN learning on digital whole slide images.


title: Lens-Type Redirective Intelligent Surfaces for Multi-User MIMO Communication

abstract: This paper explores the idea of using redirective reconfigurable intelligent surfaces (RedRIS) to overcome many of the challenges associated with the conventional reflective RIS. We develop a framework for jointly optimizing the switching matrix of the lens-type RedRIS ports along with the active precoding matrix at the base station (BS) and the receive scaling factor. A joint non-convex optimization problem is formulated under the minimum mean-square error (MMSE) criterion with the aim to maximize the spectral efficiency of each user. In the single-cell scenario, the optimum active precoding matrix at the multi-antenna BS and the receive scaling factor are found in closed-form by applying Lagrange optimization, while the optimal switching matrix of the lens-type RedRIS is obtained by means of a newly developed alternating optimization algorithm. We then extend the framework to the multi-cell scenario with single-antenna base stations that are aided by the same lens-type RedRIS. We further present two methods for reducing the number of effective connections of the RedRIS ports that result in appreciable overhead savings while enhancing the robustness of the system. The proposed RedRIS-based schemes are gauged against conventional reflective RIS-aided systems under both perfect and imperfect channel state information (CSI). The simulation results show the superiority of the proposed schemes in terms of overall throughput while incurring much less control overhead.


title: Anisotropic Paramagnetic Peak Effect in Reversible Magnetization of Crystalline Miassite Superconductor $\text{Rh}_{17}\text{S}_{15}$

abstract: We report an unusual anisotropic paramagnetic peak effect observed in reversible magnetization of a single crystalline nodal superconductor $\text{Rh}_{17}\text{S}_{15}$. Both temperature- and field-dependent magnetization measurements reveal a distinct novel vortex state above approximately 1 T. This peak effect is most pronounced when the magnetic field, $H$, is applied parallel to the $\left[111\right]$ direction, whereas it diminishes for $H\parallel\left[110\right]$. Intriguingly, for $H\parallel\left[100\right]$, instead of a peak, we observe a step-like decrease in $M(T)$, with the step amplitude increasing in larger applied magnetic fields. This behavior is opposite to the expectations of conventional Meissner expulsion. The magnitude of the peak effect, expressed in terms of dimensionless volume susceptibility, is on the order of $\Delta\chi=10^{-5}$ (with full diamagnetic screening corresponding to $\chi=-1$). The observed anisotropic paramagnetic vortex response is unusual considering the cubic symmetry of $\text{Rh}_{17}\text{S}_{15}$. We propose that in this distinct vortex phase, a small but finite attractive interaction between vortices below $H_{c2}$ may be responsible for this unusual phenomenon. Furthermore, the vortices seem to prefer aligning along the $\left[111\right]$ direction, rotating toward it when the magnetic field is applied in other directions. Our findings add another item to the list of unusual properties of $\text{Rh}_{17}\text{S}_{15}$ that attracted recent attention as the first unconventional superconductor that has a mineral analog, miassite, found in nature.


title: Rigidity of compact rank one symmetric spaces

abstract: We consider rigidity properties of compact symmetric spaces $X$ with metric $g_0$ of rank one. Suppose $g$ is another Riemannian metric on $X$ with sectional curvature $\kappa$ bounded by $0 \leq \kappa \leq 1$. If $g$ equals $g_0$ outside a convex proper subset of $X$, then $g$ is isometric with $g_0$. We also exhibit examples of surfaces showing that the nonnegativity of the curvature is needed. Our main result complements earlier results on other symmetric spaces by Gromov and Schroeder-Ziller.


title: A brief review of Reduced Order Models using intrusive and non-intrusive techniques

abstract: Reduced Order Models (ROMs) have gained a great attention by the scientific community in the last years thanks to their capabilities of significantly reducing the computational cost of the numerical simulations, which is a crucial objective in applications like real time control and shape optimization. This contribution aims to provide a brief overview about such a topic. We discuss both an intrusive framework based on a Galerkin projection technique and non-intrusive approaches, including Physics Informed Neural Networks (PINN), purely Data-Driven Neural Networks (DDNN), Radial Basis Functions (RBF), Dynamic Mode Decomposition (DMD) and Gaussian Process Regression (GPR). We also briefly mention geometrical parametrization and dimensionality reduction methods like Active Subspaces (AS). Then we present some results related to academic test cases as well as a preliminary investigation related to an industrial application.


title: The Role of Generative AI in Software Development Productivity: A Pilot Case Study

abstract: With software development increasingly reliant on innovative technologies, there is a growing interest in exploring the potential of generative AI tools to streamline processes and enhance productivity. In this scenario, this paper investigates the integration of generative AI tools within software development, focusing on understanding their uses, benefits, and challenges to software professionals, in particular, looking at aspects of productivity. Through a pilot case study involving software practitioners working in different roles, we gathered valuable experiences on the integration of generative AI tools into their daily work routines. Our findings reveal a generally positive perception of these tools in individual productivity while also highlighting the need to address identified limitations. Overall, our research sets the stage for further exploration into the evolving landscape of software development practices with the integration of generative AI tools.


title: Learning to Approximate Particle Smoothing Trajectories via Diffusion Generative Models

abstract: Learning dynamical systems from sparse observations is critical in numerous fields, including biology, finance, and physics. Even if tackling such problems is standard in general information fusion, it remains challenging for contemporary machine learning models, such as diffusion models. We introduce a method that integrates conditional particle filtering with ancestral sampling and diffusion models, enabling the generation of realistic trajectories that align with observed data. Our approach uses a smoother based on iterating a conditional particle filter with ancestral sampling to first generate plausible trajectories matching observed marginals, and learns the corresponding diffusion model. This approach provides both a generative method for high-quality, smoothed trajectories under complex constraints, and an efficient approximation of the particle smoothing distribution for classical tracking problems. We demonstrate the approach in time-series generation and interpolation tasks, including vehicle tracking and single-cell RNA sequencing data.


title: SPAGHETTI: Open-Domain Question Answering from Heterogeneous Data Sources with Retrieval and Semantic Parsing

abstract: We introduce SPAGHETTI: Semantic Parsing Augmented Generation for Hybrid English information from Text Tables and Infoboxes, a hybrid question-answering (QA) pipeline that utilizes information from heterogeneous knowledge sources, including knowledge base, text, tables, and infoboxes. Our LLM-augmented approach achieves state-of-the-art performance on the Compmix dataset, the most comprehensive heterogeneous open-domain QA dataset, with 56.5% exact match (EM) rate. More importantly, manual analysis on a sample of the dataset suggests that SPAGHETTI is more than 90% accurate, indicating that EM is no longer suitable for assessing the capabilities of QA systems today.


title: Reflection Map Construction: Enhancing and Speeding Up Indoor Localization

abstract: This paper introduces an indoor localization method using fixed reflector objects within the environment, leveraging a base station (BS) equipped with Angle of Arrival (AoA) and Time of Arrival (ToA) measurement capabilities. The localization process includes two phases. In the offline phase, we identify effective reflector points within a specific region using significantly fewer test points than typical methods. In the online phase, we solve a maximization problem to locate users based on BS measurements and offline phase information. We introduce the reflectivity parameter (\(n_r\)), which quantifies the typical number of first-order reflection paths from the transmitter to the receiver, demonstrating its impact on localization accuracy. The log-scale accuracy ratio (\(R_a\)) is defined as the logarithmic function of the localization area divided by the localization ambiguity area, serving as an accuracy indicator. We show that in scenarios where the Signal-to-Noise Ratio (SNR) approaches infinity, without a line of sight (LoS) link, \(R_a\) is upper-bounded by \(n_r \log_{2}\left(1 + \frac{\mathrm{Vol}(\mathcal{S}_A)}{\mathrm{Vol}(\mathcal{S}_{\epsilon}(\mathcal{M}_s))}\right)\). Here, \(\mathrm{Vol}(\mathcal{S}_A)\) and \(\mathrm{Vol}(\mathcal{S}_{\epsilon}(\mathcal{M}_s))\) represent the areas of the localization region and the area containing all reflector points with a probability of at least \(1 - \epsilon\), respectively.


title: Probabilistic approach to homogenization for a type of multivalued Dirichlet-Neumann problems

abstract: The work is about homogenization for a type of multivalued Dirichlet-Neumann problems. First, we prove an average principle for general multivalued stochastic differential equations in the weak sense. Then for general forward-backward coupled multivalued stochastic systems, the other average principle is presented. Finally, we apply the result to a type of multivalued Dirichlet-Neumann problems and investigate its homogenization.


title: Efficient Massive Black Hole Binary parameter estimation for LISA using Sequential Neural Likelihood

abstract: LISA (Laser Interferometer Space Antenna) is a space mission that has recently entered the implementation phase. The main goal of LISA is to survey, for the first time, the observable universe by detecting low-frequency gravitational waves (GWs). One of the main GW sources that LISA will detect is the coalescence and merger of Massive Black Hole Binaries (MBHBs). In this work, we explore the application of Sequential Neural Likelihood, a simulation-based inference algorithm, to the detection and parameter estimation of MBHBs signals in the LISA data. Instead of sampling from the conventional likelihood function, which typically relies on the assumptions of Gaussianity and stationarity of the noise and requires a forward simulation for each evaluation, this method constructs a surrogate likelihood that is ultimately described by a neural network trained from a dataset of simulations (noise + MBHB). Since the likelihood is independent of the priors, we can iteratively train models that target specific observations in a fraction of the time and computational cost that other traditional and machine learning-based strategies would require. One key aspect of the method is the compression of the data. Because of the iterative nature of the method, we are able to train models to obtain qualitatively similar posteriors with less than 2% of the simulator calls that Markov Chain Monte Carlo methods would require. We compare these posteriors with those obtained from standard techniques and discuss the differences that appear, some of which can be identified as caused by the loss of information from the data compression we use. We also discuss future improvements to this method.


title: An Unsupervised Approach for Periodic Source Detection in Time Series

abstract: Detection of periodic patterns of interest within noisy time series data plays a critical role in various tasks, spanning from health monitoring to behavior analysis. Existing learning techniques often rely on labels or clean versions of signals for detecting the periodicity, and those employing self-supervised learning methods are required to apply proper augmentations, which is already challenging for time series and can result in collapse -- all representations collapse to a single point due to strong augmentations. In this work, we propose a novel method to detect the periodicity in time series without the need for any labels or requiring tailored positive or negative data generation mechanisms with specific augmentations. We mitigate the collapse issue by ensuring the learned representations retain information from the original samples without imposing any random variance constraints on the batch. Our experiments in three time series tasks against state-of-the-art learning methods show that the proposed approach consistently outperforms prior works, achieving performance improvements of more than 45--50\%, showing its effectiveness. Code: https://github.com/eth-siplab/Unsupervised_Periodicity_Detection


title: Formulas for odd zeta values and powers of $\pi$

abstract: Plouffe conjectured rapidly converging series formulas for $\pi^{2n+1}$ and $\zeta (2n+1)$ for small values of $n$. We find the general pattern for all nonnegative integer values of $n$ and offer a proof.


title: Designing Reconfigurable Interconnection Network of Heterogeneous Chiplets Using Kalman Filter

abstract: Heterogeneous chiplets have been proposed for accelerating high-performance computing tasks. Integrated inside one package, CPU and GPU chiplets can share a common interconnection network that can be implemented through the interposer. However, CPU and GPU applications have very different traffic patterns in general. Without effective management of the network resource, some chiplets can suffer significant performance degradation because the network bandwidth is taken away by communication-intensive applications. Therefore, techniques need to be developed to effectively manage the shared network resources. In a chiplet-based system, resource management needs to not only react in real-time but also be cost-efficient. In this work, we propose a reconfigurable network architecture, leveraging Kalman Filter to make accurate predictions on network resources needed by the applications and then adaptively change the resource allocation. Using our design, the network bandwidth can be fairly allocated to avoid starvation or performance degradation. Our evaluation results show that the proposed reconfigurable interconnection network can dynamically react to the changes in traffic demand of the chiplets and improve the system performance with low cost and design complexity.


title: Redefining Contributions: Shapley-Driven Federated Learning

abstract: Federated learning (FL) has emerged as a pivotal approach in machine learning, enabling multiple participants to collaboratively train a global model without sharing raw data. While FL finds applications in various domains such as healthcare and finance, it is challenging to ensure global model convergence when participants do not contribute equally and/or honestly. To overcome this challenge, principled mechanisms are required to evaluate the contributions made by individual participants in the FL setting. Existing solutions for contribution assessment rely on general accuracy evaluation, often failing to capture nuanced dynamics and class-specific influences. This paper proposes a novel contribution assessment method called ShapFed for fine-grained evaluation of participant contributions in FL. Our approach uses Shapley values from cooperative game theory to provide a granular understanding of class-specific influences. Based on ShapFed, we introduce a weighted aggregation method called ShapFed-WA, which outperforms conventional federated averaging, especially in class-imbalanced scenarios. Personalizing participant updates based on their contributions further enhances collaborative fairness by delivering differentiated models commensurate with the participant contributions. Experiments on CIFAR-10, Chest X-Ray, and Fed-ISIC2019 datasets demonstrate the effectiveness of our approach in improving utility, efficiency, and fairness in FL systems. The code can be found at https://github.com/tnurbek/shapfed.


title: A Gaussian Process-based Streaming Algorithm for Prediction of Time Series With Regimes and Outliers

abstract: Online prediction of time series under regime switching is a widely studied problem in the literature, with many celebrated approaches. Using the non-parametric flexibility of Gaussian processes, the recently proposed INTEL algorithm provides a product of experts approach to online prediction of time series under possible regime switching, including the special case of outliers. This is achieved by adaptively combining several candidate models, each reporting their predictive distribution at time $t$. However, the INTEL algorithm uses a finite context window approximation to the predictive distribution, the computation of which scales cubically with the maximum lag, or otherwise scales quartically with exact predictive distributions. We introduce LINTEL, which uses the exact filtering distribution at time $t$ with constant-time updates, making the time complexity of the streaming algorithm optimal. We additionally note that the weighting mechanism of INTEL is better suited to a mixture of experts approach, and propose a fusion policy based on arithmetic averaging for LINTEL. We show experimentally that our proposed approach is over five times faster than INTEL under reasonable settings with better quality predictions.


title: An Image Segmentation Model with Transformed Total Variation

abstract: Based on transformed $\ell_1$ regularization, transformed total variation (TTV) has robust image recovery that is competitive with other nonconvex total variation (TV) regularizers, such as TV$^p$, $0<p<1$. Inspired by its performance, we propose a TTV-regularized Mumford--Shah model with fuzzy membership function for image segmentation. To solve it, we design an alternating direction method of multipliers (ADMM) algorithm that utilizes the transformed $\ell_1$ proximal operator. Numerical experiments demonstrate that using TTV is more effective than classical TV and other nonconvex TV variants in image segmentation.


title: For sky-facing passive radiative cooling, are wavelength-selective emitters the best choice?

abstract: For passive cooling via thermal radiation toward the sky, it is known that an ideal selective emitter (SE) with high emissivity only in the 8-13 um atmospheric transparency window can reach a lower equilibrium temperature than an ideal broadband emitter (BE) across the mid infrared. Here, we evaluate whether this principle should guide the development of practical passive radiative cooling technologies. We model and compare the cooling performance of sky-facing SEs and BEs at various locations on Earth, accounting for the distributions of atmospheric temperature and gas composition at specific dates and times. We find that for emitter temperatures at or higher than the ambient temperature, an ideal broadband emitter always provides higher net cooling power, while for sub-ambient cooling, an ideal selective emitter is usually slightly better, but the difference in cooling power is small, at most 1-2% of the incident solar power during daytime. Our conclusion is that large-scale deployment of passive radiative cooling technologies should focus on design and manufacturing of scalable low-cost surfaces with the lowest possible solar absorption without worrying too much whether the emitter is broadband or selective.


title: VOICE: Variance of Induced Contrastive Explanations to quantify Uncertainty in Neural Network Interpretability

abstract: In this paper, we visualize and quantify the predictive uncertainty of gradient-based post hoc visual explanations for neural networks. Predictive uncertainty refers to the variability in the network predictions under perturbations to the input. Visual post hoc explainability techniques highlight features within an image to justify a network's prediction. We theoretically show that existing evaluation strategies of visual explanatory techniques partially reduce the predictive uncertainty of neural networks. This analysis allows us to construct a plug in approach to visualize and quantify the remaining predictive uncertainty of any gradient-based explanatory technique. We show that every image, network, prediction, and explanatory technique has a unique uncertainty. The proposed uncertainty visualization and quantification yields two key observations. Firstly, oftentimes under incorrect predictions, explanatory techniques are uncertain about the same features that they are attributing the predictions to, thereby reducing the trustworthiness of the explanation. Secondly, objective metrics of an explanation's uncertainty, empirically behave similarly to epistemic uncertainty. We support these observations on two datasets, four explanatory techniques, and six neural network architectures. The code is available at https://github.com/olivesgatech/VOICE-Uncertainty.


title: On the Convergence Rates of Set Membership Estimation of Linear Systems with Disturbances Bounded by General Convex Sets

abstract: This paper studies the uncertainty set estimation of system parameters of linear dynamical systems with bounded disturbances, which is motivated by robust (adaptive) constrained control. Departing from the confidence bounds of least square estimation from the machine-learning literature, this paper focuses on a method commonly used in (robust constrained) control literature: set membership estimation (SME). SME tends to enjoy better empirical performance than LSE's confidence bounds when the system disturbances are bounded. However, the theoretical guarantees of SME are not fully addressed even for i.i.d. bounded disturbances. In the literature, SME's convergence has been proved for general convex supports of the disturbances, but SME's convergence rate assumes a special type of disturbance support: $l_\infty$ ball. The main contribution of this paper is relaxing the assumption on the disturbance support and establishing the convergence rates of SME for general convex supports, which closes the gap on the applicability of the convergence and convergence rates results. Numerical experiments on SME and LSE's confidence bounds are also provided for different disturbance supports.


title: Existence-Uniqueness Theory and Small-Data Decay for a Reaction-Diffusion Model of Wildfire Spread

abstract: I examine some analytical properties of a nonlinear reaction-diffusion system that has been used to model the propagation of a wildfire. I establish global-in-time existence and uniqueness of bounded mild solutions to the Cauchy problem for this system given bounded initial data. In particular, this shows that the model does not allow for thermal blow-up. If the initial temperature and fuel density also satisfy certain integrability conditions, the $L^2$-norms of these global solutions are uniformly bounded in time. Additionally, I use a bootstrap argument to show that small initial temperatures give rise to solutions that decay to zero as time goes to infinity, proving the existence of initial states that do not develop into travelling combustion waves.


title: A Universal Transfer Theorem for Convex Optimization Algorithms Using Inexact First-order Oracles

abstract: Given any algorithm for convex optimization that uses exact first-order information (i.e., function values and subgradients), we show how to use such an algorithm to solve the problem with access to inexact first-order information. This is done in a ``black-box'' manner without knowledge of the internal workings of the algorithm. This complements previous work that considers the performance of specific algorithms like (accelerated) gradient descent with inexact information. In particular, our results apply to a wider range of algorithms beyond variants of gradient descent, e.g., projection-free methods, cutting-plane methods, or any other first-order methods formulated in the future. Further, they also apply to algorithms that handle structured nonconvexities like mixed-integer decision variables.


title: Analyzing trends for agricultural decision support system using twitter data

abstract: The trends and reactions of the general public towards global events can be analyzed using data from social platforms, including Twitter. The number of tweets has been reported to help detect variations in communication traffic within subsets like countries, age groups and industries. Similarly, publicly accessible data and (in particular) data from social media about agricultural issues provide a great opportunity for obtaining instantaneous snapshots of farmer opinions and a method to track changes in opinion through temporal analysis. In this paper we hypothesize that the presence of keywords like precision agriculture, digital agriculture, Internet of Things (IoT), BigData, remote sensing, GPS, etc., in tweets could serve as an indicator of discussions centered around interest in modern farming practices. We extracted relevant tweets using keywords such as IoT, BigData and Geographical Information System (GIS), and then analyzed their geographical origin and frequency of their mention. We analyzed the Twitter data for the period of 1st -11th January 2018 to understand these trends and the factors affecting them. These factors, such as special events, projects, biogeography, etc., were further analyzed using tweet sources and trending hashtags from the database. The regions with the highest interest in the keywords were United States, Egypt, Brazil, Japan and China. A comparison of frequency of keywords revealed IoT as the most tweeted word (77.6%) in the downloaded data. The most used language was English followed by Spanish, Japanese and French. Periodical tweets on IoT from an account handled by IoT project on Twitter and Seminars on IoT in January in Santa Catarina (Brazil) were found to be the underlying factors for the observed trends.


title: ContextFlow++: Generalist-Specialist Flow-based Generative Models with Mixed-Variable Context Encoding

abstract: Normalizing flow-based generative models have been widely used in applications where the exact density estimation is of major importance. Recent research proposes numerous methods to improve their expressivity. However, conditioning on a context is largely overlooked area in the bijective flow research. Conventional conditioning with the vector concatenation is limited to only a few flow types. More importantly, this approach cannot support a practical setup where a set of context-conditioned (specialist) models are trained with the fixed pretrained general-knowledge (generalist) model. We propose ContextFlow++ approach to overcome these limitations using an additive conditioning with explicit generalist-specialist knowledge decoupling. Furthermore, we support discrete contexts by the proposed mixed-variable architecture with context encoders. Particularly, our context encoder for discrete variables is a surjective flow from which the context-conditioned continuous variables are sampled. Our experiments on rotated MNIST-R, corrupted CIFAR-10C, real-world ATM predictive maintenance and SMAP unsupervised anomaly detection benchmarks show that the proposed ContextFlow++ offers faster stable training and achieves higher performance metrics. Our code is publicly available at https://github.com/gudovskiy/contextflow.


title: Kerr-MOG-(A)dS black hole and its shadow in scalar-tensor-vector gravity theory

abstract: The scalar-tensor-vector gravity (STVG) theory has attracted significant interest due to its ability to effectively address the issue of galaxy rotation curves and clusters of galaxies without considering the influence of dark matter. In this paper, we construct rotating black hole solutions with a cosmological constant in the STVG theory (i.e., Kerr-MOG-(A)dS black hole solutions), where the import of a gravitational charge as a source modifies the gravitational constant, determined by $ G=G_{\text{N}}(1+\alpha) $. For Kerr-MOG-dS spacetime, the observer is situated at a specific location within the domain of outer communication, rather than being located infinitely far away. Since black hole shadows are shaped by light propagation in spacetime, the interaction between the MOG parameter and the cosmological constant is expected to produce novel effects on these shadows. As the cosmological constant $\Lambda$ increases, the apparent size of the black hole shadow on the screen decreases. Additionally, the shadow expands with an increase in the MOG parameter $\alpha$, reaching a maximum at a certain value, and its shape becomes more rounded under an arbitrary rotation parameter, which leads to degeneracy between different black hole parameters. However, by employing numerical backward ray-tracing techniques, we have found that gravitational lensing and the frame-dragging effect effectively distinguish this degeneracy. Our work contributes to a deeper understanding of black holes in modified gravity, their observational signatures, and constraints.


title: Lieb-Thirring type estimates for Dirichlet Laplacians on spiral-shaped domains

abstract: In this paper we derive Lieb-Thirring estimates for eigenvalues of Dirichlet Laplacians below the threshold of the essential spectrum on asymptotically Archimedean spiral-shaped regions.


title: On a Pieri-like rule for the Petrie symmetric functions

abstract: A $k$-ribbon tiling is a decomposition of a connected skew diagram into disjoint ribbons of size $k$. In this paper, we establish a connection between a subset of $k$-ribbon tilings and Petrie symmetric functions, thus providing a combinatorial interpretation for the coefficients in a Pieri-like rule for the Petrie symmetric functions due to Grinberg (Algebr. Comb. 5 (2022), no. 5, 947-1013). This also extends a result by Cheng, Chou and Eu et al. (Proc. Amer. Math. Soc. 151 (2023), no. 5, 1839-1854). As a bonus, our findings can be effectively utilized to derive certain specializations.