title: Popularity-Aware Alignment and Contrast for Mitigating Popularity Bias

abstract: Collaborative Filtering (CF) typically suffers from the significant challenge of popularity bias due to the uneven distribution of items in real-world datasets. This bias leads to a significant accuracy gap between popular and unpopular items. It not only hinders accurate user preference understanding but also exacerbates the Matthew effect in recommendation systems. To alleviate popularity bias, existing efforts focus on emphasizing unpopular items or separating the correlation between item representations and their popularity. Despite the effectiveness, existing works still face two persistent challenges: (1) how to extract common supervision signals from popular items to improve the unpopular item representations, and (2) how to alleviate the representation separation caused by popularity bias. In this work, we conduct an empirical analysis of popularity bias and propose Popularity-Aware Alignment and Contrast (PAAC) to address two challenges. Specifically, we use the common supervisory signals modeled in popular item representations and propose a novel popularity-aware supervised alignment module to learn unpopular item representations. Additionally, we suggest re-weighting the contrastive learning loss to mitigate the representation separation from a popularity-centric perspective. Finally, we validate the effectiveness and rationale of PAAC in mitigating popularity bias through extensive experiments on three real-world datasets. Our code is available at https://github.com/miaomiao-cai2/KDD2024-PAAC.


title: Climate Variable Downscaling with Conditional Normalizing Flows

abstract: Predictions of global climate models typically operate on coarse spatial scales due to the large computational costs of climate simulations. This has led to a considerable interest in methods for statistical downscaling, a similar process to super-resolution in the computer vision context, to provide more local and regional climate information. In this work, we apply conditional normalizing flows to the task of climate variable downscaling. We showcase its successful performance on an ERA5 water content dataset for different upsampling factors. Additionally, we show that the method allows us to assess the predictive uncertainty in terms of standard deviation from the fitted conditional distribution mean.


title: Power of Cooperative Supervision: Multiple Teachers Framework for Enhanced 3D Semi-Supervised Object Detection

abstract: To ensure safe urban driving for autonomous platforms, it is crucial not only to develop high-performance object detection techniques but also to establish a diverse and representative dataset that captures various urban environments and object characteristics. To address these two issues, we have constructed a multi-class 3D LiDAR dataset reflecting diverse urban environments and object characteristics, and developed a robust 3D semi-supervised object detection (SSOD) based on a multiple teachers framework. This SSOD framework categorizes similar classes and assigns specialized teachers to each category. Through collaborative supervision among these category-specialized teachers, the student network becomes increasingly proficient, leading to a highly effective object detector. We propose a simple yet effective augmentation technique, Pie-based Point Compensating Augmentation (PieAug), to enable the teacher network to generate high-quality pseudo-labels. Extensive experiments on the WOD, KITTI, and our datasets validate the effectiveness of our proposed method and the quality of our dataset. Experimental results demonstrate that our approach consistently outperforms existing state-of-the-art 3D semi-supervised object detection methods across all datasets. We plan to release our multi-class LiDAR dataset and the source code available on our Github repository in the near future.


title: ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Model

abstract: Recently, 3D Gaussian Splatting (3DGS) has become a promising framework for novel view synthesis, offering fast rendering speeds and high fidelity. However, the large number of Gaussians and their associated attributes require effective compression techniques. Existing methods primarily compress neural Gaussians individually and independently, i.e., coding all the neural Gaussians at the same time, with little design for their interactions and spatial dependence. Inspired by the effectiveness of the context model in image compression, we propose the first autoregressive model at the anchor level for 3DGS compression in this work. We divide anchors into different levels and the anchors that are not coded yet can be predicted based on the already coded ones in all the coarser levels, leading to more accurate modeling and higher coding efficiency. To further improve the efficiency of entropy coding, e.g., to code the coarsest level with no already coded anchors, we propose to introduce a low-dimensional quantized feature as the hyperprior for each anchor, which can be effectively compressed. Our work pioneers the context model in the anchor level for 3DGS representation, yielding an impressive size reduction of over 100 times compared to vanilla 3DGS and 15 times compared to the most recent state-of-the-art work Scaffold-GS, while achieving comparable or even higher rendering quality.


title: Formal Verification of Ecosystem Restoration Requirements using UML and Alloy

abstract: United Nations have declared the current decade (2021-2030) as the "UN Decade on Ecosystem Restoration" to join R\&D forces to fight against the ongoing environmental crisis. Given the ongoing degradation of earth ecosystems and the related crucial services that they offer to the human society, ecosystem restoration has become a major society-critical issue. It is required to develop rigorously software applications managing ecosystem restoration. Reliable models of ecosystems and restoration goals are necessary. This paper proposes a rigorous approach for ecosystem requirements modeling using formal methods from a model-driven software engineering point of view. The authors describe the main concepts at stake with a metamodel in UML and introduce a formalization of this metamodel in Alloy. The formal model is executed with Alloy Analyzer, and safety and liveness properties are checked against it. This approach helps ensuring that ecosystem specifications are reliable and that the specified ecosystem meets the desired restoration goals, seen in our approach as liveness and safety properties. The concepts and activities of the approach are illustrated with CRESTO, a real-world running example of a restored Costa Rican ecosystem.


title: Beaconless Auto-Alignment for Single-Wavelength 5 Tbit/s Mode-Division Multiplexing Free-Space Optical Communications

abstract: Mode-division multiplexing has shown its ability to significantly increase the capacity of free-space optical communications. An accurate alignment is crucial to enable such links due to possible performance degradation induced by mode crosstalk and narrow beam divergence. Conventionally, a beacon beam is necessary for system alignment due to multiple local maximums in the mode-division multiplexed beam profile. However, the beacon beam introduces excess system complexity, power consumption, and alignment errors. Here we demonstrate a beaconless system with significantly higher alignment accuracy and faster acquisition. This system also excludes excess complexity, power consumption, and alignment errors, facilitating simplified system calibration and supporting a record-high 5.14 Tbit/s line rate in a single-wavelength free-space optical link. We anticipate our paper to be a starting point for more sophisticated alignment scenarios in future multi-Terabit mode-division multiplexing free-space optical communications for long-distance applications with a generalised mode basis.


title: Learning on Large Graphs using Intersecting Communities

abstract: Message Passing Neural Networks (MPNNs) are a staple of graph machine learning. MPNNs iteratively update each node's representation in an input graph by aggregating messages from the node's neighbors, which necessitates a memory complexity of the order of the number of graph edges. This complexity might quickly become prohibitive for large graphs provided they are not very sparse. In this paper, we propose a novel approach to alleviate this problem by approximating the input graph as an intersecting community graph (ICG) -- a combination of intersecting cliques. The key insight is that the number of communities required to approximate a graph does not depend on the graph size. We develop a new constructive version of the Weak Graph Regularity Lemma to efficiently construct an approximating ICG for any input graph. We then devise an efficient graph learning algorithm operating directly on ICG in linear memory and time with respect to the number of nodes (rather than edges). This offers a new and fundamentally different pipeline for learning on very large non-sparse graphs, whose applicability is demonstrated empirically on node classification tasks and spatio-temporal data processing.


title: GI-NAS: Boosting Gradient Inversion Attacks through Adaptive Neural Architecture Search

abstract: Gradient Inversion Attacks invert the transmitted gradients in Federated Learning (FL) systems to reconstruct the sensitive data of local clients and have raised considerable privacy concerns. A majority of gradient inversion methods rely heavily on explicit prior knowledge (e.g., a well pre-trained generative model), which is often unavailable in realistic scenarios. To alleviate this issue, researchers have proposed to leverage the implicit prior knowledge of an over-parameterized network. However, they only utilize a fixed neural architecture for all the attack settings. This would hinder the adaptive use of implicit architectural priors and consequently limit the generalizability. In this paper, we further exploit such implicit prior knowledge by proposing Gradient Inversion via Neural Architecture Search (GI-NAS), which adaptively searches the network and captures the implicit priors behind neural architectures. Extensive experiments verify that our proposed GI-NAS can achieve superior attack performance compared to state-of-the-art gradient inversion methods, even under more practical settings with high-resolution images, large-sized batches, and advanced defense strategies.


title: Symplectic Homology and 3-dimensional Besse Manifolds with vanishing first Chern class

abstract: In this paper, we will show that one can use certain types of symplectic homology as an invariant of 3-dimensional Besse manifolds, which are contact manifolds admitting a periodic Reeb flow and hence allow Seifert fibration structure. For simplicity, we will assume our contact structures to be trivial plane bundles. We will also compute Robbin-Salamon indices of periodic Reeb orbits in Besse manifolds and obtain more precise information about the symplectic homology. In the computations, invariants of the Seifert fibration such as the Euler number and the orbifold Euler characteristic play an important role.


title: GANcrop: A Contrastive Defense Against Backdoor Attacks in Federated Learning

abstract: With heightened awareness of data privacy protection, Federated Learning (FL) has attracted widespread attention as a privacy-preserving distributed machine learning method. However, the distributed nature of federated learning also provides opportunities for backdoor attacks, where attackers can guide the model to produce incorrect predictions without affecting the global model training process. This paper introduces a novel defense mechanism against backdoor attacks in federated learning, named GANcrop. This approach leverages contrastive learning to deeply explore the disparities between malicious and benign models for attack identification, followed by the utilization of Generative Adversarial Networks (GAN) to recover backdoor triggers and implement targeted mitigation strategies. Experimental findings demonstrate that GANcrop effectively safeguards against backdoor attacks, particularly in non-IID scenarios, while maintaining satisfactory model accuracy, showcasing its remarkable defensive efficacy and practical utility.


title: Kinetic theory of stellar systems and two-dimensional vortices

abstract: We discuss the kinetic theory of stellar systems and two-dimensional vortices and stress their analogies. We recall the derivation of the Landau and Lenard-Balescu equations from the Klimontovich formalism. These equations take into account two-body correlations and are valid at the order $1/N$, where $N$ is the number of particles in the system. They have the structure of a Fokker-Planck equation involving a diffusion term and a drift term. The systematic drift of a vortex is the counterpart of the dynamical friction experienced by a star. At equilibrium, the diffusion and the drift terms balance each other establishing the Boltzmann distribution of statistical mechanics. We discuss the problem of kinetic blocking in certain cases and how it can be solved at the order $1/N^2$ by the consideration of three-body correlations. We also consider the behavior of the system close to the critical point following a recent suggestion by Hamilton and Heinemann (2023). We present a simple calculation, valid for spatially homogeneous systems with long-range interactions described by the Cauchy distribution, showing how the consideration of the Landau modes regularizes the divergence of the friction by polarization at the critical point.


title: Extreme Point Supervised Instance Segmentation

abstract: This paper introduces a novel approach to learning instance segmentation using extreme points, i.e., the topmost, leftmost, bottommost, and rightmost points, of each object. These points are readily available in the modern bounding box annotation process while offering strong clues for precise segmentation, and thus allows to improve performance at the same annotation cost with box-supervised methods. Our work considers extreme points as a part of the true instance mask and propagates them to identify potential foreground and background points, which are all together used for training a pseudo label generator. Then pseudo labels given by the generator are in turn used for supervised learning of our final model. On three public benchmarks, our method significantly outperforms existing box-supervised methods, further narrowing the gap with its fully supervised counterpart. In particular, our model generates high-quality masks when a target object is separated into multiple parts, where previous box-supervised methods often fail.


title: GRAVITY for MATISSE -- Improving the MATISSE performance with the GRAVITY fringe tracker

abstract: Context: MATISSE, the mid-infrared spectro-imaging instrument of VLTI, was designed to deliver its advertised performance when paired with an external second generation fringe tracker. Science observation started in 2019, demonstrating imaging capabilities and faint science target observations. Now, The GRAVITY fringe tracker stabilizes the MATISSE fringes which allows using all spectroscopic modes and improves sensitivity and data accuracy. Aims: We present how the MATISSE and GRAVITY instruments were adapted to make the GRAVITY fringe tracker work with MATISSE, under the umbrella of the aptly-named GRA4MAT project, led by ESO in collaboration with the two instrument consortia. Methods: We detail the software modifications needed to implement an acquisition and observing sequence specific to GRA4MAT, including simultaneous fringe tracking and chopping and a narrow off-axis capability inspired by the galactic center and exoplanet capability of GRAVITY. We explain the modified data collection and reduction processes. We show how we leveraged the recent fringe tracker upgrade to implement features specific to its use with MATISSE, e.g. fringe jumps mitigation with an improved group delay control and simultaneous fringe tracking and chopping with a new state machine. Results: We successfully demonstrate significant improvements to the MATISSE instrument. Observations can now be performed at higher spectral resolutions of up to $R\sim3300$ and across the full LM bands at once. Long detector integration times, made possible with stabilized fringes, have improved the LM-bands sensitivity by a factor of 10. Low flux biases in coherently-reduced N-band data have been eliminated. The L-band transfer function is now higher and more stable. We finally illustrate the scientific potential of GRA4MAT with a preview of the first exoplanet observation made by MATISSE on $\beta$ Pictoris b.


title: Maximum Temperature Prediction Using Remote Sensing Data Via Convolutional Neural Network

abstract: Urban heat islands, defined as specific zones exhibiting substantially higher temperatures than their immediate environs, pose significant threats to environmental sustainability and public health. This study introduces a novel machine-learning model that amalgamates data from the Sentinel-3 satellite, meteorological predictions, and additional remote sensing inputs. The primary aim is to generate detailed spatiotemporal maps that forecast the peak temperatures within a 24-hour period in Turin. Experimental results validate the model's proficiency in predicting temperature patterns, achieving a Mean Absolute Error (MAE) of 2.09 degrees Celsius for the year 2023 at a resolution of 20 meters per pixel, thereby enriching our knowledge of urban climatic behavior. This investigation enhances the understanding of urban microclimates, emphasizing the importance of cross-disciplinary data integration, and laying the groundwork for informed policy-making aimed at alleviating the negative impacts of extreme urban temperatures.


title: Dynamical Moir\'e Systems in Twisted Bilayer Optical Lattices

abstract: Moir\'e related physics in twisted bilayer two-dimensional (2D) materials has attracted widespread interest in condensed matter physics. Simulation of moir\'e related physics in cold atom platform is expected to outperform the 2D materials thanks to its advantage of higher tunablility. Here, we point out, the cold atom platform enables a new mechanism of moir\'e lattice formation, with intrinsic "dynamical" character arising from interlayer interaction, in contrast to conventional moir\'e lattice induced by "static" ways such as single-particle interlayer tunneling or external controls. Specifically, we consider a twisted bilayer Bose-Hubbard model with vanishing interlayer tunneling, and the bilayer is solely coupled through interlayer interaction that originates from contact interaction of atoms. We find that this system hosts a plethora of novel phases unique to this dynamical lattice, including a variety of Mott insulator (MI) and superfluid (SF) phases either preserving or breaking moir\'e lattice symmetry, phases with one layer in SF and the other in MI, "interlocked" MI, and self-localized phases at commensurate twist angles, which exhibits the characteristics of Bose glass and quasi-many-body localization in the absence of (quasi)disorder or quasicrystalline lattices. Our prediction can be readily observed in current experimental setup of twisted bilayer optical lattices, opening up new avenues for exploring the rich physics of dynamical moir\'e systems in cold atoms.


title: Dynamic Microgrid Formation Considering Time-dependent Contingency: A Distributionally Robust Approach

abstract: The increasing frequency of extreme weather events has posed significant risks to the operation of power grids. During long-duration extreme weather events, microgrid formation (MF) is an essential solution to enhance the resilience of the distribution systems by proactively partitioning the distribution system into several microgrids to mitigate the impact of contingencies. This paper proposes a distributionally robust dynamic microgrid formation (DR-DMF) approach to fully consider the temporal characteristics of line failure probability during long-duration extreme weather events like typhoons. The boundaries of each microgrid are dynamically adjusted to enhance the resilience of the system. Furthermore, the expected load shedding is minimized by a distributionally robust optimization model considering the uncertainty of line failure probability regarding the worst-case distribution of contingencies. The effectiveness of the proposed model is verified by numerical simulations on a modified IEEE 37-node system.


title: The giant outburst of EXO 2030+375 I: Spectral and pulse profile evolution

abstract: The Be X-ray binary EXO 2030+375 went through its third recorded giant outburst from June 2021 to early 2022. We present the results of both spectral and timing analysis based on NICER monitoring, covering the 2-10 keV flux range from 20 to 310 mCrab. Dense monitoring with observations carried out about every second day and a total exposure time of 160 ks allowed us to closely track the source evolution over the outburst. Changes in spectral shape and pulse profiles showed a stable luminosity dependence during the rise and decline. The same type of dependence has been seen in past outbursts. The pulse profile is characterized by several distinct peaks and dips. The profiles show a clear dependence on luminosity with a stark transition at a luminosity of 2x10^36 erg/s, indicating a change in the emission pattern. Using relativistic ray-tracing, we demonstrate how anisotropic beaming of emission from an accretion channel with constant geometrical configuration can give rise to the observed pulse profiles over a range of luminosities.


title: Language Augmentation in CLIP for Improved Anatomy Detection on Multi-modal Medical Images

abstract: Vision-language models have emerged as a powerful tool for previously challenging multi-modal classification problem in the medical domain. This development has led to the exploration of automated image description generation for multi-modal clinical scans, particularly for radiology report generation. Existing research has focused on clinical descriptions for specific modalities or body regions, leaving a gap for a model providing entire-body multi-modal descriptions. In this paper, we address this gap by automating the generation of standardized body station(s) and list of organ(s) across the whole body in multi-modal MR and CT radiological images. Leveraging the versatility of the Contrastive Language-Image Pre-training (CLIP), we refine and augment the existing approach through multiple experiments, including baseline model fine-tuning, adding station(s) as a superset for better correlation between organs, along with image and language augmentations. Our proposed approach demonstrates 47.6% performance improvement over baseline PubMedCLIP.


title: Progenitor Constraint Incorporating Shell Merger: The Case of Supernova Remnant G359.0-0.9

abstract: It is generally hard to put robust constraints on progenitor masses of supernovae (SNe) and remnants (SNRs) observationally, while they offer tantalizing clues to understanding explosion mechanisms and mass distribution. Our recent study suggests that ``shell merger'', which is theoretically expected for stellar evolution, can appreciably affect final yields of inter-mediate mass elements (IMEs; such as Ne, Mg, and Si). In light of this, here we report results of X-ray spectral analysis of a Galactic SNR G359.0-0.9, whose abundance pattern may possibly be anomalous according to a previous study. Our spectroscopy using all the available data taken with XMM-Newton reveals that this remnant is classified as Mg-rich SNRs because of its high Mg-to-Ne ratio (Z_Mg/Z_Ne=1.90+0.27-0.19; mass ratio 0.66+0.09-0.07) and conclude that the result cannot be explained without the shell merger. By comparing the observation with theoretical calculations, we prefer the so-called Ne-burning shell intrusion and in this case the progenitor mass M_ZAMS is likely <15M_sun. We confirm the result also by our new molecular line observations with the NRO-45 m telescope: G359.0-0.9 is located in the Scutum-Centaurus arm (2.66--2.94 kpc) and in this case the resultant total ejecta mass ~6.8M_sun is indeed consistent with the above estimate. Our method using mass ratios of IMEs presented in this paper will become useful to distinguish the type of the shell merger, the Ne-burning shell intrusion and the O-burning shell merger, for future SNR studies.


title: Regular Subgradients of Marginal Functions with Applications to Calculus and Bilevel Programming

abstract: The paper addresses the study and applications of a broad class of extended-real-valued functions, known as optimal value or marginal functions, which are frequently appeared in variational analysis, parametric optimization, and a variety of applications. Functions of this type are intrinsically nonsmooth and require the usage of tools of generalized differentiation. The main results of this paper provide novel evaluations and exact calculations of regular/Fr\'echet subgradients and their singular counterparts for general classes of marginal functions via their given data. The obtained results are applied to establishing new calculus rules for such subgradients and necessary optimality conditions in bilevel programming


title: Federated Random Forest for Partially Overlapping Clinical Data

abstract: In the healthcare sector, a consciousness surrounding data privacy and corresponding data protection regulations, as well as heterogeneous and non-harmonized data, pose huge challenges to large-scale data analysis. Moreover, clinical data often involves partially overlapping features, as some observations may be missing due to various reasons, such as differences in procedures, diagnostic tests, or other recorded patient history information across hospitals or institutes. To address the challenges posed by partially overlapping features and incomplete data in clinical datasets, a comprehensive approach is required. Particularly in the domain of medical data, promising outcomes are achieved by federated random forests whenever features align. However, for most standard algorithms, like random forest, it is essential that all data sets have identical parameters. Therefore, in this work the concept of federated random forest is adapted to a setting with partially overlapping features. Moreover, our research assesses the effectiveness of the newly developed federated random forest models for partially overlapping clinical data. For aggregating the federated, globally optimized model, only features available locally at each site can be used. We tackled two issues in federation: (i) the quantity of involved parties, (ii) the varying overlap of features. This evaluation was conducted across three clinical datasets. The federated random forest model even in cases where only a subset of features overlaps consistently demonstrates superior performance compared to its local counterpart. This holds true across various scenarios, including datasets with imbalanced classes. Consequently, federated random forests for partially overlapped data offer a promising solution to transcend barriers in collaborative research and corporate cooperation.


title: Elucidating the Role of Stacking Faults in TlGaSe$_{2}$ on its Thermoelectric Properties

abstract: Thermoelectric materials are of great interest for heat energy harvesting applications. One such promising material is TlGaSe$_{2}$, a p-type semiconducting ternary chalcogenide. Recent reports show it can be processed as a thin film, opening the door for large-scale commercialization. However, TlGaSe$_{2}$ is prone to stacking faults along the [001] stacking direction and their role in its thermoelectric properties has not been understood to date. Herein, TlGaSe$_{2}$ is investigated via (scanning) transmission electron microscopy and first-principles calculations. Stacking faults are found to be present throughout the material, as density functional theory calculations reveal a lack of preferential stacking order. Electron transport calculations show an enhancement of thermoelectric power factors when stacking faults are present. This implies the presence of stacking faults is key to the material's excellent thermoelectric properties along the [001] stacking direction, which can be further enhanced by doping the material to hole carrier concentrations to approx. 10$^{19}$ cm$^{-3}$.


title: Discrete Lanchester attrition models: the case of precautionary surrender

abstract: Discrete Lanchester-type attrition models describe many types of antagonistic situations; the preferred interpretation is two fleets of battleships, each trying to sink the other. Such models may be characterised by a bivariate recurrence relation. Here I consider a restricted case in which a fleet that finds itself two or three units behind its opponent immediately surrenders. I present some theoretical and numerical results and suggest lines for further work.


title: Upscaled equations for the Fokker-Planck diffusion through arrays of permeable and of impermeable inclusions

abstract: We study the Fokker-Planck diffusion equation with diffusion coefficient depending periodically on the space variable. Inside a periodic array of inclusions the diffusion coefficient is reduced by a factor called the diffusion magnitude. We find the upscaled equations obtained by taking both the degeneration and the homogenization limits in which the diffusion magnitude and the scale of the periodicity tends, respectively, to zero. Different behaviors, classified as pure diffusion, diffusion with mass deposition, and absence of diffusion, are found depending on the order in which the two limits are taken and on the ratio between the size of the inclusions and the scale of the periodicity.

categories: math.AP cond-mat.stat-mech math-ph math.MP


title: Terahertz emission from mutually synchronized standalone Bi2Sr2CaCu2O8+x intrinsic-Josephson-junction stacks

abstract: Suitably patterned single crystals made of the cuprate superconductor Bi$_2$Sr$_2$CaCu$_2$O$_{8+x}$ (BSCCO), intrinsically forming a stack of Josephson junctions, can generate electromagnetic radiation in the lower terahertz regime. Due to Joule heating the emission power of single stacks seems to be limited to values below 100 $\mu$W. To increase the radiation power, mutually synchronized arrays situated on the same BSCCO base crystal have been studied. Mutual electromagnetic interactions via a connecting BSCCO base crystal have been considered essential for synchronization, but the approach still suffers from Joule heating, preventing the synchronization of more than three stacks. In the present paper we show, on the basis of two emitting stacks, that mutual synchronization can also be achieved by stand-alone stacks contacted by gold layers and sharing only a common gold layer. Compared to BSCCO base crystals, the gold layers have a much higher thermal conductivity and their patterning is not very problematic. We analyze our results in detail, showing that the two oscillators exhibit phase correlations over a range of $\pm$0.4 GHz relative to their center frequencies, which we mainly studied between 745 GHz and 765 GHz. However, we also find that strong phase gradients in the beams radiated from both the mutually locked stacks and the unlocked ones play an important role and, presumably, diminish the detected emission power due to destructive interference. We speculate that the effect arises from higher-order cavity modes which are excited in the individual stacks. Our main message is that the mutual interaction provided by a common gold layer may open new possibilities for relaxing the Joule-heating-problem, allowing the synchronization of a higher number of stacks. Our findings may boost attempts to substantially increase the output power levels of the BSCCO terahertz oscillators.


title: Trajectory Forecasting through Low-Rank Adaptation of Discrete Latent Codes

abstract: Trajectory forecasting is crucial for video surveillance analytics, as it enables the anticipation of future movements for a set of agents, e.g. basketball players engaged in intricate interactions with long-term intentions. Deep generative models offer a natural learning approach for trajectory forecasting, yet they encounter difficulties in achieving an optimal balance between sampling fidelity and diversity. We address this challenge by leveraging Vector Quantized Variational Autoencoders (VQ-VAEs), which utilize a discrete latent space to tackle the issue of posterior collapse. Specifically, we introduce an instance-based codebook that allows tailored latent representations for each example. In a nutshell, the rows of the codebook are dynamically adjusted to reflect contextual information (i.e., past motion patterns extracted from the observed trajectories). In this way, the discretization process gains flexibility, leading to improved reconstructions. Notably, instance-level dynamics are injected into the codebook through low-rank updates, which restrict the customization of the codebook to a lower dimension space. The resulting discrete space serves as the basis of the subsequent step, which regards the training of a diffusion-based predictive model. We show that such a two-fold framework, augmented with instance-level discretization, leads to accurate and diverse forecasts, yielding state-of-the-art performance on three established benchmarks.


title: On the sequential convergence of Lloyd's algorithms

abstract: Lloyd's algorithm is an iterative method that solves the quantization problem, i.e. the approximation of a target probability measure by a discrete one, and is particularly used in digital applications.This algorithm can be interpreted as a gradient method on a certain quantization functional which is given by optimal transport. We study the sequential convergence (to a single accumulation point) for two variants of Lloyd's method: (i) optimal quantization with an arbitrary discrete measure and (ii) uniform quantization with a uniform discrete measure. For both cases, we prove sequential convergence of the iterates under an analiticity assumption on the density of the target measure. This includes for example analytic densities truncated to a compact semi-algebraic set. The argument leverages the log analytic nature of globally subanalytic integrals, the interpretation of Lloyd's method as a gradient method and the convergence analysis of gradient algorithms under Kurdyka-Lojasiewicz assumptions. As a by-product, we also obtain definability results for more general semi-discrete optimal transport losses such as transport distances with general costs, the max-sliced Wasserstein distance and the entropy regularized optimal transport loss.


title: Practical Modelling with Bigraphs

abstract: Bigraphs are a versatile modelling formalism that allows easy expression of placement and connectivity relations in a graphical format. System evolution is user defined as a set of rewrite rules. This paper presents a practical, yet detailed guide to developing, executing, and reasoning about bigraph models, including recent extensions such as parameterised, instantaneous, prioritised and conditional rules, and probabilistic and stochastic rewriting.


title: UAV-Enabled Wireless Networks with Movable-Antenna Array: Flexible Beamforming and Trajectory Design

abstract: Recently, movable antenna (MA) array becomes a promising technology for improving the communication quality in wireless communication systems. In this letter, an unmanned aerial vehicle (UAV) enabled multi-user multi-input-single-output system enhanced by the MA array is investigated. To enhance the throughput capacity, we aim to maximize the achievable data rate by jointly optimizing the transmit beamforming, the UAV trajectory, and the positions of the MA array antennas. The formulated data rate maximization problem is a highly coupled non-convex problem, for which an alternating optimization based algorithm is proposed to get a sub-optimal solution. Numerical results have demonstrated the performance gain of the proposed method compared with conventional method with fixed-position antenna array.


title: Generalized Inverse Optimal Control and its Application in Biology

abstract: Living organisms exhibit remarkable adaptations across all scales, from molecules to ecosystems. We believe that many of these adaptations correspond to optimal solutions driven by evolution, training, and underlying physical and chemical laws and constraints. While some argue against such optimality principles due to their potential ambiguity, we propose generalized inverse optimal control to infer them directly from data. This novel approach incorporates multi-criteria optimality, nestedness of objective functions on different scales, the presence of active constraints, the possibility of switches of optimality principles during the observed time horizon, maximization of robustness, and minimization of time as important special cases, as well as uncertainties involved with the mathematical modeling of biological systems. This data-driven approach ensures that optimality principles are not merely theoretical constructs but are firmly rooted in experimental observations. Furthermore, the inferred principles can be used in forward optimal control to predict and manipulate biological systems, with possible applications in bio-medicine, biotechnology, and agriculture. As discussed and illustrated, the well-posed problem formulation and the inference are challenging and require a substantial interdisciplinary effort in the development of theory and robust numerical methods.


title: OpenTensor: Reproducing Faster Matrix Multiplication Discovering Algorithms

abstract: OpenTensor is a reproduction of AlphaTensor, which discovered a new algorithm that outperforms the state-of-the-art methods for matrix multiplication by Deep Reinforcement Learning (DRL). While AlphaTensor provides a promising framework for solving scientific problems, it is really hard to reproduce due to the massive tricks and lack of source codes. In this paper, we clean up the algorithm pipeline, clarify the technical details, and make some improvements to the training process. Computational results show that OpenTensor can successfully find efficient matrix multiplication algorithms.


title: Bifurcation in correlation length of the Ising model on a "Toblerone" lattice

abstract: The classical Ising chain is the paradigm for the non-existence of phase transitions in 1D systems and was solved by Ernst Ising one hundred years ago. More recently, a decorated two leg Ising ladder has received interest for the curious thermodynamics that resemble a phase transition; a sharp peak in the specific heat at low, but finite temperature. We use this model to reveal a bifurcation in the correlation lengths due to a crossing of the sub-leading eigenvalues of the transfer matrix, which results in two distinct length scales necessary to describe to the decay of correlations. We discuss this phenomenon in the context of the geometric frustration in the model. We also provide additional results to aid in the understanding of the curious thermodynamics of the model through a study of the magnetic susceptibilities.


title: Diffusion Models Are Innate One-Step Generators

abstract: Diffusion Models (DMs) have achieved great success in image generation and other fields. By fine sampling through the trajectory defined by the SDE/ODE solver based on a well-trained score model, DMs can generate remarkable high-quality results. However, this precise sampling often requires multiple steps and is computationally demanding. To address this problem, instance-based distillation methods have been proposed to distill a one-step generator from a DM by having a simpler student model mimic a more complex teacher model. Yet, our research reveals an inherent limitations in these methods: the teacher model, with more steps and more parameters, occupies different local minima compared to the student model, leading to suboptimal performance when the student model attempts to replicate the teacher. To avoid this problem, we introduce a novel distributional distillation method, which uses an exclusive distributional loss. This method exceeds state-of-the-art (SOTA) results while requiring significantly fewer training images. Additionally, we show that DMs' layers are differentially activated at different time steps, leading to an inherent capability to generate images in a single step. Freezing most of the convolutional layers in a DM during distributional distillation enables this innate capability and leads to further performance improvements. Our method achieves the SOTA results on CIFAR-10 (FID 1.54), AFHQv2 64x64 (FID 1.23), FFHQ 64x64 (FID 0.85) and ImageNet 64x64 (FID 1.16) with great efficiency. Most of those results are obtained with only 5 million training images within 6 hours on 8 A100 GPUs.


title: Linear models of strip-type roughness

abstract: Prandtl's secondary flows of the second kind generated by laterally-varying roughness are studied in this work using the linearised Reynolds-Averaged Navier-Stokes approach recently proposed. The momentum equations are coupled to the SA transport model for the turbulent viscosity and the surface roughness is captured by adapting established strategies for homogeneous rough walls to spanwise inhomogeneous surfaces. Linearisation of the governing equations and of the roughness model yields a linear framework that elucidates the linear mechanisms that play a role in the generation of secondary flows. In addition, the framework allows exploring the parameter space associated with heterogeneous rough surfaces. Channel flow is considered, with high and low roughness strips arranged symmetrically on the two channel walls. The strip width is varied systematically to ascertain the role played by the length scale characterising the heterogeneity on the size and intensity of secondary flows. It is found that linear mechanisms, i.e. whereby secondary flows are interpreted as the output response of the turbulent mean flow subjected to a forcing localised at the wall, may be sufficient to explain such a role. In fact the model predicts that secondary flows are most intense when the strip width is about 0.7 times the half-channel height, in excellent agreement with available data. Further, a unified framework to analyse combinations of heterogeneous roughness properties and laterally-varying topographies, common in engineering applications, is discussed. This framework yields two separate secondary-flow inducing source mechanisms, i.e. the lateral variation of the virtual origin from which the turbulent structure is allowed to develop and the lateral variation of the streamwise velocity slip, capturing the acceleration/deceleration perceived by the bulk flow over troughs and crests of the topography.


title: Experimental evidence of crystal-field, Zeeman splitting, and spin-phonon excitations in the quantum supersolid Na2BaCo(PO4)2

abstract: Drawing inspiration from the recent breakthroughs in the \ce{Na_{2}BaCo(PO_{4})_{2}} quantum magnet, renowned for its spin supersolidity phase and its potential for revolutionary cooling applications, our study delves into the intricate interplay among lattice, spin, and orbital degrees of freedom within this intriguing compound. Using meticulous temperature, field, and pressure-dependent Raman scattering techniques, we present compelling experimental evidence revealing pronounced crystal-electric field (CEF) excitations, alongside the interplay of CEF-phonon interactions. Notably, our experiments elucidate all electronic transitions from $j_{1 / 2}$ to $j_{3 / 2}$ and from $j_{1 / 2}$ to $j_{5 / 2}$, with energy level patterns closely aligned with theoretical predictions based on point-charge models. Furthermore, the application of a magnetic field and pressure reveals Zeeman splittings characterized by Land\'e-g factors as well as the CEF-phonon resonances. The anomalous shift in coupled peak at low temperatures originates from the hybridization of CEF and phonon excitations due to their close energy proximity. These findings constitute a significant step towards unraveling the fundamental properties of this exotic quantum material for future research in fundamental physics or engineering application.


title: The generating power of weighted tree automata with initial algebra semantics

abstract: We consider the images of the initial algebra semantics of weighted tree automata over strong bimonoids (hence also over semirings). These images are subsets of the carrier set of the underlying strong bimonoid. We consider locally finite, weakly locally finite, and bi-locally finite strong bimonoids. We show that there exists a strong bimonoid which is weakly locally finite and not locally finite. We also show that if the ranked alphabet contains a binary symbol, then for any finitely generated strong bimonoid, weighted tree automata can generate, via their initial algebra semantics, all elements of the strong bimonoid. As a consequence of these results, for weakly locally finite strong bimonoids which are not locally finite, weighted tree automata can generate infinite images provided that the input ranked alphabet contains at least one binary symbol. This is in sharp contrast to the setting of weighted string automata, where each such image is known to be finite. As a further consequence, for any finitely generated semiring, there exists a weighted tree automaton which generates, via its run semantics, all elements of the semiring.


title: Non-uniqueness of weak solutions to 2D generalized Navier-Stokes equations

abstract: We study the non-uniqueness of weak solutions for the two-dimensional hyper-dissipative Navier-Stokes equations in the super-critical spaces $L_{t}^{\gamma}L_{x}^{p}$ when $\alpha\in[1,\frac{3}{2})$, and obtain the conclusion that the non-uniqueness of the weak solutions at the endpoint $(\gamma,p)=(\infty, \frac{2}{2\alpha-1})$ is sharp in view of the generalized Lady\v{z}enskaja-Prodi-Serrin condition by using a different spatial-temporal building block from [Cheskidov-Luo, Ann. PDE, 9:13 (2023)] and taking advantage of the intermittency of the temporal concentrated function $g_{(k)}$ in an almost optimal way. Our results recover the above 2D non-uniqueness conclusion and extend to the hyper-dissipative case $\alpha \in(1,\frac{3}{2})$.


title: Improving code-mixed hate detection by native sample mixing: A case study for Hindi-English code-mixed scenario

abstract: Hate detection has long been a challenging task for the NLP community. The task becomes complex in a code-mixed environment because the models must understand the context and the hate expressed through language alteration. Compared to the monolingual setup, we see very less work on code-mixed hate as large-scale annotated hate corpora are unavailable to make the study. To overcome this bottleneck, we propose using native language hate samples. We hypothesise that in the era of multilingual language models (MLMs), hate in code-mixed settings can be detected by majorly relying on the native language samples. Even though the NLP literature reports the effectiveness of MLMs on hate detection in many cross-lingual settings, their extensive evaluation in a code-mixed scenario is yet to be done. This paper attempts to fill this gap through rigorous empirical experiments. We considered the Hindi-English code-mixed setup as a case study as we have the linguistic expertise for the same. Some of the interesting observations we got are: (i) adding native hate samples in the code-mixed training set, even in small quantity, improved the performance of MLMs for code-mixed hate detection, (ii) MLMs trained with native samples alone observed to be detecting code-mixed hate to a large extent, (iii) The visualisation of attention scores revealed that, when native samples were included in training, MLMs could better focus on the hate emitting words in the code-mixed context, and (iv) finally, when hate is subjective or sarcastic, naively mixing native samples doesn't help much to detect code-mixed hate. We will release the data and code repository to reproduce the reported results.


title: Understanding magnetic hyperthermia performance within the "Brezovich criterion": beyond the uniaxial anisotropy description

abstract: Careful determination of the heating performance of magnetic nanoparticles under AC fields is critical for magnetic hyperthermia applications. However, most interpretations of experimental data are based on the uniaxial anisotropy approximation, which in first instance can be correlated with particle aspect ratio. This is to say, the intrinsic magnetocrystalline anisotropy is discarded, under the assumption that the shape contribution dominates. We show in this work that such premise, generally valid for large field amplitudes, does not hold for describing hyperthermia experiments carried out under small field values. Specifically, given its relevance for \textit{in vivo} applications, we focus our analysis on the so-called "Brezovich criterion", $H\cdot{f}=4.85\cdot{10^8}A/m\cdot{s}$. By means of a computational model, we show that the intrinsic magnetocrystalline anisotropy plays a critical role in defining the heat output; otherwise, the only-uniaxial anisotropy description reports essentially negligible heat loss values. Our results call therefore for an improvement in the theoretical models used to interpret magnetic hyperthermia performance.


title: Compressibility of dense nuclear matter in the $\rho$-meson variant of the Skyrme model

abstract: We show that coupling the $\textrm{SU}(2)$-valued Skyrme field to the $\rho$-meson solves the long-standing issue of (in)compressibility in the solitonic Skyrme model. Even by including only one $\rho\pi$ interaction term, motivated by a holographic-like reduction of Yang-Mills action by Sutcliffe, reduces the compression modulus from $K_0 \simeq 1080$ MeV, in the massive Skyrme model, to $K_0\simeq 351$ MeV.


title: Fast Bayesian Basis Selection for Functional Data Representation with Correlated Errors

abstract: Functional data analysis (FDA) finds widespread application across various fields, due to data being recorded continuously over a time interval or at several discrete points. Since the data is not observed at every point but rather across a dense grid, smoothing techniques are often employed to convert the observed data into functions. In this work, we propose a novel Bayesian approach for selecting basis functions for smoothing one or multiple curves simultaneously. Our method differentiates from other Bayesian approaches in two key ways: (i) by accounting for correlated errors and (ii) by developing a variational EM algorithm instead of a Gibbs sampler. Simulation studies demonstrate that our method effectively identifies the true underlying structure of the data across various scenarios and it is applicable to different types of functional data. Our variational EM algorithm not only recovers the basis coefficients and the correct set of basis functions but also estimates the existing within-curve correlation. When applied to the motorcycle dataset, our method demonstrates comparable, and in some cases superior, performance in terms of adjusted $R^2$ compared to other techniques such as regression splines, Bayesian LASSO and LASSO. Additionally, when assuming independence among observations within a curve, our method, utilizing only a variational Bayes algorithm, is in the order of thousands faster than a Gibbs sampler on average. Our proposed method is implemented in R and codes are available at https://github.com/acarolcruz/VB-Bases-Selection.


title: Information Theoretic Text-to-Image Alignment

abstract: Diffusion models for Text-to-Image (T2I) conditional generation have seen tremendous success recently. Despite their success, accurately capturing user intentions with these models still requires a laborious trial and error process. This challenge is commonly identified as a model alignment problem, an issue that has attracted considerable attention by the research community. Instead of relying on fine-grained linguistic analyses of prompts, human annotation, or auxiliary vision-language models to steer image generation, in this work we present a novel method that relies on an information-theoretic alignment measure. In a nutshell, our method uses self-supervised fine-tuning and relies on point-wise mutual information between prompts and images to define a synthetic training set to induce model alignment. Our comparative analysis shows that our method is on-par or superior to the state-of-the-art, yet requires nothing but a pre-trained denoising network to estimate MI and a lightweight fine-tuning strategy.


title: On $r$-primitive $k$-normal polynomials with two prescribed coefficients

abstract: This article investigates the existence of an $r$-primitive $k$-normal polynomial, defined as the minimal polynomial of an $r$-primitive $k$-normal element in $\mathbb{F}_{q^n}$, with a specified degree $n$ and two given coefficients over the finite field $\mathbb{F}_{q}$. Here, $q$ represents an odd prime power, and $n$ is an integer. The article establishes a sufficient condition to ensure the existence of such a polynomial. Using this condition, it is demonstrated that a $2$-primitive $2$-normal polynomial of degree $n$ always exists over $\mathbb{F}_{q}$ when both $q\geq 11$ and $n\geq 15$. However, for the range $10\leq n\leq 14$, uncertainty remains regarding the existence of such a polynomial for $71$ specific pairs of $(q,n)$. Moreover, when $q<11$, the number of uncertain pairs reduces to $16$. Furthermore, for the case of $n=9$, extensive computational power is employed using SageMath software, and it is found that the count of such uncertain pairs is reduced to $3988$.


title: Share Your Secrets for Privacy! Confidential Forecasting with Vertical Federated Learning

abstract: Vertical federated learning (VFL) is a promising area for time series forecasting in industrial applications, such as predictive maintenance and machine control. Critical challenges to address in manufacturing include data privacy and over-fitting on small and noisy datasets during both training and inference. Additionally, to increase industry adaptability, such forecasting models must scale well with the number of parties while ensuring strong convergence and low-tuning complexity. We address those challenges and propose 'Secret-shared Time Series Forecasting with VFL' (STV), a novel framework that exhibits the following key features: i) a privacy-preserving algorithm for forecasting with SARIMAX and autoregressive trees on vertically partitioned data; ii) serverless forecasting using secret sharing and multi-party computation; iii) novel N-party algorithms for matrix multiplication and inverse operations for direct parameter optimization, giving strong convergence with minimal hyperparameter tuning complexity. We conduct evaluations on six representative datasets from public and industry-specific contexts. Our results demonstrate that STV's forecasting accuracy is comparable to those of centralized approaches. They also show that our direct optimization can outperform centralized methods, which include state-of-the-art diffusion models and long-short-term memory, by 23.81% on forecasting accuracy. We also conduct a scalability analysis by examining the communication costs of direct and iterative optimization to navigate the choice between the two. Code and appendix are available: https://github.com/adis98/STV


title: Comparison of Access Control Approaches for Graph-Structured Data

abstract: Access control is the enforcement of the authorization policy, which defines subjects, resources, and access rights. Graph-structured data requires advanced, flexible, and fine-grained access control due to its complex structure as sequences of alternating vertices and edges. Several research works focus on protecting property graph-structured data, enforcing fine-grained access control, and proving the feasibility and applicability of their concept. However, they differ conceptually and technically. We select works from our systematic literature review on authorization and access control for different database models in addition to recent ones. Based on defined criteria, we exclude research works with different objectives, such as no protection of graph-structured data, graph models other than the property graph, coarse-grained access control approaches, or no application in a graph datastore (i.e., no proof-of-concept implementation). The latest version of the remaining works are discussed in detail in terms of their access control approach as well as authorization policy definition and enforcement. Finally, we analyze the strengths and limitations of the selected works and provide a comparison with respect to different aspects, including the base access control model, open/closed policy, negative permission support, and datastore-independent enforcement.


title: Improving Generalization and Convergence by Enhancing Implicit Regularization

abstract: In this work, we propose an Implicit Regularization Enhancement (IRE) framework to accelerate the discovery of flat solutions in deep learning, thereby improving generalization and convergence. Specifically, IRE decouples the dynamics of flat and sharp directions, which boosts the sharpness reduction along flat directions while maintaining the training stability in sharp directions. We show that IRE can be practically incorporated with {\em generic base optimizers} without introducing significant computational overload. Experiments show that IRE consistently improves the generalization performance for image classification tasks across a variety of benchmark datasets (CIFAR-10/100, ImageNet) and models (ResNets and ViTs). Surprisingly, IRE also achieves a $2\times$ {\em speed-up} compared to AdamW in the pre-training of Llama models (of sizes ranging from 60M to 229M) on datasets including Wikitext-103, Minipile, and Openwebtext. Moreover, we provide theoretical guarantees, showing that IRE can substantially accelerate the convergence towards flat minima in Sharpness-aware Minimization (SAM).


title: CoMoFusion: Fast and High-quality Fusion of Infrared and Visible Image with Consistency Model

abstract: Generative models are widely utilized to model the distribution of fused images in the field of infrared and visible image fusion. However, current generative models based fusion methods often suffer from unstable training and slow inference speed. To tackle this problem, a novel fusion method based on consistency model is proposed, termed as CoMoFusion, which can generate the high-quality images and achieve fast image inference speed. In specific, the consistency model is used to construct multi-modal joint features in the latent space with the forward and reverse process. Then, the infrared and visible features extracted by the trained consistency model are fed into fusion module to generate the final fused image. In order to enhance the texture and salient information of fused images, a novel loss based on pixel value selection is also designed. Extensive experiments on public datasets illustrate that our method obtains the SOTA fusion performance compared with the existing fusion methods.


title: A transportable hyperspectral imaging setup based on fast, high-density spectral scanning for in situ quantitative biochemical mapping of fresh tissue biopsies

abstract: Histopathological examination of surgical biopsies, such as in glioma and glioblastoma resection, is hindered in current clinical practice by the long times required for the laboratory analysis and pathological screening, typically taking several days or even weeks to be completed. We propose here a transportable, high-density, spectral-scanning based hyperspectral imaging setup, named HyperProbe1, that can provide in situ, fast biochemical analysis and mapping of fresh surgical tissue samples, right after excision, and without the need of fixing or staining. HyperProbe1 is based on spectral scanning via supercontinuum laser illumination filtered with acousto-optic tuneable filters. Such methodology allows the user to select any number and type of wavelength bands in the visible and near-infrared range between 510 and 900 nm (up to 79), and to reconstruct 3D hypercubes composed of high-resolution, widefield images of the surgical samples, where each pixel is associated with a complete spectrum. The system is applied on 11 fresh surgical biopsies of glioma from routine patients, including different grades of tumour classification. Quantitative analysis of the composition of the tissue is performed via fast spectral unmixing to reconstruct mapping of major biomarkers. We also provided a preliminary attempt to infer tumour classification based on differences of composition in the samples, suggesting the possibility to use lipid content and differential cytochrome-c-oxidase concentrations to distinguish between lower and higher grade gliomas. A proof-of-concept of the performances of HyperProbe1 for quantitative, biochemical mapping of surgical biopsies is demonstrated, paving the way for improving current post-surgical, histopathological practice via non-destructive, in situ streamlined screening of fresh tissue samples in a matter of minutes after excision.


title: Long cycles and spectral radii in planar graphs

abstract: There is a rich history of studying the existence of cycles in planar graphs. The famous Tutte theorem on the Hamilton cycle states that every 4-connected planar graph contains a Hamilton cycle. Later on, Thomassen (1983), Thomas and Yu (1994) and Sanders (1996) respectively proved that every 4-connected planar graph contains a cycle of length $n-1, n-2$ and $n-3$. Chen, Fan and Yu (2004) further conjectured that every 4-connected planar graph contains a cycle of length $\ell$ for $\ell\in\{n,n-1,\ldots,n-25\}$ and they verified that $\ell\in \{n-4, n-5, n-6\}$. When we remove the ``4-connected" condition, how to guarantee the existence of a long cycle in a planar graph? A natural question asks by adding a spectral radius condition: What is the smallest constant $C$ such that for sufficiently large $n$, every graph $G$ of order $n$ with spectral radius greater than $C$ contains a long cycle in a planar graph? In this paper, we give a stronger answer to the above question. Let $G$ be a planar graph with order $n\geq 1.8\times 10^{17}$ and $k\leq \lfloor\log_2(n-3)\rfloor-8$ be a non-negative integer, we show that if $\rho(G)\geq \rho(K_2\vee(P_{n-2k-4}\cup 2P_{k+1}))$ then $G$ contains a cycle of length $\ell$ for every $\ell\in \{n-k, n-k-1, \ldots, 3\}$ unless $G\cong K_2\vee(P_{n-2k-4}\cup 2P_{k+1})$.


title: Topological analysis of entropy measure using regression model for terpyridine complex nanosheet

abstract: A numerical parameter, known as a topological index, is employed to represent the molecular structure of a compound by considering its graph-theoretical properties. In the study of quantitative structure-activity relationships (QSAR) and quantitative structure-property relationships (QSPR), topological indices are used to predict the physicochemical properties of chemical compounds. Graph entropies have evolved as information-theoretic tools to investigate the structural information of a molecular graph. In this research work, we compute the Nirmala index, the first and second inverse Nirmala index for terpyridine complex nanosheet $TCN_{n,m}$ with the help of its M-polynomial. Further, entropy measures based on Nirmala indices are calculated for terpyridine complex nanosheets. We expand this analysis to include visual comparisons, which could be useful in refining the structure for more effective implementation. Furthermore, using graphical and numerical methods, the correlation and comparison between the Nirmala indices and the corresponding entropy measurements are shown. The relationship between the Nirmala indices and associated entropy measurements is then examined using a regression model.


title: Expanded Gating Ranges Improve Activation Functions

abstract: Activation functions are core components of all deep learning architectures. Currently, the most popular activation functions are smooth ReLU variants like GELU and SiLU. These are self-gated activation functions where the range of the gating function is between zero and one. In this paper, we explore the viability of using arctan as a gating mechanism. A self-gated activation function that uses arctan as its gating function has a monotonically increasing first derivative. To make this activation function competitive, it is necessary to introduce a trainable parameter for every MLP block to expand the range of the gating function beyond zero and one. We find that this technique also improves existing self-gated activation functions. We conduct an empirical evaluation of Expanded ArcTan Linear Unit (xATLU), Expanded GELU (xGELU), and Expanded SiLU (xSiLU) and show that they outperform existing activation functions within a transformer architecture. Additionally, expanded gating ranges show promising results in improving first-order Gated Linear Units (GLU).


title: Avoiding Pitfalls for Privacy Accounting of Subsampled Mechanisms under Composition

abstract: We consider the problem of computing tight privacy guarantees for the composition of subsampled differentially private mechanisms. Recent algorithms can numerically compute the privacy parameters to arbitrary precision but must be carefully applied. Our main contribution is to address two common points of confusion. First, some privacy accountants assume that the privacy guarantees for the composition of a subsampled mechanism are determined by self-composing the worst-case datasets for the uncomposed mechanism. We show that this is not true in general. Second, Poisson subsampling is sometimes assumed to have similar privacy guarantees compared to sampling without replacement. We show that the privacy guarantees may in fact differ significantly between the two sampling schemes. In particular, we give an example of hyperparameters that result in $\varepsilon \approx 1$ for Poisson subsampling and $\varepsilon > 10$ for sampling without replacement. This occurs for some parameters that could realistically be chosen for DP-SGD.


title: Large Language Model Sentinel: Advancing Adversarial Robustness by LLM Agent

abstract: Over the past two years, the use of large language models (LLMs) has advanced rapidly. While these LLMs offer considerable convenience, they also raise security concerns, as LLMs are vulnerable to adversarial attacks by some well-designed textual perturbations. In this paper, we introduce a novel defense technique named Large LAnguage MOdel Sentinel (LLAMOS), which is designed to enhance the adversarial robustness of LLMs by purifying the adversarial textual examples before feeding them into the target LLM. Our method comprises two main components: a) Agent instruction, which can simulate a new agent for adversarial defense, altering minimal characters to maintain the original meaning of the sentence while defending against attacks; b) Defense guidance, which provides strategies for modifying clean or adversarial examples to ensure effective defense and accurate outputs from the target LLMs. Remarkably, the defense agent demonstrates robust defensive capabilities even without learning from adversarial examples. Additionally, we conduct an intriguing adversarial experiment where we develop two agents, one for defense and one for defense, and engage them in mutual confrontation. During the adversarial interactions, neither agent completely beat the other. Extensive experiments on both open-source and closed-source LLMs demonstrate that our method effectively defends against adversarial attacks, thereby enhancing adversarial robustness.


title: Towards Black-Box Membership Inference Attack for Diffusion Models

abstract: Identifying whether an artwork was used to train a diffusion model is an important research topic, given the rising popularity of AI-generated art and the associated copyright concerns. The work approaches this problem from the membership inference attack (MIA) perspective. We first identify the limitations of applying existing MIA methods for copyright protection: the required access of internal U-nets and the choice of non-member datasets for evaluation. To address the above problems, we introduce a novel black-box membership inference attack method that operates without needing access to the model's internal U-net. We then construct a DALL-E generated dataset for a more comprehensive evaluation. We validate our method across various setups, and our experimental results outperform previous works.


title: Reinforcement Learning for Sociohydrology

abstract: In this study, we discuss how reinforcement learning (RL) provides an effective and efficient framework for solving sociohydrology problems. The efficacy of RL for these types of problems is evident because of its ability to update policies in an iterative manner - something that is also foundational to sociohydrology, where we are interested in representing the co-evolution of human-water interactions. We present a simple case study to demonstrate the implementation of RL in a problem of runoff reduction through management decisions related to changes in land-use land-cover (LULC). We then discuss the benefits of RL for these types of problems and share our perspectives on the future research directions in this area.


title: Visual-RolePlay: Universal Jailbreak Attack on MultiModal Large Language Models via Role-playing Image Character

abstract: With the advent and widespread deployment of Multimodal Large Language Models (MLLMs), ensuring their safety has become increasingly critical. To achieve this objective, it requires us to proactively discover the vulnerability of MLLMs by exploring the attack methods. Thus, structure-based jailbreak attacks, where harmful semantic content is embedded within images, have been proposed to mislead the models. However, previous structure-based jailbreak methods mainly focus on transforming the format of malicious queries, such as converting harmful content into images through typography, which lacks sufficient jailbreak effectiveness and generalizability. To address these limitations, we first introduce the concept of "Role-play" into MLLM jailbreak attacks and propose a novel and effective method called Visual Role-play (VRP). Specifically, VRP leverages Large Language Models to generate detailed descriptions of high-risk characters and create corresponding images based on the descriptions. When paired with benign role-play instruction texts, these high-risk character images effectively mislead MLLMs into generating malicious responses by enacting characters with negative attributes. We further extend our VRP method into a universal setup to demonstrate its generalizability. Extensive experiments on popular benchmarks show that VRP outperforms the strongest baseline, Query relevant and FigStep, by an average Attack Success Rate (ASR) margin of 14.3% across all models.


title: Exploring Backdoor Attacks against Large Language Model-based Decision Making

abstract: Large Language Models (LLMs) have shown significant promise in decision-making tasks when fine-tuned on specific applications, leveraging their inherent common sense and reasoning abilities learned from vast amounts of data. However, these systems are exposed to substantial safety and security risks during the fine-tuning phase. In this work, we propose the first comprehensive framework for Backdoor Attacks against LLM-enabled Decision-making systems (BALD), systematically exploring how such attacks can be introduced during the fine-tuning phase across various channels. Specifically, we propose three attack mechanisms and corresponding backdoor optimization methods to attack different components in the LLM-based decision-making pipeline: word injection, scenario manipulation, and knowledge injection. Word injection embeds trigger words directly into the query prompt. Scenario manipulation occurs in the physical environment, where a high-level backdoor semantic scenario triggers the attack. Knowledge injection conducts backdoor attacks on retrieval augmented generation (RAG)-based LLM systems, strategically injecting word triggers into poisoned knowledge while ensuring the information remains factually accurate for stealthiness. We conduct extensive experiments with three popular LLMs (GPT-3.5, LLaMA2, PaLM2), using two datasets (HighwayEnv, nuScenes), and demonstrate the effectiveness and stealthiness of our backdoor triggers and mechanisms. Finally, we critically assess the strengths and weaknesses of our proposed approaches, highlight the inherent vulnerabilities of LLMs in decision-making tasks, and evaluate potential defenses to safeguard LLM-based decision making systems.


title: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

abstract: Security concerns related to Large Language Models (LLMs) have been extensively explored, yet the safety implications for Multimodal Large Language Models (MLLMs), particularly in medical contexts (MedMLLMs), remain insufficiently studied. This paper delves into the underexplored security vulnerabilities of MedMLLMs, especially when deployed in clinical environments where the accuracy and relevance of question-and-answer interactions are critically tested against complex medical challenges. By combining existing clinical medical data with atypical natural phenomena, we redefine two types of attacks: mismatched malicious attack (2M-attack) and optimized mismatched malicious attack (O2M-attack). Using our own constructed voluminous 3MAD dataset, which covers a wide range of medical image modalities and harmful medical scenarios, we conduct a comprehensive analysis and propose the MCM optimization method, which significantly enhances the attack success rate on MedMLLMs. Evaluations with this dataset and novel attack methods, including white-box attacks on LLaVA-Med and transfer attacks on four other state-of-the-art models, indicate that even MedMLLMs designed with enhanced security features are vulnerable to security breaches. Our work underscores the urgent need for a concerted effort to implement robust security measures and enhance the safety and efficacy of open-source MedMLLMs, particularly given the potential severity of jailbreak attacks and other malicious or clinically significant exploits in medical settings. For further research and replication, anonymous access to our code is available at https://github.com/dirtycomputer/O2M_attack. Warning: Medical large model jailbreaking may generate content that includes unverified diagnoses and treatment recommendations. Always consult professional medical advice.


title: Federated Learning with Blockchain-Enhanced Machine Unlearning: A Trustworthy Approach

abstract: With the growing need to comply with privacy regulations and respond to user data deletion requests, integrating machine unlearning into IoT-based federated learning has become imperative. Traditional unlearning methods, however, often lack verifiable mechanisms, leading to challenges in establishing trust. This paper delves into the innovative integration of blockchain technology with federated learning to surmount these obstacles. Blockchain fortifies the unlearning process through its inherent qualities of immutability, transparency, and robust security. It facilitates verifiable certification, harmonizes security with privacy, and sustains system efficiency. We introduce a framework that melds blockchain with federated learning, thereby ensuring an immutable record of unlearning requests and actions. This strategy not only bolsters the trustworthiness and integrity of the federated learning model but also adeptly addresses efficiency and security challenges typical in IoT environments. Our key contributions encompass a certification mechanism for the unlearning process, the enhancement of data security and privacy, and the optimization of data management to ensure system responsiveness in IoT scenarios.


title: Black-Box Detection of Language Model Watermarks

abstract: Watermarking has emerged as a promising way to detect LLM-generated text. To apply a watermark an LLM provider, given a secret key, augments generations with a signal that is later detectable by any party with the same key. Recent work has proposed three main families of watermarking schemes, two of which focus on the property of preserving the LLM distribution. This is motivated by it being a tractable proxy for maintaining LLM capabilities, but also by the idea that concealing a watermark deployment makes it harder for malicious actors to hide misuse by avoiding a certain LLM or attacking its watermark. Yet, despite much discourse around detectability, no prior work has investigated if any of these scheme families are detectable in a realistic black-box setting. We tackle this for the first time, developing rigorous statistical tests to detect the presence of all three most popular watermarking scheme families using only a limited number of black-box queries. We experimentally confirm the effectiveness of our methods on a range of schemes and a diverse set of open-source models. Our findings indicate that current watermarking schemes are more detectable than previously believed, and that obscuring the fact that a watermark was deployed may not be a viable way for providers to protect against adversaries. We further apply our methods to test for watermark presence behind the most popular public APIs: GPT4, Claude 3, Gemini 1.0 Pro, finding no strong evidence of a watermark at this point in time.


title: Improved Generation of Adversarial Examples Against Safety-aligned LLMs

abstract: Despite numerous efforts to ensure large language models (LLMs) adhere to safety standards and produce harmless content, some successes have been achieved in bypassing these restrictions, known as jailbreak attacks against LLMs. Adversarial prompts generated using gradient-based methods exhibit outstanding performance in performing jailbreak attacks automatically. Nevertheless, due to the discrete nature of texts, the input gradient of LLMs struggles to precisely reflect the magnitude of loss change that results from token replacements in the prompt, leading to limited attack success rates against safety-aligned LLMs, even in the white-box setting. In this paper, we explore a new perspective on this problem, suggesting that it can be alleviated by leveraging innovations inspired in transfer-based attacks that were originally proposed for attacking black-box image classification models. For the first time, we appropriate the ideologies of effective methods among these transfer-based attacks, i.e., Skip Gradient Method and Intermediate Level Attack, for improving the effectiveness of automatically generated adversarial examples against white-box LLMs. With appropriate adaptations, we inject these ideologies into gradient-based adversarial prompt generation processes and achieve significant performance gains without introducing obvious computational cost. Meanwhile, by discussing mechanisms behind the gains, new insights are drawn, and proper combinations of these methods are also developed. Our empirical results show that the developed combination achieves >30% absolute increase in attack success rates compared with GCG for attacking the Llama-2-7B-Chat model on AdvBench.


title: Asymptotic utility of spectral anonymization

abstract: In the contemporary data landscape characterized by multi-source data collection and third-party sharing, ensuring individual privacy stands as a critical concern. While various anonymization methods exist, their utility preservation and privacy guarantees remain challenging to quantify. In this work, we address this gap by studying the utility and privacy of the spectral anonymization (SA) algorithm, particularly in an asymptotic framework. Unlike conventional anonymization methods that directly modify the original data, SA operates by perturbing the data in a spectral basis and subsequently reverting them to their original basis. Alongside the original version $\mathcal{P}$-SA, employing random permutation transformation, we introduce two novel SA variants: $\mathcal{J}$-spectral anonymization and $\mathcal{O}$-spectral anonymization, which employ sign-change and orthogonal matrix transformations, respectively. We show how well, under some practical assumptions, these SA algorithms preserve the first and second moments of the original data. Our results reveal, in particular, that the asymptotic efficiency of all three SA algorithms in covariance estimation is exactly 50% when compared to the original data. To assess the applicability of these asymptotic results in practice, we conduct a simulation study with finite data and also evaluate the privacy protection offered by these algorithms using distance-based record linkage. Our research reveals that while no method exhibits clear superiority in finite-sample utility, $\mathcal{O}$-SA distinguishes itself for its exceptional privacy preservation, never producing identical records, albeit with increased computational complexity. Conversely, $\mathcal{P}$-SA emerges as a computationally efficient alternative, demonstrating unmatched efficiency in mean estimation.


title: Simulating Physics with Computers

abstract: Feynman gave in 1982 a keynote speech \textit{Simulating Physics with Computers} (Int. J. Theor. Phys. {\bf 21}, 467 (1982)) in which he talked ``...about the possibility...that the computer will do exactly the same as nature". The motivation was that: ``...the physical world is quantum mechanical, and therefore the proper problem is the simulation of quantum physics". Here I try after more than forty years to answer Feynman's question of whether it is possible to perform exact computer simulations. Many computer simulations are not exact, they contain mean field approximations that disobey the symmetry in the quantum dynamics with Newton's third law, e.g. almost all astrophysical simulations of galaxy systems. After a review of computer simulations and the problems of simulating real systems, I argue that Newton's discrete dynamics, which is used in almost all computer simulations and which is exact in the same sense as Newton's analytic dynamics, is the classical limit path of Feynman's quantum paths. However, the physical world is not known exactly and it is much more complex than any simulated systems, and so far no real systems have been simulated exactly. Hence, more than forty years later, and after hundreds of thousands of computer simulations of the physical system's dynamics the answer to Feynman's question is still negative. But although it is not possible to simulate the dynamics exactly for any real systems, the simulations have been and will be of great use in Natural Science.


title: Physical meaning of electromagnetic mass and 4/3-problem

abstract: In this article one aspect of the so-called '4/3-problem' is analyzed, namely definitions of the electromagnetic mass of the classical electron. It is shown that if the special relativity definition of the electromagnetic (EM) mass as the ratio of the electromagnetic field energy to the square of the speed of light is correctly treated by the scientists who considered this probem, the second definition, which originated with Thomson, i.e. a coefficient of proportionality of the EM momentum of the particle and its velocity has another physical meaning. This meaning was explained by Frenkel in his textbook on clssical electrodynamics. According to this scientist, the second EM mass is actualy a self-inductance of the classical electron or the reaction of its magnetic field to a change in the velocity of this particle. Consequently, these two physical quantities have different meanings, and attempts to reduce the expression for one mass to an expression for the second mass have always been unsuccessful.


title: Universal Exact Compression of Differentially Private Mechanisms

abstract: To reduce the communication cost of differential privacy mechanisms, we introduce a novel construction, called Poisson private representation (PPR), designed to compress and simulate any local randomizer while ensuring local differential privacy. Unlike previous simulation-based local differential privacy mechanisms, PPR exactly preserves the joint distribution of the data and the output of the original local randomizer. Hence, the PPR-compressed privacy mechanism retains all desirable statistical properties of the original privacy mechanism such as unbiasedness and Gaussianity. Moreover, PPR achieves a compression size within a logarithmic gap from the theoretical lower bound. Using the PPR, we give a new order-wise trade-off between communication, accuracy, central and local differential privacy for distributed mean estimation. Experiment results on distributed mean estimation show that PPR consistently gives a better trade-off between communication, accuracy and central differential privacy compared to the coordinate subsampled Gaussian mechanism, while also providing local differential privacy.


title: Thermodynamics of the most generalized form of Holographic Dark Energy and some particular cases with Corrected Entropies

abstract: The holographic cut-off in generalized dark energy (HDE) formalism depends on its cut-off. Following this, a four-parameter generalized entropy has recently been developed. It reduces to various known entropies for appropriate parameter limits in the study of Odintsov, S. D., S. DOnofrio, and T. Paul. (2023) Physics of the Dark Universe, 42 pp: 101277. In the current work, we investigate the evolution of the universe in its early phase and late phase within the framework of entropic cosmology, where the entropic energy density functions are reconstructed within the framework of the equivalence of holographic dark energy and four-parameter generalized entropy (Sg). Along with the reconstruction as mentioned earlier scheme, in this study, we demonstrate that an extensive variety of dark energy (DE) models can be considered distinct and particular candidates for the most generalized four-parameter entropic HDE family, each having their cut-off. We examined several entropic dark energy models in this regard, including the generalized holographic dark energy with Nojiri-Odintsov(NO) cut-off, the Barrow entropic HDE (BHDE) with particle horizon as IR cut-off, the Tsallis entropic HDE (THDE) with future event horizon as IR cut-off, all of three cases are particular cases of the most generalized four parameter entropic holographic dark energy. Inspired by S. Nojiri, and S. D. Odintsov (2006) (General Relativity and Gravitation, 38 p: 1285-1304 ) and (S. Nojiri and S. D. Odintsov, 2017, European Physical Journal C, 77, pp.1-8 ); our current work reports a study on cosmological parameters and thermodynamics with entropy-corrections (logarithmic and power-law) to cosmological horizon entropy as well as black hole entropy with a highly generalized viscous coupled holographic dark fluid along its particular cases.


title: Totally geodesic submanifolds in the manifold SPD of symmetric positive-definite real matrices

abstract: This paper is a self-contained exposition of the geometry of symmetric positive-definite real $n\times n$ matrices $\operatorname{SPD}(n)$, including necessary and sufficent conditions for a submanifold $\mathcal{N} \subset\operatorname{SPD}(n)$ to be totally geodesic for the affine-invariant Riemannian metric. A non-linear projection $x\mapsto \pi(x)$ on a totally geodesic submanifold is defined. This projection has the minimizing property with respect to the Riemannian metric: it maps an arbitrary point $x \in\operatorname{SPD}(n)$ to the unique closest element $\pi(x)$ in the totally geodesic submanifold for the distance defined by the affine-invariant Riemannian metric. Decompositions of the space $\operatorname{SPD}(n)$ follow, as well as variants of the polar decomposition of non-singular matrices known as Mostow's decompositions. Applications to decompositions of covariant matrices are mentioned.


title: How the Future Works at SOUPS: Analyzing Future Work Statements and Their Impact on Usable Security and Privacy Research

abstract: Extending knowledge by identifying and investigating valuable research questions and problems is a core function of research. Research publications often suggest avenues for future work to extend and build upon their results. Considering these suggestions can contribute to developing research ideas that build upon previous work and produce results that tie into existing knowledge. Usable security and privacy researchers commonly add future work statements to their publications. However, our community lacks an in-depth understanding of their prevalence, quality, and impact on future research. Our work aims to address this gap in the research literature. We reviewed all 27 papers from the 2019 SOUPS proceedings and analyzed their future work statements. Additionally, we analyzed 978 publications that cite any paper from SOUPS 2019 proceedings to assess their future work statements' impact. We find that most papers from the SOUPS 2019 proceedings include future work statements. However, they are often unspecific or ambiguous, and not always easy to find. Therefore, the citing publications often matched the future work statements' content thematically, but rarely explicitly acknowledged them, indicating a limited impact. We conclude with recommendations for the usable security and privacy community to improve the utility of future work statements by making them more tangible and actionable, and avenues for future work.


title: Stratified Avatar Generation from Sparse Observations

abstract: Estimating 3D full-body avatars from AR/VR devices is essential for creating immersive experiences in AR/VR applications. This task is challenging due to the limited input from Head Mounted Devices, which capture only sparse observations from the head and hands. Predicting the full-body avatars, particularly the lower body, from these sparse observations presents significant difficulties. In this paper, we are inspired by the inherent property of the kinematic tree defined in the Skinned Multi-Person Linear (SMPL) model, where the upper body and lower body share only one common ancestor node, bringing the potential of decoupled reconstruction. We propose a stratified approach to decouple the conventional full-body avatar reconstruction pipeline into two stages, with the reconstruction of the upper body first and a subsequent reconstruction of the lower body conditioned on the previous stage. To implement this straightforward idea, we leverage the latent diffusion model as a powerful probabilistic generator, and train it to follow the latent distribution of decoupled motions explored by a VQ-VAE encoder-decoder model. Extensive experiments on AMASS mocap dataset demonstrate our state-of-the-art performance in the reconstruction of full-body motions.


title: PGA-SciRE: Harnessing LLM on Data Augmentation for Enhancing Scientific Relation Extraction

abstract: Relation Extraction (RE) aims at recognizing the relation between pairs of entities mentioned in a text. Advances in LLMs have had a tremendous impact on NLP. In this work, we propose a textual data augmentation framework called PGA for improving the performance of models for RE in the scientific domain. The framework introduces two ways of data augmentation, utilizing a LLM to obtain pseudo-samples with the same sentence meaning but with different representations and forms by paraphrasing the original training set samples. As well as instructing LLM to generate sentences that implicitly contain information about the corresponding labels based on the relation and entity of the original training set samples. These two kinds of pseudo-samples participate in the training of the RE model together with the original dataset, respectively. The PGA framework in the experiment improves the F1 scores of the three mainstream models for RE within the scientific domain. Also, using a LLM to obtain samples can effectively reduce the cost of manually labeling data.


title: Synchronizing Rhythms of Logic

abstract: Although quantum states nicely express interference effects, outcomes of experimental trials show no states directly; they indicate properties of probability distributions for outcomes. Twenty years ago we proved categorically that probability distributions leave open a choice of quantum states and operators and particles, resolvable only by a move beyond logic, which, inspired or not, can be characterized as a guess. Guesses link the inner lives of investigators to their explanations that objectively accord with measured data. Recognizing the inescapability of guesswork in physics leads to avenues of investigation, an example of which is this paper. We display a physical foundation of logic and calculation, representing this foundation mathematically, so as to show the shaping and re-shaping of calculation by guesswork. We draw on the interplay between guessing and computation as it works in digital contexts that include living organisms. Digital computation and communication depend on a type of synchronization that coordinates transitions among physically distinct conditions that express "digits." This logical synchronization, known to engineers but neglected in physics, requires guesswork for its maintenance. By abstracting digital hardware, we model the structure of human thinking as logically synchronized computation, punctuated by guesses. We adapt marked graphs to mathematically represent computation, and we represent guesses by unpredictable changes in the marked graphs. The marked graphs reveal a logical structure of spatial and temporal navigation, with implications across physics and its applications to biology. By limiting our model to the logical aspect of communications and computations, we display structure in relation to guesswork, applicable not just in electronics but also to the functioning of living organisms.


title: Bell inequalities violation in relativity theory

abstract: A violation of Bell local realism inequalities in Clauser-Horn-Shimony-Holt (CHSH) form has been discovered in a relativistic GedanknExperiment. This means that there are no definite joint probabilities and this finds a classical explanation in the structure of Special relativity (SRT). The discovered nonlocality is weaker than Albert Einstein's quantum 'spooky action at a distance', and its presence suggests certain parallels between special relativity and quantum mechanics.


title: Intersectional Unfairness Discovery

abstract: AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research often falls short, primarily focusing on the subgroups characterized by a single sensitive attribute, while neglecting the nature of intersectional fairness of multiple sensitive attributes. This paper focuses on its one fundamental aspect by discovering diverse high-bias subgroups under intersectional sensitive attributes. Specifically, we propose a Bias-Guided Generative Network (BGGN). By treating each bias value as a reward, BGGN efficiently generates high-bias intersectional sensitive attributes. Experiments on real-world text and image datasets demonstrate a diverse and efficient discovery of BGGN. To further evaluate the generated unseen but possible unfair intersectional sensitive attributes, we formulate them as prompts and use modern generative AI to produce new texts and images. The results of frequently generating biased data provides new insights of discovering potential unfairness in popular modern generative AI systems. Warning: This paper contains generative examples that are offensive in nature.


title: GS-Phong: Meta-Learned 3D Gaussians for Relightable Novel View Synthesis

abstract: Decoupling the illumination in 3D scenes is crucial for novel view synthesis and relighting. In this paper, we propose a novel method for representing a scene illuminated by a point light using a set of relightable 3D Gaussian points. Inspired by the Blinn-Phong model, our approach decomposes the scene into ambient, diffuse, and specular components, enabling the synthesis of realistic lighting effects. To facilitate the decomposition of geometric information independent of lighting conditions, we introduce a novel bilevel optimization-based meta-learning framework. The fundamental idea is to view the rendering tasks under various lighting positions as a multi-task learning problem, which our meta-learning approach effectively addresses by generalizing the learned Gaussian geometries not only across different viewpoints but also across diverse light positions. Experimental results demonstrate the effectiveness of our approach in terms of training efficiency and rendering quality compared to existing methods for free-viewpoint relighting.


title: Operators in the Fock-Toeplitz algebra

abstract: We consider various classes of bounded operators on the Fock space $F^2$ of Gaussian square integrable entire functions over the complex plane. These include Toeplitz (type) operators, weighted composition operators, singular integral operators, Volterra-type operators and Hausdorff operators and range from classical objects in harmonic analysis to more recently introduced classes. As a leading problem and closely linked to well-known compactness characterizations we pursue the question of when these operators are contained in the Toeplitz algebra. This paper combines a (certainly in-complete) survey of the classical and more recent literature including new ideas for proofs from the perspective of quantum harmonic analysis (QHA). Moreover, we have added a number of new theorems and links between known results.


title: Properties of regular Tangles

abstract: A Tangle is a smooth simple closed curve formed from arcs (or ``links'') of circles with fixed radius. Most previous study of Tangles has dealt with the case where these arcs are quarter-circles, but Tangles comprised of thirds and sixths of circles are introduced. Together, these three families of Tangles are related to the three regular tilings of the plane by squares, regular hexagons, and equilateral triangles. This relationship is harnessed to prove results about the number of links comprising a Tangle and the area that it encloses.