title: Learn to Categorize or Categorize to Learn? Self-Coding for Generalized Category Discovery

abstract: In the quest for unveiling novel categories at test time, we confront the inherent limitations of traditional supervised recognition models that are restricted by a predefined category set. While strides have been made in the realms of self-supervised and open-world learning towards test-time category discovery, a crucial yet often overlooked question persists: what exactly delineates a category? In this paper, we conceptualize a category through the lens of optimization, viewing it as an optimal solution to a well-defined problem. Harnessing this unique conceptualization, we propose a novel, efficient and self-supervised method capable of discovering previously unknown categories at test time. A salient feature of our approach is the assignment of minimum length category codes to individual data instances, which encapsulates the implicit category hierarchy prevalent in real-world datasets. This mechanism affords us enhanced control over category granularity, thereby equipping our model to handle fine-grained categories adeptly. Experimental evaluations, bolstered by state-of-the-art benchmark comparisons, testify to the efficacy of our solution in managing unknown categories at test time. Furthermore, we fortify our proposition with a theoretical foundation, providing proof of its optimality. Our code is available at https://github.com/SarahRastegar/InfoSieve.


title: Conditional gradients for total variation regularization with PDE constraints: a graph cuts approach

abstract: Total variation regularization has proven to be a valuable tool in the context of optimal control of differential equations. This is particularly attributed to the observation that TV-penalties often favor piecewise constant minimizers with well-behaved jumpsets. On the downside, their intricate properties significantly complicate every aspect of their analysis, from the derivation of first-order optimality conditions to their discrete approximation and the choice of a suitable solution algorithm. In this paper, we investigate a general class of minimization problems with TV-regularization, comprising both continuous and discretized control spaces, from a convex geometry perspective. This leads to a variety of novel theoretical insights on minimization problems with total variation regularization as well as tools for their practical realization. First, by studying the extremal points of the respective total variation unit balls, we enable their efficient solution by geometry exploiting algorithms, e.g. fully-corrective generalized conditional gradient methods. We give a detailed account on the practical realization of such a method for piecewise constant finite element approximations of the control on triangulations of the spatial domain. Second, in the same setting and for suitable sequences of uniformly refined meshes, it is shown that minimizers to discretized PDE-constrained optimal control problems approximate solutions to a continuous limit problem involving an anisotropic total variation reflecting the fine-scale geometry of the mesh.


title: Human-AI collaboration is not very collaborative yet: A taxonomy of interaction patterns in AI-assisted decision making from a systematic review

abstract: Leveraging Artificial Intelligence (AI) in decision support systems has disproportionately focused on technological advancements, often overlooking the alignment between algorithmic outputs and human expectations. A human-centered perspective attempts to alleviate this concern by designing AI solutions for seamless integration with existing processes. Determining what information AI should provide to aid humans is vital, a concept underscored by explainable AI's efforts to justify AI predictions. However, how the information is presented, e.g., the sequence of recommendations and solicitation of interpretations, is equally crucial as complex interactions may emerge between humans and AI. While empirical studies have evaluated human-AI dynamics across domains, a common vocabulary for human-AI interaction protocols is lacking. To promote more deliberate consideration of interaction designs, we introduce a taxonomy of interaction patterns that delineate various modes of human-AI interactivity. We summarize the results of a systematic review of AI-assisted decision making literature and identify trends and opportunities in existing interactions across application domains from 105 articles. We find that current interactions are dominated by simplistic collaboration paradigms, leading to little support for truly interactive functionality. Our taxonomy offers a tool to understand interactivity with AI in decision-making and foster interaction designs for achieving clear communication, trustworthiness, and collaboration.


title: A proof of the Ryser-Brualdi-Stein conjecture for large even $n$

abstract: A Latin square of order $n$ is an $n$ by $n$ grid filled using $n$ symbols so that each symbol appears exactly once in each row and column. A transversal in a Latin square is a collection of cells which share no symbol, row or column. The Ryser-Brualdi-Stein conjecture, with origins from 1967, states that every Latin square of order $n$ contains a transversal with $n-1$ cells, and a transversal with $n$ cells if $n$ is odd. Keevash, Pokrovskiy, Sudakov and Yepremyan recently improved the long-standing best known bounds towards this conjecture by showing that every Latin square of order $n$ has a transversal with $n-O(\log n/\log\log n)$ cells. Here, we show, for sufficiently large $n$, that every Latin square of order $n$ has a transversal with $n-1$ cells. We also apply our methods to show that, for sufficiently large $n$, every Steiner triple system of order $n$ has a matching containing at least $(n-4)/3$ edges. This improves a recent result of Keevash, Pokrovskiy, Sudakov and Yepremyan, who found such matchings with $n/3-O(\log n/\log\log n)$ edges, and proves a conjecture of Brouwer from 1981 for large $n$.


title: From Instability to Singularity Formation in Incompressible Fluids

abstract: We establish finite-time singularity formation for $C^{1,\alpha}$ solutions to the Boussinesq system that are compactly supported on $\mathbb{R}^2$ and infinitely smooth except in the radial direction at the origin. The solutions are smooth in the angular variable at the blow-up point, which was a fundamental obstruction in previous works. This is done by exploiting a second-order effect, related to the classical Rayleigh--B\'enard instability, that overcomes the regularizing effect of transport. A similar result is established for the 3d Euler system based on the Taylor--Couette instability.


title: Invertibility of a linearized Boussinesq flow: a symbolic approach

abstract: We develop a computer-assisted symbolic method to show that a linearized Boussinesq flow in self-similar coordinates gives rise to an invertible operator.


title: Charge-transfer Contact to a High-Mobility Monolayer Semiconductor

abstract: Two-dimensional (2D) semiconductors, such as the transition metal dichalcogenides, have demonstrated tremendous promise for the development of highly tunable quantum devices. Realizing this potential requires low-resistance electrical contacts that perform well at low temperatures and low densities where quantum properties are relevant. Here we present a new device architecture for 2D semiconductors that utilizes a charge-transfer layer to achieve large hole doping in the contact region, and implement this technique to measure magneto-transport properties of high-purity monolayer WSe$_2$. We measure a record-high hole mobility of 80,000 cm$^2$/Vs and access channel carrier densities as low as $1.6\times10^{11}$ cm$^{-2}$, an order of magnitude lower than previously achievable. Our ability to realize transparent contact to high-mobility devices at low density enables transport measurement of correlation-driven quantum phases including observation of a low temperature metal-insulator transition in a density and temperature regime where Wigner crystal formation is expected, and observation of the fractional quantum Hall effect under large magnetic fields. The charge transfer contact scheme paves the way for discovery and manipulation of new quantum phenomena in 2D semiconductors and their heterostructures.


title: Approximate t-designs in generic circuit architectures

abstract: Unitary t-designs are distributions on the unitary group whose first t moments appear maximally random. Previous work has established several upper bounds on the depths at which certain specific random quantum circuit ensembles approximate t-designs. Here we show that these bounds can be extended to any fixed architecture of Haar-random two-site gates. This is accomplished by relating the spectral gaps of such architectures to those of 1D brickwork architectures. Our bound depends on the details of the architecture only via the typical number of layers needed for a block of the circuit to form a connected graph over the sites. When this quantity is independent of width, the circuit forms an approximate t-design in linear depth. We also give an implicit bound for nondeterministic architectures in terms of properties of the corresponding distribution over fixed architectures.


title: CustomNet: Zero-shot Object Customization with Variable-Viewpoints in Text-to-Image Diffusion Models

abstract: Incorporating a customized object into image generation presents an attractive feature in text-to-image generation. However, existing optimization-based and encoder-based methods are hindered by drawbacks such as time-consuming optimization, insufficient identity preservation, and a prevalent copy-pasting effect. To overcome these limitations, we introduce CustomNet, a novel object customization approach that explicitly incorporates 3D novel view synthesis capabilities into the object customization process. This integration facilitates the adjustment of spatial position relationships and viewpoints, yielding diverse outputs while effectively preserving object identity. Moreover, we introduce delicate designs to enable location control and flexible background control through textual descriptions or specific user-defined images, overcoming the limitations of existing 3D novel view synthesis methods. We further leverage a dataset construction pipeline that can better handle real-world objects and complex backgrounds. Equipped with these designs, our method facilitates zero-shot object customization without test-time optimization, offering simultaneous control over the viewpoints, location, and background. As a result, our CustomNet ensures enhanced identity preservation and generates diverse, harmonious outputs.


title: What's "up" with vision-language models? Investigating their struggle with spatial reasoning

abstract: Recent vision-language (VL) models are powerful, but can they reliably distinguish "right" from "left"? We curate three new corpora to quantify model comprehension of such basic spatial relations. These tests isolate spatial reasoning more precisely than existing datasets like VQAv2, e.g., our What'sUp benchmark contains sets of photographs varying only the spatial relations of objects, keeping their identity fixed (see Figure 1: models must comprehend not only the usual case of a dog under a table, but also, the same dog on top of the same table). We evaluate 18 VL models, finding that all perform poorly, e.g., BLIP finetuned on VQAv2, which nears human parity on VQAv2, achieves 56% accuracy on our benchmarks vs. humans at 99%. We conclude by studying causes of this surprising behavior, finding: 1) that popular vision-language pretraining corpora like LAION-2B contain little reliable data for learning spatial relationships; and 2) that basic modeling interventions like up-weighting preposition-containing instances or fine-tuning on our corpora are not sufficient to address the challenges our benchmarks pose. We are hopeful that these corpora will facilitate further research, and we release our data and code at https://github.com/amitakamath/whatsup_vlms.


title: From External to Swap Regret 2.0: An Efficient Reduction and Oblivious Adversary for Large Action Spaces

abstract: We provide a novel reduction from swap-regret minimization to external-regret minimization, which improves upon the classical reductions of Blum-Mansour [BM07] and Stolz-Lugosi [SL05] in that it does not require finiteness of the space of actions. We show that, whenever there exists a no-external-regret algorithm for some hypothesis class, there must also exist a no-swap-regret algorithm for that same class. For the problem of learning with expert advice, our result implies that it is possible to guarantee that the swap regret is bounded by {\epsilon} after $\log(N)^{O(1/\epsilon)}$ rounds and with $O(N)$ per iteration complexity, where $N$ is the number of experts, while the classical reductions of Blum-Mansour and Stolz-Lugosi require $O(N/\epsilon^2)$ rounds and at least $\Omega(N^2)$ per iteration complexity. Our result comes with an associated lower bound, which -- in contrast to that in [BM07] -- holds for oblivious and $\ell_1$-constrained adversaries and learners that can employ distributions over experts, showing that the number of rounds must be $\tilde\Omega(N/\epsilon^2)$ or exponential in $1/\epsilon$. Our reduction implies that, if no-regret learning is possible in some game, then this game must have approximate correlated equilibria, of arbitrarily good approximation. This strengthens the folklore implication of no-regret learning that approximate coarse correlated equilibria exist. Importantly, it provides a sufficient condition for the existence of correlated equilibrium which vastly extends the requirement that the action set is finite, thus answering a question left open by [DG22; Ass+23]. Moreover, it answers several outstanding questions about equilibrium computation and learning in games.


title: $e^{\text{RPCA}}$: Robust Principal Component Analysis for Exponential Family Distributions

abstract: Robust Principal Component Analysis (RPCA) is a widely used method for recovering low-rank structure from data matrices corrupted by significant and sparse outliers. These corruptions may arise from occlusions, malicious tampering, or other causes for anomalies, and the joint identification of such corruptions with low-rank background is critical for process monitoring and diagnosis. However, existing RPCA methods and their extensions largely do not account for the underlying probabilistic distribution for the data matrices, which in many applications are known and can be highly non-Gaussian. We thus propose a new method called Robust Principal Component Analysis for Exponential Family distributions ($e^{\text{RPCA}}$), which can perform the desired decomposition into low-rank and sparse matrices when such a distribution falls within the exponential family. We present a novel alternating direction method of multiplier optimization algorithm for efficient $e^{\text{RPCA}}$ decomposition. The effectiveness of $e^{\text{RPCA}}$ is then demonstrated in two applications: the first for steel sheet defect detection, and the second for crime activity monitoring in the Atlanta metropolitan area.


title: Worst-Case Optimal Multi-Armed Gaussian Best Arm Identification with a Fixed Budget

abstract: This study investigates the experimental design problem for identifying the arm with the highest expected outcome, referred to as best arm identification (BAI). In our experiments, the number of treatment-allocation rounds is fixed. During each round, a decision-maker allocates an arm and observes a corresponding outcome, which follows a Gaussian distribution with variances that can differ among the arms. At the end of the experiment, the decision-maker recommends one of the arms as an estimate of the best arm. To design an experiment, we first discuss lower bounds for the probability of misidentification. Our analysis highlights that the available information on the outcome distribution, such as means (expected outcomes), variances, and the choice of the best arm, significantly influences the lower bounds. Because available information is limited in actual experiments, we develop a lower bound that is valid under the unknown means and the unknown choice of the best arm, which are referred to as the worst-case lower bound. We demonstrate that the worst-case lower bound depends solely on the variances of the outcomes. Then, under the assumption that the variances are known, we propose the Generalized-Neyman-Allocation (GNA)-empirical-best-arm (EBA) strategy, an extension of the Neyman allocation proposed by Neyman (1934). We show that the GNA-EBA strategy is asymptotically optimal in the sense that its probability of misidentification aligns with the lower bounds as the sample size increases infinitely and the differences between the expected outcomes of the best and other suboptimal arms converge to the same values across arms. We refer to such strategies as asymptotically worst-case optimal.

categories: math.ST cs.LG econ.EM stat.ME stat.ML stat.TH


title: DiffEnc: Variational Diffusion with a Learned Encoder

abstract: Diffusion models may be viewed as hierarchical variational autoencoders (VAEs) with two improvements: parameter sharing for the conditional distributions in the generative process and efficient computation of the loss as independent terms over the hierarchy. We consider two changes to the diffusion model that retain these advantages while adding flexibility to the model. Firstly, we introduce a data- and depth-dependent mean function in the diffusion process, which leads to a modified diffusion loss. Our proposed framework, DiffEnc, achieves a statistically significant improvement in likelihood on CIFAR-10. Secondly, we let the ratio of the noise variance of the reverse encoder process and the generative process be a free weight parameter rather than being fixed to 1. This leads to theoretical insights: For a finite depth hierarchy, the evidence lower bound (ELBO) can be used as an objective for a weighted diffusion loss approach and for optimizing the noise schedule specifically for inference. For the infinite-depth hierarchy, on the other hand, the weight parameter has to be 1 to have a well-defined ELBO.


title: Detection and Preliminary Characterisation of Polluted White Dwarfs from Gaia EDR3 and LAMOST

abstract: We present a catalogue of 62 polluted white dwarfs observed by the 9th Low-Resolution Data Release of the Large Sky Area Multi-Object Fiber Spectroscopic Telescope (LAMOST LRS DR9v1; R$\approx$1,800) and the Early Data Release 3 (EDR3) of the Gaia Mission. Among these stellar remnants, 30 are new discoveries with previously unknown traces of calcium pollution. To generate our catalogue, we used a database of 4,324 unique Gaia EDR3 white dwarf candidates with LAMOST LRS DR9v1 observations, many of which have been spectroscopically confirmed by other telescopes. For these stars, we developed a quantitative method to detect calcium absorption in their spectra between 3,900-4,000$\mathring {\mathrm A}$, which we then validated through visual inspection and multiple literature cross-checks. Our catalogue provides the astrometric and photometric properties of the white dwarf candidates, incorporates supplementary data (e.g. Montreal White Dwarf Database, MWDD; PanSTARRS; the Hubble Space Telescope), and indicates the possibility of calcium pollution in their atmospheres. For our final sample of polluted white dwarfs, we also determine the main atmospheric properties of 23 sources with effective temperatures $T_{\rm eff}$$\leq$25,000K and no existing calcium abundances in the MWDD. Our analysis represents a first step towards measuring the full atmospheric composition of these stars and learning about the bulk properties of their accreted material. As we venture into the era of wide-field spectroscopic surveys, our work highlights the importance of combining large-scale databases for identifying and characterising new polluted white dwarfs.


title: LILO: Learning Interpretable Libraries by Compressing and Documenting Code

abstract: While large language models (LLMs) now excel at code generation, a key aspect of software development is the art of refactoring: consolidating code into libraries of reusable and readable programs. In this paper, we introduce LILO, a neurosymbolic framework that iteratively synthesizes, compresses, and documents code to build libraries tailored to particular problem domains. LILO combines LLM-guided program synthesis with recent algorithmic advances in automated refactoring from Stitch: a symbolic compression system that efficiently identifies optimal lambda abstractions across large code corpora. To make these abstractions interpretable, we introduce an auto-documentation (AutoDoc) procedure that infers natural language names and docstrings based on contextual examples of usage. In addition to improving human readability, we find that AutoDoc boosts performance by helping LILO's synthesizer to interpret and deploy learned abstractions. We evaluate LILO on three inductive program synthesis benchmarks for string editing, scene reasoning, and graphics composition. Compared to existing neural and symbolic methods - including the state-of-the-art library learning algorithm DreamCoder - LILO solves more complex tasks and learns richer libraries that are grounded in linguistic knowledge.


title: The Eval4NLP 2023 Shared Task on Prompting Large Language Models as Explainable Metrics

abstract: With an increasing number of parameters and pre-training data, generative large language models (LLMs) have shown remarkable capabilities to solve tasks with minimal or no task-related examples. Notably, LLMs have been successfully employed as evaluation metrics in text generation tasks. Within this context, we introduce the Eval4NLP 2023 shared task that asks participants to explore prompting and score extraction for machine translation (MT) and summarization evaluation. Specifically, we propose a novel competition setting in which we select a list of allowed LLMs and disallow fine-tuning to ensure a focus on prompting. We present an overview of participants' approaches and evaluate them on a new reference-free test set spanning three language pairs for MT and a summarization dataset. Notably, despite the task's restrictions, the best-performing systems achieve results on par with or even surpassing recent reference-free metrics developed using larger models, including GEMBA and Comet-Kiwi-XXL. Finally, as a separate track, we perform a small-scale human evaluation of the plausibility of explanations given by the LLMs.


title: On Learning Gaussian Multi-index Models with Gradient Flow

abstract: We study gradient flow on the multi-index regression problem for high-dimensional Gaussian data. Multi-index functions consist of a composition of an unknown low-rank linear projection and an arbitrary unknown, low-dimensional link function. As such, they constitute a natural template for feature learning in neural networks. We consider a two-timescale algorithm, whereby the low-dimensional link function is learnt with a non-parametric model infinitely faster than the subspace parametrizing the low-rank projection. By appropriately exploiting the matrix semigroup structure arising over the subspace correlation matrices, we establish global convergence of the resulting Grassmannian population gradient flow dynamics, and provide a quantitative description of its associated `saddle-to-saddle' dynamics. Notably, the timescales associated with each saddle can be explicitly characterized in terms of an appropriate Hermite decomposition of the target link function. In contrast with these positive results, we also show that the related \emph{planted} problem, where the link function is known and fixed, in fact has a rough optimization landscape, in which gradient flow dynamics might get trapped with high probability.


title: Robust Causal Bandits for Linear Models

abstract: Sequential design of experiments for optimizing a reward function in causal systems can be effectively modeled by the sequential design of interventions in causal bandits (CBs). In the existing literature on CBs, a critical assumption is that the causal models remain constant over time. However, this assumption does not necessarily hold in complex systems, which constantly undergo temporal model fluctuations. This paper addresses the robustness of CBs to such model fluctuations. The focus is on causal systems with linear structural equation models (SEMs). The SEMs and the time-varying pre- and post-interventional statistical models are all unknown. Cumulative regret is adopted as the design criteria, based on which the objective is to design a sequence of interventions that incur the smallest cumulative regret with respect to an oracle aware of the entire causal model and its fluctuations. First, it is established that the existing approaches fail to maintain regret sub-linearity with even a few instances of model deviation. Specifically, when the number of instances with model deviation is as few as $T^\frac{1}{2L}$, where $T$ is the time horizon and $L$ is the longest causal path in the graph, the existing algorithms will have linear regret in $T$. Next, a robust CB algorithm is designed, and its regret is analyzed, where upper and information-theoretic lower bounds on the regret are established. Specifically, in a graph with $N$ nodes and maximum degree $d$, under a general measure of model deviation $C$, the cumulative regret is upper bounded by $\tilde{\mathcal{O}}(d^{L-\frac{1}{2}}(\sqrt{NT} + NC))$ and lower bounded by $\Omega(d^{\frac{L}{2}-2}\max\{\sqrt{T},d^2C\})$. Comparing these bounds establishes that the proposed algorithm achieves nearly optimal $\tilde{\mathcal{O}}(\sqrt{T})$ regret when $C$ is $o(\sqrt{T})$ and maintains sub-linear regret for a broader range of $C$.


title: SimMMDG: A Simple and Effective Framework for Multi-modal Domain Generalization

abstract: In real-world scenarios, achieving domain generalization (DG) presents significant challenges as models are required to generalize to unknown target distributions. Generalizing to unseen multi-modal distributions poses even greater difficulties due to the distinct properties exhibited by different modalities. To overcome the challenges of achieving domain generalization in multi-modal scenarios, we propose SimMMDG, a simple yet effective multi-modal DG framework. We argue that mapping features from different modalities into the same embedding space impedes model generalization. To address this, we propose splitting the features within each modality into modality-specific and modality-shared components. We employ supervised contrastive learning on the modality-shared features to ensure they possess joint properties and impose distance constraints on modality-specific features to promote diversity. In addition, we introduce a cross-modal translation module to regularize the learned features, which can also be used for missing-modality generalization. We demonstrate that our framework is theoretically well-supported and achieves strong performance in multi-modal DG on the EPIC-Kitchens dataset and the novel Human-Animal-Cartoon (HAC) dataset introduced in this paper. Our source code and HAC dataset are available at https://github.com/donghao51/SimMMDG.


title: Re-evaluating Retrosynthesis Algorithms with Syntheseus

abstract: The planning of how to synthesize molecules, also known as retrosynthesis, has been a growing focus of the machine learning and chemistry communities in recent years. Despite the appearance of steady progress, we argue that imperfect benchmarks and inconsistent comparisons mask systematic shortcomings of existing techniques. To remedy this, we present a benchmarking library called syntheseus which promotes best practice by default, enabling consistent meaningful evaluation of single-step and multi-step retrosynthesis algorithms. We use syntheseus to re-evaluate a number of previous retrosynthesis algorithms, and find that the ranking of state-of-the-art models changes when evaluated carefully. We end with guidance for future works in this area.


title: DEFT: Dexterous Fine-Tuning for Real-World Hand Policies

abstract: Dexterity is often seen as a cornerstone of complex manipulation. Humans are able to perform a host of skills with their hands, from making food to operating tools. In this paper, we investigate these challenges, especially in the case of soft, deformable objects as well as complex, relatively long-horizon tasks. However, learning such behaviors from scratch can be data inefficient. To circumvent this, we propose a novel approach, DEFT (DExterous Fine-Tuning for Hand Policies), that leverages human-driven priors, which are executed directly in the real world. In order to improve upon these priors, DEFT involves an efficient online optimization procedure. With the integration of human-based learning and online fine-tuning, coupled with a soft robotic hand, DEFT demonstrates success across various tasks, establishing a robust, data-efficient pathway toward general dexterous manipulation. Please see our website at https://dexterous-finetuning.github.io for video results.


title: Gradient-Based Dovetail Joint Shape Optimization for Stiffness

abstract: It is common to manufacture an object by decomposing it into parts that can be assembled. This decomposition is often required by size limits of the machine, the complex structure of the shape, etc. To make it possible to easily assemble the final object, it is often desirable to design geometry that enables robust connections between the subcomponents. In this project, we study the task of dovetail-joint shape optimization for stiffness using gradient-based optimization. This optimization requires a differentiable simulator that is capable of modeling the contact between the two parts of a joint, making it possible to reason about the gradient of the stiffness with respect to shape parameters. Our simulation approach uses a penalty method that alternates between optimizing each side of the joint, using the adjoint method to compute gradients. We test our method by optimizing the joint shapes in three different joint shape spaces, and evaluate optimized joint shapes in both simulation and real-world tests. The experiments show that optimized joint shapes achieve higher stiffness, both synthetically and in real-world tests.


title: Direct Numerical Simulation for Parametric Vertical Vibration and Atomization of Sessile Drops

abstract: Sessile drop vertical vibrations and atomization is commonly analyzed by simpler unconstrained instabilities like Faraday waves and hence, detailed studies of the phenomenon are still an open question to the fluid dynamics community. We address two critical gaps using direct numerical simulation, i.e., (i) the cause of subharmonic response of azimuthal waves, and (ii) the dependence of vertical vibrations to the universal pinchoff regime in the atomization. First, a high mode excitation of a large drop of 100 microliters is implemented. It is found that the subharmonic response is not via Faraday waves, rather it is the harmonics of the interfacial waves that induce azimuthal waves near the contact line. An analogous self-inducing dynamical system is formalized between the tip and near the contact line to elucidate the mechanism. Second, a low mode excitation of small drop of 30 microliter is used to critically explain the cause of primary pinch-off via crater formation and secondary pinch-off via ligament retraction. The pinch-off test in both cases revealed that the primary pinch-off is in visco-capillary scaling regime, while the secondary pinch-off is affected by the inertial forces via oscillatory body forces of vibration.


title: Stochastic modeling and large-eddy simulation of heated concentric coaxial pipe flow

abstract: Turbulent concentric coaxial pipe flows are numerically investigated as canonical problem addressing spanwise curvature effects on heat and momentum transfer that are encountered in various engineering applications. It is demonstrated that the wall-adapting local eddy-viscosity (WALE) model within a large-eddy simulation (LES) framework, without model parameter recalibration, has limited predictive capabilities as signalized by poor representation of wall curvature effects and notable grid dependence. The identified lack in the modeling of radial transport processes is therefore addressed here by utilizing a stochastic one-dimensional turbulence (ODT) model. A standalone ODT formulation for cylindrical geometry is used in order to asses to which extent the predictability can be expected to improve by utilizing an advanced wall-modeling modeling strategy. It is shown that ODT is capable of capturing spanwise curvature and finite Reynolds number effects for fixed adjustable ODT model parameters. Based on the analogy of heat and mass transfer, present results yield new opportunities for modeling turbulent transfer process in chemical, process, and thermal engineering.


title: SyMPox: An Automated Monkeypox Detection System Based on Symptoms Using XGBoost

abstract: Monkeypox is a zoonotic disease. About 87000 cases of monkeypox were confirmed by the World Health Organization until 10th June 2023. The most prevalent methods for identifying this disease are image-based recognition techniques. Still, they are not too fast and could only be available to a few individuals. This study presents an independent application named SyMPox, developed to diagnose Monkeypox cases based on symptoms. SyMPox utilizes the robust XGBoost algorithm to analyze symptom patterns and provide accurate assessments. Developed using the Gradio framework, SyMPox offers a user-friendly platform for individuals to assess their symptoms and obtain reliable Monkeypox diagnoses.


title: Stochastic Thermodynamics of Learning Parametric Probabilistic Models

abstract: We have formulated a family of machine learning problems as the time evolution of Parametric Probabilistic Models (PPMs), inherently rendering a thermodynamic process. Our primary motivation is to leverage the rich toolbox of thermodynamics of information to assess the information-theoretic content of learning a probabilistic model. We first introduce two information-theoretic metrics: Memorized-information (M-info) and Learned-information (L-info), which trace the flow of information during the learning process of PPMs. Then, we demonstrate that the accumulation of L-info during the learning process is associated with entropy production, and parameters serve as a heat reservoir in this process, capturing learned information in the form of M-info.


title: ShanshuiDaDA: An Interactive, Generative System towards Chinese Shanshui Painting

abstract: Shanshui, which means mountain and water, is an East Asian traditional brush painting involving natural landscapes. This paper proposes an interactive and generative system based on a Generative Adversarial Network(GAN), which helps users draw Shanshui easily. We name this system and installation ShanshuiDaDA. ShanshuiDaDA is trained with CycleGAN and wrapped with a web-based interface. When participants scribble lines and sketch the landscape, the ShanshuiDaDA will assist them in generating and creating a Chinese "Shanshui" painting in real time.


title: A Kernel Perspective on Behavioural Metrics for Markov Decision Processes

abstract: Behavioural metrics have been shown to be an effective mechanism for constructing representations in reinforcement learning. We present a novel perspective on behavioural metrics for Markov decision processes via the use of positive definite kernels. We leverage this new perspective to define a new metric that is provably equivalent to the recently introduced MICo distance (Castro et al., 2021). The kernel perspective further enables us to provide new theoretical results, which has so far eluded prior work. These include bounding value function differences by means of our metric, and the demonstration that our metric can be provably embedded into a finite-dimensional Euclidean space with low distortion error. These are two crucial properties when using behavioural metrics for reinforcement learning representations. We complement our theory with strong empirical results that demonstrate the effectiveness of these methods in practice.


title: Improving Offline-to-Online Reinforcement Learning with Q Conditioned State Entropy Exploration

abstract: Studying how to fine-tune offline reinforcement learning (RL) pre-trained policy is profoundly significant for enhancing the sample efficiency of RL algorithms. However, directly fine-tuning pre-trained policies often results in sub-optimal performance. This is primarily due to the distribution shift between offline pre-training and online fine-tuning stages. Specifically, the distribution shift limits the acquisition of effective online samples, ultimately impacting the online fine-tuning performance. In order to narrow down the distribution shift between offline and online stages, we proposed Q conditioned state entropy (QCSE) as intrinsic reward. Specifically, QCSE maximizes the state entropy of all samples individually, considering their respective Q values. This approach encourages exploration of low-frequency samples while penalizing high-frequency ones, and implicitly achieves State Marginal Matching (SMM), thereby ensuring optimal performance, solving the asymptotic sub-optimality of constraint-based approaches. Additionally, QCSE can seamlessly integrate into various RL algorithms, enhancing online fine-tuning performance. To validate our claim, we conduct extensive experiments, and observe significant improvements with QCSE (about 13% for CQL and 8% for Cal-QL). Furthermore, we extended experimental tests to other algorithms, affirming the generality of QCSE.


title: Automated Verification of Equivalence Properties in Advanced Logic Programs -- Bachelor Thesis

abstract: With the increase in industrial applications using Answer Set Programming, the need for formal verification tools, particularly for critical applications, has also increased. During the program optimisation process, it would be desirable to have a tool which can automatically verify whether an optimised subprogram can replace the original subprogram. Formally this corresponds to the problem of verifying the strong equivalence of two programs. In order to do so, the translation tool anthem was developed. It can be used in conjunction with an automated theorem prover for classical logic to verify that two programs are strongly equivalent. With the current version of anthem, only the strong equivalence of positive programs with a restricted input language can be verified. This is a result of the translation $\tau^*$ implemented in anthem that produces formulas in the logic of here-and-there, which coincides with classical logic only for positive programs. This thesis extends anthem in order to overcome these limitations. First, the transformation $\sigma^*$ is presented, which transforms formulas from the logic of here-and-there to classical logic. A theorem formalises how $\sigma^*$ can be used to express equivalence in the logic of here-and-there in classical logic. Second, the translation $\tau^*$ is extended to programs containing pools. Another theorem shows how $\sigma^*$ can be combined with $\tau^*$ to express the strong equivalence of two programs in classical logic. With $\sigma^*$ and the extended $\tau^*$, it is possible to express the strong equivalence of logic programs containing negation, simple choices, and pools. Both the extended $\tau^*$ and $\sigma^*$ are implemented in a new version of anthem. Several examples of logic programs containing pools, negation, and simple choice rules, which the new version of anthem can translate to classical logic, are presented. Some a...


title: Improved Communication Efficiency in Federated Natural Policy Gradient via ADMM-based Gradient Updates

abstract: Federated reinforcement learning (FedRL) enables agents to collaboratively train a global policy without sharing their individual data. However, high communication overhead remains a critical bottleneck, particularly for natural policy gradient (NPG) methods, which are second-order. To address this issue, we propose the FedNPG-ADMM framework, which leverages the alternating direction method of multipliers (ADMM) to approximate global NPG directions efficiently. We theoretically demonstrate that using ADMM-based gradient updates reduces communication complexity from ${O}({d^{2}})$ to ${O}({d})$ at each iteration, where $d$ is the number of model parameters. Furthermore, we show that achieving an $\epsilon$-error stationary convergence requires ${O}(\frac{1}{(1-\gamma)^{2}{\epsilon}})$ iterations for discount factor $\gamma$, demonstrating that FedNPG-ADMM maintains the same convergence rate as the standard FedNPG. Through evaluation of the proposed algorithms in MuJoCo environments, we demonstrate that FedNPG-ADMM maintains the reward performance of standard FedNPG, and that its convergence rate improves when the number of federated agents increases.


title: Investigation of countercurrent flow profile and liquid holdup in random packed column with local CFD data

abstract: Liquid holdup and mass transfer area are critical parameters for packed column design and CO2 capture efficiency prediction. In this paper, a framework was established for modeling the liquid-gas countercurrent flow hydrodynamics in a random packed column with pall rings. Besides the column-averaged information, the radial pall ring distribution, velocity, and liquid holdup profiles are obtained to study the entrance effect and the wall influence in the packed column. With local CFD data, the validated packing specific area ap and liquid velocity uL range for liquid holdup correlation is significantly expanded with respect to existing experimental or column-averaged CFD data. The proposed liquid holdup correlation $h_L \propto u_L^{0.44}$ indicates the random packed column falls in a viscous to turbulent transition regime and it covers a Reynolds Number range of [6.7-40.2]. The derived liquid holdup correlation is in good agreement with existing correlations developed using the column-averaged experimental data.


title: MgNO: Efficient Parameterization of Linear Operators via Multigrid

abstract: In this work, we propose a concise neural operator architecture for operator learning. Drawing an analogy with a conventional fully connected neural network, we define the neural operator as follows: the output of the $i$-th neuron in a nonlinear operator layer is defined by $O_i(u) = \sigma\left( \sum_j W_{ij} u + B_{ij}\right)$. Here, $ W_{ij}$ denotes the bounded linear operator connecting $j$-th input neuron to $i$-th output neuron, and the bias $ B_{ij}$ takes the form of a function rather than a scalar. Given its new universal approximation property, the efficient parameterization of the bounded linear operators between two neurons (Banach spaces) plays a critical role. As a result, we introduce MgNO, utilizing multigrid structures to parameterize these linear operators between neurons. This approach offers both mathematical rigor and practical expressivity. Additionally, MgNO obviates the need for conventional lifting and projecting operators typically required in previous neural operators. Moreover, it seamlessly accommodates diverse boundary conditions. Our empirical observations reveal that MgNO exhibits superior ease of training compared to other CNN-based models, while also displaying a reduced susceptibility to overfitting when contrasted with spectral-type neural operators. We demonstrate the efficiency and accuracy of our method with consistently state-of-the-art performance on different types of partial differential equations (PDEs).


title: Advantages of Machine Learning in Bus Transport Analysis

abstract: Supervised Machine Learning is an innovative method that aims to mimic human learning by using past experiences. In this study, we utilize supervised machine learning algorithms to analyze the factors that contribute to the punctuality of Tehran BRT bus system. We gather publicly available datasets of 2020 to 2022 from Municipality of Tehran to train and test our models. By employing various algorithms and leveraging Python's Sci Kit Learn and Stats Models libraries, we construct accurate models capable of predicting whether a bus route will meet the prescribed standards for on-time performance on any given day. Furthermore, we delve deeper into the decision-making process of each algorithm to determine the most influential factor it considers. This investigation allows us to uncover the key feature that significantly impacts the effectiveness of bus routes, providing valuable insights for improving their performance.


title: A Historical Context for Data Streams

abstract: Machine learning from data streams is an active and growing research area. Research on learning from streaming data typically makes strict assumptions linked to computational resource constraints, including requirements for stream mining algorithms to inspect each instance not more than once and be ready to give a prediction at any time. Here we review the historical context of data streams research placing the common assumptions used in machine learning over data streams in their historical context.


title: Brain decoding: toward real-time reconstruction of visual perception

abstract: In the past five years, the use of generative and foundational AI systems has greatly improved the decoding of brain activity. Visual perception, in particular, can now be decoded from functional Magnetic Resonance Imaging (fMRI) with remarkable fidelity. This neuroimaging technique, however, suffers from a limited temporal resolution ($\approx$0.5 Hz) and thus fundamentally constrains its real-time usage. Here, we propose an alternative approach based on magnetoencephalography (MEG), a neuroimaging device capable of measuring brain activity with high temporal resolution ($\approx$5,000 Hz). For this, we develop an MEG decoding model trained with both contrastive and regression objectives and consisting of three modules: i) pretrained embeddings obtained from the image, ii) an MEG module trained end-to-end and iii) a pretrained image generator. Our results are threefold: Firstly, our MEG decoder shows a 7X improvement of image-retrieval over classic linear decoders. Second, late brain responses to images are best decoded with DINOv2, a recent foundational image model. Third, image retrievals and generations both suggest that high-level visual features can be decoded from MEG signals, although the same approach applied to 7T fMRI also recovers better low-level features. Overall, these results, while preliminary, provide an important step towards the decoding -- in real-time -- of the visual processes continuously unfolding within the human brain.


title: Enhancing Genetic Improvement Mutations Using Large Language Models

abstract: Large language models (LLMs) have been successfully applied to software engineering tasks, including program repair. However, their application in search-based techniques such as Genetic Improvement (GI) is still largely unexplored. In this paper, we evaluate the use of LLMs as mutation operators for GI to improve the search process. We expand the Gin Java GI toolkit to call OpenAI's API to generate edits for the JCodec tool. We randomly sample the space of edits using 5 different edit types. We find that the number of patches passing unit tests is up to 75% higher with LLM-based edits than with standard Insert edits. Further, we observe that the patches found with LLMs are generally less diverse compared to standard edits. We ran GI with local search to find runtime improvements. Although many improving patches are found by LLM-enhanced GI, the best improving patch was found by standard GI.


title: Learning Gradient Fields for Scalable and Generalizable Irregular Packing

abstract: The packing problem, also known as cutting or nesting, has diverse applications in logistics, manufacturing, layout design, and atlas generation. It involves arranging irregularly shaped pieces to minimize waste while avoiding overlap. Recent advances in machine learning, particularly reinforcement learning, have shown promise in addressing the packing problem. In this work, we delve deeper into a novel machine learning-based approach that formulates the packing problem as conditional generative modeling. To tackle the challenges of irregular packing, including object validity constraints and collision avoidance, our method employs the score-based diffusion model to learn a series of gradient fields. These gradient fields encode the correlations between constraint satisfaction and the spatial relationships of polygons, learned from teacher examples. During the testing phase, packing solutions are generated using a coarse-to-fine refinement mechanism guided by the learned gradient fields. To enhance packing feasibility and optimality, we introduce two key architectural designs: multi-scale feature extraction and coarse-to-fine relation extraction. We conduct experiments on two typical industrial packing domains, considering translations only. Empirically, our approach demonstrates spatial utilization rates comparable to, or even surpassing, those achieved by the teacher algorithm responsible for training data generation. Additionally, it exhibits some level of generalization to shape variations. We are hopeful that this method could pave the way for new possibilities in solving the packing problem.


title: Training binary neural networks without floating point precision

abstract: The main goal of this work is to improve the efficiency of training binary neural networks, which are low latency and low energy networks. The main contribution of this work is the proposal of two solutions comprised of topology changes and strategy training that allow the network to achieve near the state-of-the-art performance and efficient training. The time required for training and the memory required in the process are two factors that contribute to efficient training.


title: Benchmarking GPUs on SVBRDF Extractor Model

abstract: With the maturity of deep learning, its use is emerging in every field. Also, as different types of GPUs are becoming more available in the markets, it creates a difficult decision for users. How can users select GPUs to achieve optimal performance for a specific task? Analysis of GPU architecture is well studied, but existing works that benchmark GPUs do not study tasks for networks with significantly larger input. In this work, we tried to differentiate the performance of different GPUs on neural network models that operate on bigger input images (256x256).


title: Intelligibility prediction with a pretrained noise-robust automatic speech recognition model

abstract: This paper describes two intelligibility prediction systems derived from a pretrained noise-robust automatic speech recognition (ASR) model for the second Clarity Prediction Challenge (CPC2). One system is intrusive and leverages the hidden representations of the ASR model. The other system is non-intrusive and makes predictions with derived ASR uncertainty. The ASR model is only pretrained with a simulated noisy speech corpus and does not take advantage of the CPC2 data. For that reason, the intelligibility prediction systems are robust to unseen scenarios given the accurate prediction performance on the CPC2 evaluation.


title: piHyFlow Operational Semantics

abstract: Simulation models have been described using different perspectives, or worldviews. In the process interaction world view (PI), every entity is modeled by a sequence of actions describing its life cycle, offering a comprehensive model that groups the events involving each entity. In this paper we describe piHyFlow, a formalism for representing hybrid models using a set of communicating processes. This set is dynamic, enabling processes to be created and destroyed at runtime. Processes are encapsulated into piHyFlow base models and communicate through shared memory. piHyFlow, however, can guarantee modularity by enforcing that models can only communicate by input and output interfaces. piHyFlow extends current PI approaches by providing support for HyFlow concepts of sampling and dense (continuous) outputs, in addition to the more traditional event-based communication. In this paper we present piHyFlow operational semantics using the concepts of simulator and component.


title: Machine Learning and Knowledge: Why Robustness Matters

abstract: Trusting machine learning algorithms requires having confidence in their outputs. Confidence is typically interpreted in terms of model reliability, where a model is reliable if it produces a high proportion of correct outputs. However, model reliability does not address concerns about the robustness of machine learning models, such as models relying on the wrong features or variations in performance based on context. I argue that the epistemic dimension of trust can instead be understood through the concept of knowledge, where the trustworthiness of an algorithm depends on whether its users are in the position to know that its outputs are correct. Knowledge requires beliefs to be formed for the right reasons and to be robust to error, so machine learning algorithms can only provide knowledge if they work well across counterfactual scenarios and if they make decisions based on the right features. This, I argue, can explain why we should care about model properties like interpretability, causal shortcut independence, and distribution shift robustness even if such properties are not required for model reliability.


title: NetDistiller: Empowering Tiny Deep Learning via In-Situ Distillation

abstract: Boosting the task accuracy of tiny neural networks (TNNs) has become a fundamental challenge for enabling the deployments of TNNs on edge devices which are constrained by strict limitations in terms of memory, computation, bandwidth, and power supply. To this end, we propose a framework called NetDistiller to boost the achievable accuracy of TNNs by treating them as sub-networks of a weight-sharing teacher constructed by expanding the number of channels of the TNN. Specifically, the target TNN model is jointly trained with the weight-sharing teacher model via (1) gradient surgery to tackle the gradient conflicts between them and (2) uncertainty-aware distillation to mitigate the overfitting of the teacher model. Extensive experiments across diverse tasks validate NetDistiller's effectiveness in boosting TNNs' achievable accuracy over state-of-the-art methods. Our code is available at https://github.com/GATECH-EIC/NetDistiller.


title: A Risk-Averse Framework for Non-Stationary Stochastic Multi-Armed Bandits

abstract: In a typical stochastic multi-armed bandit problem, the objective is often to maximize the expected sum of rewards over some time horizon $T$. While the choice of a strategy that accomplishes that is optimal with no additional information, it is no longer the case when provided additional environment-specific knowledge. In particular, in areas of high volatility like healthcare or finance, a naive reward maximization approach often does not accurately capture the complexity of the learning problem and results in unreliable solutions. To tackle problems of this nature, we propose a framework of adaptive risk-aware strategies that operate in non-stationary environments. Our framework incorporates various risk measures prevalent in the literature to map multiple families of multi-armed bandit algorithms into a risk-sensitive setting. In addition, we equip the resulting algorithms with the Restarted Bayesian Online Change-Point Detection (R-BOCPD) algorithm and impose a (tunable) forced exploration strategy to detect local (per-arm) switches. We provide finite-time theoretical guarantees and an asymptotic regret bound of order $\tilde O(\sqrt{K_T T})$ up to time horizon $T$ with $K_T$ the total number of change-points. In practice, our framework compares favorably to the state-of-the-art in both synthetic and real-world environments and manages to perform efficiently with respect to both risk-sensitivity and non-stationarity.


title: FuXi-Extreme: Improving extreme rainfall and wind forecasts with diffusion model

abstract: Significant advancements in the development of machine learning (ML) models for weather forecasting have produced remarkable results. State-of-the-art ML-based weather forecast models, such as FuXi, have demonstrated superior statistical forecast performance in comparison to the high-resolution forecasts (HRES) of the European Centre for Medium-Range Weather Forecasts (ECMWF). However, ML models face a common challenge: as forecast lead times increase, they tend to generate increasingly smooth predictions, leading to an underestimation of the intensity of extreme weather events. To address this challenge, we developed the FuXi-Extreme model, which employs a denoising diffusion probabilistic model (DDPM) to restore finer-scale details in the surface forecast data generated by the FuXi model in 5-day forecasts. An evaluation of extreme total precipitation ($\textrm{TP}$), 10-meter wind speed ($\textrm{WS10}$), and 2-meter temperature ($\textrm{T2M}$) illustrates the superior performance of FuXi-Extreme over both FuXi and HRES. Moreover, when evaluating tropical cyclone (TC) forecasts based on International Best Track Archive for Climate Stewardship (IBTrACS) dataset, both FuXi and FuXi-Extreme shows superior performance in TC track forecasts compared to HRES, but they show inferior performance in TC intensity forecasts in comparison to HRES.


title: Korg: fitting, model atmosphere interpolation, and Brackett lines

abstract: We describe several updates to Korg, a package for 1D LTE spectral synthesis of FGKM stars. Built-in functions to fit observed spectra via synthesis or equivalent widths make it easy to take advantage of Korg's automatic differentiation. Comparison to a past analysis of 18 Sco shows that we obtain significantly reduced line-to-line abundance scatter with Korg. Fitting and synthesis are facilitated by a rigorously-tested model atmosphere interpolation method, which introduces negligible error to synthesized spectra for stars with $T_\mathrm{eff} \gtrsim 4000\,\mathrm{K}$. For cooler stars, atmosphere interpolation is complicated by the presence of molecules, though we demonstrate an adequate method for cool dwarfs. The chemical equilibrium solver has been extended to include polyatomic and charged molecules, extending Korg's regime of applicability to M stars. We also discuss a common oversight regarding the synthesis of hydrogen lines in the infrared, and show that Korg's Brackett line profiles are a much closer match to observations than others available. Documentation, installation instructions, and tutorials are available at https://github.com/ajwheeler/Korg.jl.


title: Note on power hypergraphs with equal domination and matching numbers

abstract: We present some examples that refute two recent results in the literature concerning the equality of the domination and matching numbers for power and generalized power hypergraphs. In this note we pinpoint the flaws in the proofs and suggest how they may be mended.


title: A Survey of the Security Challenges and Requirements for IoT Operating Systems

abstract: The Internet of Things (IoT) is becoming an integral part of our modern lives as we converge towards a world surrounded by ubiquitous connectivity. The inherent complexity presented by the vast IoT ecosystem ends up in an insufficient understanding of individual system components and their interactions, leading to numerous security challenges. In order to create a secure IoT platform from the ground up, there is a need for a unifying operating system (OS) that can act as a cornerstone regulating the development of stable and secure solutions. In this paper, we present a classification of the security challenges stemming from the manifold aspects of IoT development. We also specify security requirements to direct the secure development of an unifying IoT OS to resolve many of those ensuing challenges. Survey of several modern IoT OSs confirm that while the developers of the OSs have taken many alternative approaches to implement security, we are far from engineering an adequately secure and unified architecture. More broadly, the study presented in this paper can help address the growing need for a secure and unified platform to base IoT development on and assure the safe, secure, and reliable operation of IoT in critical domains.


title: Fabrication of optically smooth Sn thin films

abstract: The fabrication of optically smooth thin Sn films by vacuum or electrodeposition techniques is usually challenging. Little has been published on how to address this challenge mainly because very few applications require such smooth Sn surfaces. The excitation of surface plasmon polaritons on Sn surfaces by prism-based methods represents a case that requires very smooth surfaces and has motivated this work. It is shown that the deposition rate and the substrate temperature of a vacuum evaporation method can be optimized to obtain very smooth Sn films and this is supported by direct imaging evidence from atomic force microscopy and scanning electron microscopy.


title: Sn whisker growth mitigation by using NiO sublayers

abstract: The potential of NiO sublayers for whisker growth mitigation has been examined. A thin NiO film was applied on a Cu-coated substrate before the deposition of a thicker Sn layer. The growth of Sn whiskers was then followed by optical and scanning electron microscopy and was compared with the whisker growth on a control sample without the NiO sublayer. No whiskers were observed on the sample with the NiO layer even after 12 months, whereas the control sample developed whiskers of size and density that is generally expected, based on the vast amount of published work on the topic. The mechanisms of whisker growth and whisker growth suppression are briefly discussed as well.


title: Metal whisker growth induced by localized, high-intensity DC electric fields

abstract: In this work, a very high, locally applied electric field was used to induce whisker nucleation on an Sn film. The field was generated by using a conductive AFM tip and applying a voltage bias between the sample and the conductive cantilever>The tip-sample separation distance was thus controllable, and any dielectric breakdown could be avoided. At locations where the AFM tip was positioned for an extended period, minuscule whiskers were observed, whose growth direction matched vertical orientation of the field.


title: Closed Timelike Curves Induced by a Buchdahl-inspired Vacuum Spacetime in $R^2$ Gravity

abstract: The recently obtained $\textit{special}$ Buchdahl-inspired metric [Phys. Rev. D 107, 104008 (2023)] describes asymptotically flat spacetimes in pure Ricci-squared gravity. The metric depends on a new (Buchdahl) parameter $\tilde{k}$ of higher-derivative characteristic, and reduces to the Schwarzschild metric, for $\tilde{k}=0$. For the case $\tilde{k}\in(-1,0)$, it was shown that it describes a traversable Morris-Thorne-Buchdahl (MTB) wormhole [Eur. Phys. J. C 83, 626 (2023)], where the weak energy condition is formally violated. In this paper, we briefly review the $\textit{special}$ Buchdahl-inspired metric, with focuses on the construction of $\zeta-$Kruskal-Szekeres (KS) diagram and the situation for a wormhole to emerge. Interestingly, the MTB wormhole structure appears to permit the formation of closed timelike curves (CTCs). More specifically, a CTC straddles the throat, comprising of two segments positioned in opposite quadrants of the $\zeta-$KS diagram. The closed timelike loop thus passes through the wormhole throat twice, causing $\textit{two}$ reversals in the time direction experienced by the (timelike) traveller on the CTC. The key to constructing a CTC lies in identifying any given pair of antipodal points $(T,X)$ and $(-T,-X)$ $\textit{on the wormhole throat}$ in the $\zeta-$KS diagram as corresponding to the same spacetime event. It is interesting to note that the Campanelli-Lousto metric in Brans-Dicke gravity is known to support two-way traversable wormholes, and the formation of the CTCs presented herein is equally applicable to the Campanelli-Lousto solution.


title: GalliformeSpectra: A Hen Breed Dataset

abstract: This article presents a comprehensive dataset featuring ten distinct hen breeds, sourced from various regions, capturing the unique characteristics and traits of each breed. The dataset encompasses Bielefeld, Blackorpington, Brahma, Buckeye, Fayoumi, Leghorn, Newhampshire, Plymouthrock, Sussex, and Turken breeds, offering a diverse representation of poultry commonly bred worldwide. A total of 1010 original JPG images were meticulously collected, showcasing the physical attributes, feather patterns, and distinctive features of each hen breed. These images were subsequently standardized, resized, and converted to PNG format for consistency within the dataset. The compilation, although unevenly distributed across the breeds, provides a rich resource, serving as a foundation for research and applications in poultry science, genetics, and agricultural studies. This dataset holds significant potential to contribute to various fields by enabling the exploration and analysis of unique characteristics and genetic traits across different hen breeds, thereby supporting advancements in poultry breeding, farming, and genetic research.


title: Explaining by Imitating: Understanding Decisions by Interpretable Policy Learning

abstract: Understanding human behavior from observed data is critical for transparency and accountability in decision-making. Consider real-world settings such as healthcare, in which modeling a decision-maker's policy is challenging -- with no access to underlying states, no knowledge of environment dynamics, and no allowance for live experimentation. We desire learning a data-driven representation of decision-making behavior that (1) inheres transparency by design, (2) accommodates partial observability, and (3) operates completely offline. To satisfy these key criteria, we propose a novel model-based Bayesian method for interpretable policy learning ("Interpole") that jointly estimates an agent's (possibly biased) belief-update process together with their (possibly suboptimal) belief-action mapping. Through experiments on both simulated and real-world data for the problem of Alzheimer's disease diagnosis, we illustrate the potential of our approach as an investigative device for auditing, quantifying, and understanding human decision-making behavior.


title: Photomolecular Effect: Visible Light Interaction with Air-Water Interface

abstract: Although water is almost transparent to visible light, we demonstrate that the air-water interface interacts strongly with visible light via what we hypothesize as the photomolecular effect. In this effect, transverse-magnetic polarized photons cleave off water clusters from the air-water interface. We use over 10 different experiments to demonstrate the existence of this effect and its dependence on the wavelength, incident angle and polarization of visible light. We further demonstrate that visible light heats up thin fogs, suggesting that this process can impact weather, climate, and the earth's water cycle. Our study suggests that the photomolecular effect should happen widely in nature, from clouds to fogs, ocean to soil surfaces, and plant transpiration, and can also lead to new applications in energy and clear water.

categories: physics.optics cond-mat.soft physics.app-ph quant-ph


title: Polynomial Time Algorithm for Boolean Satisfiability Problem

abstract: This is the latest in a series of articles aimed at exploring the relationship between the complexity classes of P and NP. In the previous papers, we have proved that the sat CNF problem is polynomially reduced to the problem of finding a special covering for a set under the special decomposition of this set and vice versa. That is, these problems are polinomially equivalent. This means that the problem of finding a special covering for a set under a special decomposition of this set, is an NP-complete problem. We also described algorithmic procedures that determine whether there is a special covering for a set under a special decomposition of this set. In this article we prove that all these algorithmic procedures have polynomial time complexity with respect to the length of input data. In addition, we will describe an algorithm that, given any Boolean function in conjunctive normal form (CNF), determines in polynomial time whether this function is satisfiable. We will prove that the time complexity of this algorithm is bounded by the cube of the length of the input data. Also, if the function is not satisfiable, the algorithm deduces this result noting the reason for this result. We have implemented an algorithm in Python, and successfully tested it on Boolean functions represented in CNF with tens of thousands of variables and tens of thousands of clauses.


title: AMIR: Automated MisInformation Rebuttal -- A COVID-19 Vaccination Datasets based Recommendation System

abstract: Misinformation has emerged as a major societal threat in recent years in general; specifically in the context of the COVID-19 pandemic, it has wrecked havoc, for instance, by fuelling vaccine hesitancy. Cost-effective, scalable solutions for combating misinformation are the need of the hour. This work explored how existing information obtained from social media and augmented with more curated fact checked data repositories can be harnessed to facilitate automated rebuttal of misinformation at scale. While the ideas herein can be generalized and reapplied in the broader context of misinformation mitigation using a multitude of information sources and catering to the spectrum of social media platforms, this work serves as a proof of concept, and as such, it is confined in its scope to only rebuttal of tweets, and in the specific context of misinformation regarding COVID-19. It leverages two publicly available datasets, viz. FaCov (fact-checked articles) and misleading (social media Twitter) data on COVID-19 Vaccination.


title: CrossEAI: Using Explainable AI to generate better bounding boxes for Chest X-ray images

abstract: Explainability is critical for deep learning applications in healthcare which are mandated to provide interpretations to both patients and doctors according to legal regulations and responsibilities. Explainable AI methods, such as feature importance using integrated gradients, model approximation using LIME, or neuron activation and layer conductance to provide interpretations for certain health risk predictions. In medical imaging diagnosis, disease classification usually achieves high accuracy, but generated bounding boxes have much lower Intersection over Union (IoU). Different methods with self-supervised or semi-supervised learning strategies have been proposed, but few improvements have been identified for bounding box generation. Previous work shows that bounding boxes generated by these methods are usually larger than ground truth and contain major non-disease area. This paper utilizes the advantages of post-hoc AI explainable methods to generate bounding boxes for chest x-ray image diagnosis. In this work, we propose CrossEAI which combines heatmap and gradient map to generate more targeted bounding boxes. By using weighted average of Guided Backpropagation and Grad-CAM++, we are able to generate bounding boxes which are closer to the ground truth. We evaluate our model on a chest x-ray dataset. The performance has significant improvement over the state of the art model with the same setting, with $9\%$ improvement in average of all diseases over all IoU. Moreover, as a model that does not use any ground truth bounding box information for training, we achieve same performance in general as the model that uses $80\%$ of the ground truth bounding box information for training


title: Two-dimensional Parameter Relationships for W UMa-type Systems Revisited

abstract: Reviewing the empirical and theoretical parameter relationships between various parameters is a good way to understand more about contact binary systems. In this investigation, two-dimensional (2D) relationships for P-M_V(system), P-L_1,2, M_1,2-L_1,2, and q-L_ratio were revisited. The sample used is related to 118 contact binary systems with an orbital period shorter than 0.6 days whose absolute parameters were estimated based on the Gaia Data Release 3 (DR3) parallax. We reviewed previous studies on 2D relationships and updated six parameter relationships. Therefore, Markov chain Monte Carlo (MCMC) and Machine Learning (ML) methods were used, and the outcomes were compared. We selected 22 contact binary systems from eight previous studies for comparison, which had light curve solutions using spectroscopic data. The results show that the systems are in good agreement with the results of this study.


title: Private Variable-Length Coding with Zero Leakage

abstract: A private compression design problem is studied, where an encoder observes useful data $Y$, wishes to compress it using variable length code and communicates it through an unsecured channel. Since $Y$ is correlated with private attribute $X$, the encoder uses a private compression mechanism to design encoded message $\cal C$ and sends it over the channel. An adversary is assumed to have access to the output of the encoder, i.e., $\cal C$, and tries to estimate $X$. Furthermore, it is assumed that both encoder and decoder have access to a shared secret key $W$. The design goal is to encode message $\cal C$ with minimum possible average length that satisfies a perfect privacy constraint. To do so we first consider two different privacy mechanism design problems and find upper bounds on the entropy of the optimizers by solving a linear program. We use the obtained optimizers to design $\cal C$. In two cases we strengthen the existing bounds: 1. $|\mathcal{X}|\geq |\mathcal{Y}|$; 2. The realization of $(X,Y)$ follows a specific joint distribution. In particular, considering the second case we use two-part construction coding to achieve the upper bounds. Furthermore, in a numerical example we study the obtained bounds and show that they can improve the existing results.


title: Graviton to photon conversion in curved space-time and external magnetic field

abstract: The suppression of relic gravitational waves due to their conversion into electromagnetic radiation in a cosmological magnetic field is studied. The coupled system of equations describing gravitational and electromagnetic wave propagation in an arbitrary curved space-time and in external magnetic field is derived. The subsequent elimination of photons from the beam due to their interaction with the primary plasma is taken into account. The resulting system of equations is solved numerically in Friedman-LeMaitre-Robertson-Walker metric for the upper limit of the intergalactic magnetic field strength of 1 nGs. We conclude that the gravitational wave conversion into photons in the intergalactic magnetic field cannot significantly change the amplitude of the relic gravitational wave and their frequency spectrum.


title: A unit of information in black hole evaporation

abstract: Black holes evolve by evaporation of their event horizon. While this process is believed to be unitary, there is no consensus on the recovery of information in black hole entropy. A missing link is a unit of information in black hole evaporation. Distinct from Hawking radiation, we identify evaporation in entangled pairs by $\mathbb{P}^2$ topology of the event horizon consistent with the Bekenstein-Hawking entropy in a uniformly spaced horizon area, where $k_B$ denotes the Boltzmann constant. It derives by continuation of $\mathbb{P}^2$ in Rindler spacetime prior to gravitational collapse, subject to a tight correlation of the fundamental frequency of Quasi-Normal-Mode (QNM) ringing in gravitational and electromagnetic radiation. Information extraction from entangled pairs by detecting one over the surface spanned by three faces of a large cube carries a unit of information of $2\log3$ upon including measurement of spin.


title: An Enhanced Spectral Boundary Integral Method for Modeling Highly Nonlinear Water Waves in Variable Depth

abstract: This paper presents a new numerical model based on the highly nonlinear potential flow theory for simulating the propagation of water waves in variable depth. A new set of equations for estimating the surface vertical velocity is derived based on the boundary integral equation considering the water depth variability. A successive approximation scheme is also proposed in this study for calculating the surface vertical velocity. With the usage of Fast Fourier Transform, the model can be efficiently used for simulating highly nonlinear water waves on large spatiotemporal scale in a phase-resolving approach. The new model is comprehensively verified and validated through simulating a variety of nonlinear wave phenomenon including free propagating solitary wave, wave transformations over submerged bar, Bragg reflection over undulating bars, nonlinear evolution of Peregrine breather, obliquely propagating uniform waves and extreme waves in crossing random seas. Good agreements are achieved between the numerical simulations and laboratory measurements, indicating that the new model is sufficiently accurate. A discussion is presented on the accuracy and efficiency of the present model, which is compared with the Higher-Order Spectral method. The results show that the present model can be significantly more efficient at the same level of accuracy. It is suggested that the new model developed in the paper can be reliably used to simulate the nonlinear evolution of ocean waves in phase-resolving approach to shed light on the dynamics of nonlinear wave phenomenon taking place on a large spatiotemporal scale, which may be computationally expensive by using other existing methods.


title: An interpretable clustering approach to safety climate analysis: examining driver group distinction in safety climate perceptions

abstract: The transportation industry, particularly the trucking sector, is prone to workplace accidents and fatalities. Accidents involving large trucks accounted for a considerable percentage of overall traffic fatalities. Recognizing the crucial role of safety climate in accident prevention, researchers have sought to understand its factors and measure its impact within organizations. While existing data-driven safety climate studies have made remarkable progress, clustering employees based on their safety climate perception is innovative and has not been extensively utilized in research. Identifying clusters of drivers based on their safety climate perception allows the organization to profile its workforce and devise more impactful interventions. The lack of utilizing the clustering approach could be due to difficulties interpreting or explaining the factors influencing employees' cluster membership. Moreover, existing safety-related studies did not compare multiple clustering algorithms, resulting in potential bias. To address these issues, this study introduces an interpretable clustering approach for safety climate analysis. This study compares 5 algorithms for clustering truck drivers based on their safety climate perceptions. It proposes a novel method for quantitatively evaluating partial dependence plots (QPDP). To better interpret the clustering results, this study introduces different interpretable machine learning measures (SHAP, PFI, and QPDP). Drawing on data collected from more than 7,000 American truck drivers, this study significantly contributes to the scientific literature. It highlights the critical role of supervisory care promotion in distinguishing various driver groups. The Python code is available at https://github.com/NUS-DBE/truck-driver-safety-climate.


title: Musical Form Generation

abstract: While recent generative models can produce engaging music, their utility is limited. The variation in the music is often left to chance, resulting in compositions that lack structure. Pieces extending beyond a minute can become incoherent or repetitive. This paper introduces an approach for generating structured, arbitrarily long musical pieces. Central to this approach is the creation of musical segments using a conditional generative model, with transitions between these segments. The generation of prompts that determine the high-level composition is distinct from the creation of finer, lower-level details. A large language model is then used to suggest the musical form.


title: Modeling the Telemarketing Process using Genetic Algorithms and Extreme Boosting: Feature Selection and Cost-Sensitive Analytical Approach

abstract: Currently, almost all direct marketing activities take place virtually rather than in person, weakening interpersonal skills at an alarming pace. Furthermore, businesses have been striving to sense and foster the tendency of their clients to accept a marketing offer. The digital transformation and the increased virtual presence forced firms to seek novel marketing research approaches. This research aims at leveraging the power of telemarketing data in modeling the willingness of clients to make a term deposit and finding the most significant characteristics of the clients. Real-world data from a Portuguese bank and national socio-economic metrics are used to model the telemarketing decision-making process. This research makes two key contributions. First, propose a novel genetic algorithm-based classifier to select the best discriminating features and tune classifier parameters simultaneously. Second, build an explainable prediction model. The best-generated classification models were intensively validated using 50 times repeated 10-fold stratified cross-validation and the selected features have been analyzed. The models significantly outperform the related works in terms of class of interest accuracy, they attained an average of 89.07\% and 0.059 in terms of geometric mean and type I error respectively. The model is expected to maximize the potential profit margin at the least possible cost and provide more insights to support marketing decision-making.


title: Design and Analysis of Robust Ballistic Landings on the Secondary of a Binary Asteroid

abstract: ESA's Hera mission aims to visit binary asteroid Didymos in late 2026, investigating its physical characteristics and the result of NASA's impact by the DART spacecraft in more detail. Two CubeSats on-board Hera plan to perform a ballistic landing on the secondary of the system, called Dimorphos. For these types of landings the translational state during descent is not controlled, reducing the spacecrafts complexity but also increasing its sensitivity to deployment maneuver errors and dynamical uncertainties. This paper introduces a novel methodology to analyse the effect of these uncertainties on the dynamics of the lander and design a trajectory that is robust against them. This methodology consists of propagating the uncertain state of the lander using the non-intrusive Chebyshev interpolation (NCI) technique, which approximates the uncertain dynamics using a polynomial expansion, and analysing the results using the pseudo-diffusion indicator, derived from the coefficients of the polynomial expansion, which quantifies the rate of growth of the set of possible states of the spacecraft over time. This indicator is used here to constrain the impact velocity and angle to values which allow for successful settling on the surface. This information is then used to optimize the landing trajectory by applying the NCI technique inside the transcription of the problem. The resulting trajectory increases the robustness of the trajectory compared to a conventional method, improving the landing success by 20 percent and significantly reducing the landing footprint.

categories: astro-ph.IM astro-ph.EP cs.NA math.NA math.OC math.PR


title: Modified Genetic Algorithm for Feature Selection and Hyper Parameter Optimization: Case of XGBoost in Spam Prediction

abstract: Recently, spam on online social networks has attracted attention in the research and business world. Twitter has become the preferred medium to spread spam content. Many research efforts attempted to encounter social networks spam. Twitter brought extra challenges represented by the feature space size, and imbalanced data distributions. Usually, the related research works focus on part of these main challenges or produce black-box models. In this paper, we propose a modified genetic algorithm for simultaneous dimensionality reduction and hyper parameter optimization over imbalanced datasets. The algorithm initialized an eXtreme Gradient Boosting classifier and reduced the features space of tweets dataset; to generate a spam prediction model. The model is validated using a 50 times repeated 10-fold stratified cross-validation, and analyzed using nonparametric statistical tests. The resulted prediction model attains on average 82.32\% and 92.67\% in terms of geometric mean and accuracy respectively, utilizing less than 10\% of the total feature space. The empirical results show that the modified genetic algorithm outperforms $Chi^2$ and $PCA$ feature selection methods. In addition, eXtreme Gradient Boosting outperforms many machine learning algorithms, including BERT-based deep learning model, in spam prediction. Furthermore, the proposed approach is applied to SMS spam modeling and compared to related works.


title: A high-Q metasurface signal isolator for 1.5T surface coil magnetic resonance imaging on the go

abstract: The combination of surface coils and metamaterials remarkably enhance magnetic resonance imaging (MRI) performance for significant local staging flexibility. However, due to the coupling in between, impeded signal-to-noise ratio (SNR) and low-contrast resolution, further hamper the future growth in clinical MRI. In this paper, we propose a high-Q metasurface decoupling isolator fueled by topological LC loops for 1.5T surface coil MRI system, increasing the magnetic field up to fivefold at 63.8 MHz. We have employed a polarization conversion mechanism to effectively eliminate the coupling between the MRI metamaterial and the radio frequency (RF) surface transmitter-receiver coils. Furthermore, a high-Q metasurface isolator was achieved by taking advantage of bound states in the continuum (BIC) for extremely high-field MRI and spectroscopy. An equivalent physical model of the miniaturized metasurface design was put forward through LC circuit analysis. This study opens up a promising route for the easy-to-use and portable surface coil MRI scanners.


title: Integrals of Hyperbolic Tangent Function

abstract: By means of the contour integration method, we evaluate, in closed form, a class of definite integrals involving hyperbolic tangent function.


title: Efficient Exploration in Continuous-time Model-based Reinforcement Learning

abstract: Reinforcement learning algorithms typically consider discrete-time dynamics, even though the underlying systems are often continuous in time. In this paper, we introduce a model-based reinforcement learning algorithm that represents continuous-time dynamics using nonlinear ordinary differential equations (ODEs). We capture epistemic uncertainty using well-calibrated probabilistic models, and use the optimistic principle for exploration. Our regret bounds surface the importance of the measurement selection strategy(MSS), since in continuous time we not only must decide how to explore, but also when to observe the underlying system. Our analysis demonstrates that the regret is sublinear when modeling ODEs with Gaussian Processes (GP) for common choices of MSS, such as equidistant sampling. Additionally, we propose an adaptive, data-dependent, practical MSS that, when combined with GP dynamics, also achieves sublinear regret with significantly fewer samples. We showcase the benefits of continuous-time modeling over its discrete-time counterpart, as well as our proposed adaptive MSS over standard baselines, on several applications.


title: Predicting mutational effects on protein-protein binding via a side-chain diffusion probabilistic model

abstract: Many crucial biological processes rely on networks of protein-protein interactions. Predicting the effect of amino acid mutations on protein-protein binding is vital in protein engineering and therapeutic discovery. However, the scarcity of annotated experimental data on binding energy poses a significant challenge for developing computational approaches, particularly deep learning-based methods. In this work, we propose SidechainDiff, a representation learning-based approach that leverages unlabelled experimental protein structures. SidechainDiff utilizes a Riemannian diffusion model to learn the generative process of side-chain conformations and can also give the structural context representations of mutations on the protein-protein interface. Leveraging the learned representations, we achieve state-of-the-art performance in predicting the mutational effects on protein-protein binding. Furthermore, SidechainDiff is the first diffusion-based generative model for side-chains, distinguishing it from prior efforts that have predominantly focused on generating protein backbone structures.


title: Massive Case Study of Opinion Distribution in a Relationship with Mixed Trust and Distrust

abstract: The simulations in this paper are based on the theory of opinion dynamics, which incorporates both Opinion A and Opinion B, a case that is the inverse of Opinion A, in human relationships. It was confirmed that aspects of consensus building depend on the ratio of the trust coefficient to the distrust coefficient. In this study, the ratio of trust to distrust tended to vary like a phase transition around 55%, but we wanted to see if the same phenomenon could be confirmed in large-scale cases. In the previous case studies, this tendency has been observed from N = 300 to N = 1600 , and we will discuss the case of N = 10000 with N = 3000. By verifying the extent of the phenomenon on the social scale, we intend to consider simulation items for consensus building, such as consideration of the sensitivities of topics in online and offline opinion formation.


title: Steering droplets on substrates with plane-wave wettability patterns and deformations

abstract: Motivated by strategies for targeted microfluidic transport of droplets, we investigate how sessile droplets can be steered toward a preferred direction using travelling waves in substrate wettability or deformations of the substrate. To perform our numerical study, we implement the boundary-element method to solve the governing Stokes equations for the fluid flow field inside the moving droplet. In both cases we find two distinct modes of droplet motion. For small wave speed the droplet surfes with a constant velocity on the wave, while beyond a critical wave speed a periodic wobbling motion occurs, the period of which diverges at the transition. These observation can be rationalized by the nonuniform oscillator model and the transition described by a SNIPER bifurcation. For the travelling waves in wettability the mean droplet velocity in the wobbling state decays with the inverse wave speed. In contrast, for travelling-wave deformations of the substrate it is proportional to the wave speed at large speed values since the droplet always has to move up and down. To rationalize this behavior, the nonuniform oscillator model has to be extended. Since the critical wave speed of the bifurcation depends on the droplet radius, this dependence can be used to sort droplets by size.


title: AI Alignment: A Comprehensive Survey

abstract: AI alignment aims to make AI systems behave in line with human intentions and values. As AI systems grow more capable, so do risks from misalignment. To provide a comprehensive and up-to-date overview of the alignment field, in this survey, we delve into the core concepts, methodology, and practice of alignment. First, we identify four principles as the key objectives of AI alignment: Robustness, Interpretability, Controllability, and Ethicality (RICE). Guided by these four principles, we outline the landscape of current alignment research and decompose them into two key components: forward alignment and backward alignment. The former aims to make AI systems aligned via alignment training, while the latter aims to gain evidence about the systems' alignment and govern them appropriately to avoid exacerbating misalignment risks. On forward alignment, we discuss techniques for learning from feedback and learning under distribution shift. On backward alignment, we discuss assurance techniques and governance practices. We also release and continually update the website (www.alignmentsurvey.com) which features tutorials, collections of papers, blog posts, and other resources.


title: Soft modes in hot QCD matter

abstract: The chiral crossover of QCD at finite temperature and vanishing baryon density turns into a second order phase transition if lighter than physical quark masses are considered. If this transition occurs sufficiently close to the physical point, its universal critical behaviour would largely control the physics of the QCD phase transition. We quantify the size of this region in QCD using functional approaches, both Dyson-Schwinger equations and the functional renormalisation group. The latter allows us to study both critical and non-critical effects on an equal footing, facilitating a precise determination of the scaling regime. We find that the physical point is far away from the critical region. Importantly, we show that the physics of the chiral crossover is dominated by soft modes even far beyond the critical region. While scaling functions determine all thermodynamic properties of the system in the critical region, the order parameter potential is the relevant quantity away from it. We compute this potential in QCD using the functional renormalisation group and Dyson-Schwinger equations and provide a simple parametrisation for phenomenological applications.


title: Exact Recovery and Bregman Hard Clustering of Node-Attributed Stochastic Block Model

abstract: Network clustering tackles the problem of identifying sets of nodes (communities) that have similar connection patterns. However, in many scenarios, nodes also have attributes that are correlated with the clustering structure. Thus, network information (edges) and node information (attributes) can be jointly leveraged to design high-performance clustering algorithms. Under a general model for the network and node attributes, this work establishes an information-theoretic criterion for the exact recovery of community labels and characterizes a phase transition determined by the Chernoff-Hellinger divergence of the model. The criterion shows how network and attribute information can be exchanged in order to have exact recovery (e.g., more reliable network information requires less reliable attribute information). This work also presents an iterative clustering algorithm that maximizes the joint likelihood, assuming that the probability distribution of network interactions and node attributes belong to exponential families. This covers a broad range of possible interactions (e.g., edges with weights) and attributes (e.g., non-Gaussian models), as well as sparse networks, while also exploring the connection between exponential families and Bregman divergences. Extensive numerical experiments using synthetic data indicate that the proposed algorithm outperforms classic algorithms that leverage only network or only attribute information as well as state-of-the-art algorithms that also leverage both sources of information. The contributions of this work provide insights into the fundamental limits and practical techniques for inferring community labels on node-attributed networks.


title: GI-1.0: A Fast and Scalable Two-level Radiance Caching Scheme for Real-time Global Illumination

abstract: Real-time global illumination is key to enabling more dynamic and physically realistic worlds in performance-critical applications such as games or any other applications with real-time constraints.Hardware-accelerated ray tracing in modern GPUs allows arbitrary intersection queries against the geometry, making it possible to evaluate indirect lighting entirely at runtime. However, only a small number of rays can be traced at each pixel to maintain high framerates at ever-increasing image resolutions. Existing solutions, such as probe-based techniques, approximate the irradiance signal at the cost of a few rays per frame but suffer from a lack of details and slow response times to changes in lighting. On the other hand, reservoir-based resampling techniques capture much more details but typically suffer from poorer performance and increased amounts of noise, making them impractical for the current generation of hardware and gaming consoles. To find a balance that achieves high lighting fidelity while maintaining a low runtime cost, we propose a solution that dynamically estimates global illumination without needing any content preprocessing, thus enabling easy integration into existing real-time rendering pipelines.